=== RUN   TestAddons/Setup

addons_test.go:107: (dbg) Run:  out/minikube-linux-amd64 start -p addons-823670 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher

addons_test.go:107: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-823670 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher: signal: killed (39m59.942763549s)

-- stdout --

	* [addons-823670] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=19865

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19865-839778/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19865-839778/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-823670" primary control-plane node in "addons-823670" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.33.0

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.8

	  - Using image docker.io/registry:2.8.3

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	  - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8

	  - Using image docker.io/marcnuri/yakd:0.0.5

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.11.3

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	  - Using image docker.io/busybox:stable

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	* Verifying ingress addon...

	* Verifying registry addon...

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-823670 service yakd-dashboard -n yakd-dashboard

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3

	* Verifying csi-hostpath-driver addon...

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-823670 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: default-storageclass, inspektor-gadget, amd-gpu-device-plugin, storage-provisioner, ingress-dns, cloud-spanner, nvidia-device-plugin, metrics-server, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

-- /stdout --

** stderr ** 

	I1028 12:20:54.755622  847764 out.go:345] Setting OutFile to fd 1 ...

	I1028 12:20:54.755802  847764 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 12:20:54.755814  847764 out.go:358] Setting ErrFile to fd 2...

	I1028 12:20:54.755818  847764 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 12:20:54.755998  847764 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19865-839778/.minikube/bin

	I1028 12:20:54.756666  847764 out.go:352] Setting JSON to false

	I1028 12:20:54.757796  847764 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":7396,"bootTime":1730110659,"procs":178,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I1028 12:20:54.757907  847764 start.go:139] virtualization: kvm guest

	I1028 12:20:54.759736  847764 out.go:177] * [addons-823670] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	I1028 12:20:54.760997  847764 out.go:177]   - MINIKUBE_LOCATION=19865

	I1028 12:20:54.761046  847764 notify.go:220] Checking for updates...

	I1028 12:20:54.763536  847764 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1028 12:20:54.764907  847764 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 12:20:54.766195  847764 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 12:20:54.767420  847764 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1028 12:20:54.768840  847764 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1028 12:20:54.770451  847764 driver.go:394] Setting default libvirt URI to qemu:///system

	I1028 12:20:54.803810  847764 out.go:177] * Using the kvm2 driver based on user configuration

	I1028 12:20:54.805150  847764 start.go:297] selected driver: kvm2

	I1028 12:20:54.805169  847764 start.go:901] validating driver "kvm2" against <nil>

	I1028 12:20:54.805182  847764 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1028 12:20:54.805959  847764 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1028 12:20:54.806044  847764 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19865-839778/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I1028 12:20:54.822101  847764 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0

	I1028 12:20:54.822159  847764 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1028 12:20:54.822424  847764 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1028 12:20:54.822458  847764 cni.go:84] Creating CNI manager for ""

	I1028 12:20:54.822507  847764 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I1028 12:20:54.822526  847764 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I1028 12:20:54.822604  847764 start.go:340] cluster config:

	{Name:addons-823670 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:addons-823670 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c

rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg

entPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 12:20:54.822710  847764 iso.go:125] acquiring lock: {Name:mk3969ab3dff5daa2fa05bc5981fbcf53106ccb3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1028 12:20:54.824620  847764 out.go:177] * Starting "addons-823670" primary control-plane node in "addons-823670" cluster

	I1028 12:20:54.825814  847764 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 12:20:54.825877  847764 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4

	I1028 12:20:54.825886  847764 cache.go:56] Caching tarball of preloaded images

	I1028 12:20:54.825988  847764 preload.go:172] Found /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I1028 12:20:54.825998  847764 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on crio

	I1028 12:20:54.826733  847764 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/config.json ...

	I1028 12:20:54.826786  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/config.json: {Name:mkfd161659dfa6e6438321de29a09e6a9c2d027d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:20:54.826986  847764 start.go:360] acquireMachinesLock for addons-823670: {Name:mk3d8412df30fd3411bfb6262eb0fa70b21bf365 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1028 12:20:54.827040  847764 start.go:364] duration metric: took 40.308µs to acquireMachinesLock for "addons-823670"

	I1028 12:20:54.827060  847764 start.go:93] Provisioning new machine with config: &{Name:addons-823670 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.31.2 ClusterName:addons-823670 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 12:20:54.827191  847764 start.go:125] createHost starting for "" (driver="kvm2")

	I1028 12:20:54.828930  847764 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I1028 12:20:54.829133  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:20:54.829234  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:20:54.844465  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32985

	I1028 12:20:54.844974  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:20:54.845663  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:20:54.845686  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:20:54.846072  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:20:54.846320  847764 main.go:141] libmachine: (addons-823670) Calling .GetMachineName

	I1028 12:20:54.846465  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:20:54.846617  847764 start.go:159] libmachine.API.Create for "addons-823670" (driver="kvm2")

	I1028 12:20:54.846652  847764 client.go:168] LocalClient.Create starting

	I1028 12:20:54.846702  847764 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem

	I1028 12:20:55.263958  847764 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem

	I1028 12:20:55.338542  847764 main.go:141] libmachine: Running pre-create checks...

	I1028 12:20:55.338569  847764 main.go:141] libmachine: (addons-823670) Calling .PreCreateCheck

	I1028 12:20:55.339139  847764 main.go:141] libmachine: (addons-823670) Calling .GetConfigRaw

	I1028 12:20:55.339657  847764 main.go:141] libmachine: Creating machine...

	I1028 12:20:55.339674  847764 main.go:141] libmachine: (addons-823670) Calling .Create

	I1028 12:20:55.339848  847764 main.go:141] libmachine: (addons-823670) Creating KVM machine...

	I1028 12:20:55.340986  847764 main.go:141] libmachine: (addons-823670) DBG | found existing default KVM network

	I1028 12:20:55.341882  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:55.341683  847786 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000123350}

	I1028 12:20:55.341925  847764 main.go:141] libmachine: (addons-823670) DBG | created network xml: 

	I1028 12:20:55.341940  847764 main.go:141] libmachine: (addons-823670) DBG | <network>

	I1028 12:20:55.341955  847764 main.go:141] libmachine: (addons-823670) DBG |   <name>mk-addons-823670</name>

	I1028 12:20:55.342005  847764 main.go:141] libmachine: (addons-823670) DBG |   <dns enable='no'/>

	I1028 12:20:55.342028  847764 main.go:141] libmachine: (addons-823670) DBG |   

	I1028 12:20:55.342036  847764 main.go:141] libmachine: (addons-823670) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I1028 12:20:55.342044  847764 main.go:141] libmachine: (addons-823670) DBG |     <dhcp>

	I1028 12:20:55.342051  847764 main.go:141] libmachine: (addons-823670) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I1028 12:20:55.342058  847764 main.go:141] libmachine: (addons-823670) DBG |     </dhcp>

	I1028 12:20:55.342063  847764 main.go:141] libmachine: (addons-823670) DBG |   </ip>

	I1028 12:20:55.342067  847764 main.go:141] libmachine: (addons-823670) DBG |   

	I1028 12:20:55.342073  847764 main.go:141] libmachine: (addons-823670) DBG | </network>

	I1028 12:20:55.342079  847764 main.go:141] libmachine: (addons-823670) DBG | 

	I1028 12:20:55.347452  847764 main.go:141] libmachine: (addons-823670) DBG | trying to create private KVM network mk-addons-823670 192.168.39.0/24...

	I1028 12:20:55.419531  847764 main.go:141] libmachine: (addons-823670) DBG | private KVM network mk-addons-823670 192.168.39.0/24 created

	I1028 12:20:55.419598  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:55.419507  847786 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 12:20:55.419625  847764 main.go:141] libmachine: (addons-823670) Setting up store path in /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670 ...

	I1028 12:20:55.419650  847764 main.go:141] libmachine: (addons-823670) Building disk image from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso

	I1028 12:20:55.419669  847764 main.go:141] libmachine: (addons-823670) Downloading /home/jenkins/minikube-integration/19865-839778/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...

	I1028 12:20:55.703348  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:55.703155  847786 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa...

	I1028 12:20:55.966772  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:55.966596  847786 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/addons-823670.rawdisk...

	I1028 12:20:55.966811  847764 main.go:141] libmachine: (addons-823670) DBG | Writing magic tar header

	I1028 12:20:55.966827  847764 main.go:141] libmachine: (addons-823670) DBG | Writing SSH key tar header

	I1028 12:20:55.966839  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:55.966731  847786 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670 ...

	I1028 12:20:55.966853  847764 main.go:141] libmachine: (addons-823670) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670

	I1028 12:20:55.966919  847764 main.go:141] libmachine: (addons-823670) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670 (perms=drwx------)

	I1028 12:20:55.966947  847764 main.go:141] libmachine: (addons-823670) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines

	I1028 12:20:55.966958  847764 main.go:141] libmachine: (addons-823670) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines (perms=drwxr-xr-x)

	I1028 12:20:55.966970  847764 main.go:141] libmachine: (addons-823670) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube (perms=drwxr-xr-x)

	I1028 12:20:55.966975  847764 main.go:141] libmachine: (addons-823670) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778 (perms=drwxrwxr-x)

	I1028 12:20:55.966982  847764 main.go:141] libmachine: (addons-823670) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I1028 12:20:55.966988  847764 main.go:141] libmachine: (addons-823670) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I1028 12:20:55.966997  847764 main.go:141] libmachine: (addons-823670) Creating domain...

	I1028 12:20:55.967010  847764 main.go:141] libmachine: (addons-823670) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 12:20:55.967025  847764 main.go:141] libmachine: (addons-823670) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778

	I1028 12:20:55.967040  847764 main.go:141] libmachine: (addons-823670) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I1028 12:20:55.967051  847764 main.go:141] libmachine: (addons-823670) DBG | Checking permissions on dir: /home/jenkins

	I1028 12:20:55.967061  847764 main.go:141] libmachine: (addons-823670) DBG | Checking permissions on dir: /home

	I1028 12:20:55.967067  847764 main.go:141] libmachine: (addons-823670) DBG | Skipping /home - not owner

	I1028 12:20:55.968192  847764 main.go:141] libmachine: (addons-823670) define libvirt domain using xml: 

	I1028 12:20:55.968232  847764 main.go:141] libmachine: (addons-823670) <domain type='kvm'>

	I1028 12:20:55.968244  847764 main.go:141] libmachine: (addons-823670)   <name>addons-823670</name>

	I1028 12:20:55.968255  847764 main.go:141] libmachine: (addons-823670)   <memory unit='MiB'>4000</memory>

	I1028 12:20:55.968265  847764 main.go:141] libmachine: (addons-823670)   <vcpu>2</vcpu>

	I1028 12:20:55.968270  847764 main.go:141] libmachine: (addons-823670)   <features>

	I1028 12:20:55.968277  847764 main.go:141] libmachine: (addons-823670)     <acpi/>

	I1028 12:20:55.968284  847764 main.go:141] libmachine: (addons-823670)     <apic/>

	I1028 12:20:55.968291  847764 main.go:141] libmachine: (addons-823670)     <pae/>

	I1028 12:20:55.968295  847764 main.go:141] libmachine: (addons-823670)     

	I1028 12:20:55.968303  847764 main.go:141] libmachine: (addons-823670)   </features>

	I1028 12:20:55.968307  847764 main.go:141] libmachine: (addons-823670)   <cpu mode='host-passthrough'>

	I1028 12:20:55.968314  847764 main.go:141] libmachine: (addons-823670)   

	I1028 12:20:55.968324  847764 main.go:141] libmachine: (addons-823670)   </cpu>

	I1028 12:20:55.968356  847764 main.go:141] libmachine: (addons-823670)   <os>

	I1028 12:20:55.968401  847764 main.go:141] libmachine: (addons-823670)     <type>hvm</type>

	I1028 12:20:55.968414  847764 main.go:141] libmachine: (addons-823670)     <boot dev='cdrom'/>

	I1028 12:20:55.968422  847764 main.go:141] libmachine: (addons-823670)     <boot dev='hd'/>

	I1028 12:20:55.968427  847764 main.go:141] libmachine: (addons-823670)     <bootmenu enable='no'/>

	I1028 12:20:55.968433  847764 main.go:141] libmachine: (addons-823670)   </os>

	I1028 12:20:55.968439  847764 main.go:141] libmachine: (addons-823670)   <devices>

	I1028 12:20:55.968446  847764 main.go:141] libmachine: (addons-823670)     <disk type='file' device='cdrom'>

	I1028 12:20:55.968455  847764 main.go:141] libmachine: (addons-823670)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/boot2docker.iso'/>

	I1028 12:20:55.968466  847764 main.go:141] libmachine: (addons-823670)       <target dev='hdc' bus='scsi'/>

	I1028 12:20:55.968477  847764 main.go:141] libmachine: (addons-823670)       <readonly/>

	I1028 12:20:55.968487  847764 main.go:141] libmachine: (addons-823670)     </disk>

	I1028 12:20:55.968536  847764 main.go:141] libmachine: (addons-823670)     <disk type='file' device='disk'>

	I1028 12:20:55.968570  847764 main.go:141] libmachine: (addons-823670)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I1028 12:20:55.968593  847764 main.go:141] libmachine: (addons-823670)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/addons-823670.rawdisk'/>

	I1028 12:20:55.968611  847764 main.go:141] libmachine: (addons-823670)       <target dev='hda' bus='virtio'/>

	I1028 12:20:55.968626  847764 main.go:141] libmachine: (addons-823670)     </disk>

	I1028 12:20:55.968637  847764 main.go:141] libmachine: (addons-823670)     <interface type='network'>

	I1028 12:20:55.968646  847764 main.go:141] libmachine: (addons-823670)       <source network='mk-addons-823670'/>

	I1028 12:20:55.968656  847764 main.go:141] libmachine: (addons-823670)       <model type='virtio'/>

	I1028 12:20:55.968670  847764 main.go:141] libmachine: (addons-823670)     </interface>

	I1028 12:20:55.968682  847764 main.go:141] libmachine: (addons-823670)     <interface type='network'>

	I1028 12:20:55.968696  847764 main.go:141] libmachine: (addons-823670)       <source network='default'/>

	I1028 12:20:55.968714  847764 main.go:141] libmachine: (addons-823670)       <model type='virtio'/>

	I1028 12:20:55.968729  847764 main.go:141] libmachine: (addons-823670)     </interface>

	I1028 12:20:55.968740  847764 main.go:141] libmachine: (addons-823670)     <serial type='pty'>

	I1028 12:20:55.968752  847764 main.go:141] libmachine: (addons-823670)       <target port='0'/>

	I1028 12:20:55.968762  847764 main.go:141] libmachine: (addons-823670)     </serial>

	I1028 12:20:55.968789  847764 main.go:141] libmachine: (addons-823670)     <console type='pty'>

	I1028 12:20:55.968804  847764 main.go:141] libmachine: (addons-823670)       <target type='serial' port='0'/>

	I1028 12:20:55.968821  847764 main.go:141] libmachine: (addons-823670)     </console>

	I1028 12:20:55.968835  847764 main.go:141] libmachine: (addons-823670)     <rng model='virtio'>

	I1028 12:20:55.968844  847764 main.go:141] libmachine: (addons-823670)       <backend model='random'>/dev/random</backend>

	I1028 12:20:55.968852  847764 main.go:141] libmachine: (addons-823670)     </rng>

	I1028 12:20:55.968861  847764 main.go:141] libmachine: (addons-823670)     

	I1028 12:20:55.968868  847764 main.go:141] libmachine: (addons-823670)     

	I1028 12:20:55.968875  847764 main.go:141] libmachine: (addons-823670)   </devices>

	I1028 12:20:55.968881  847764 main.go:141] libmachine: (addons-823670) </domain>

	I1028 12:20:55.968898  847764 main.go:141] libmachine: (addons-823670) 

	I1028 12:20:55.974529  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:2d:b5:3b in network default

	I1028 12:20:55.975105  847764 main.go:141] libmachine: (addons-823670) Ensuring networks are active...

	I1028 12:20:55.975135  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:20:55.975774  847764 main.go:141] libmachine: (addons-823670) Ensuring network default is active

	I1028 12:20:55.976154  847764 main.go:141] libmachine: (addons-823670) Ensuring network mk-addons-823670 is active

	I1028 12:20:55.976738  847764 main.go:141] libmachine: (addons-823670) Getting domain xml...

	I1028 12:20:55.977484  847764 main.go:141] libmachine: (addons-823670) Creating domain...

	I1028 12:20:57.437375  847764 main.go:141] libmachine: (addons-823670) Waiting to get IP...

	I1028 12:20:57.438183  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:20:57.438564  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:20:57.438610  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:57.438532  847786 retry.go:31] will retry after 296.001504ms: waiting for machine to come up

	I1028 12:20:57.736210  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:20:57.736832  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:20:57.736863  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:57.736773  847786 retry.go:31] will retry after 236.912089ms: waiting for machine to come up

	I1028 12:20:57.975307  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:20:57.975833  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:20:57.975864  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:57.975779  847786 retry.go:31] will retry after 383.289697ms: waiting for machine to come up

	I1028 12:20:58.360483  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:20:58.360930  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:20:58.360961  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:58.360848  847786 retry.go:31] will retry after 473.40266ms: waiting for machine to come up

	I1028 12:20:58.835779  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:20:58.836241  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:20:58.836281  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:58.836183  847786 retry.go:31] will retry after 466.746463ms: waiting for machine to come up

	I1028 12:20:59.304824  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:20:59.305301  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:20:59.305337  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:20:59.305245  847786 retry.go:31] will retry after 808.227102ms: waiting for machine to come up

	I1028 12:21:00.114842  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:00.115469  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:00.115545  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:00.115339  847786 retry.go:31] will retry after 823.188338ms: waiting for machine to come up

	I1028 12:21:00.940391  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:00.940784  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:00.940814  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:00.940730  847786 retry.go:31] will retry after 1.305581922s: waiting for machine to come up

	I1028 12:21:02.248324  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:02.248766  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:02.248796  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:02.248708  847786 retry.go:31] will retry after 1.567907081s: waiting for machine to come up

	I1028 12:21:03.817991  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:03.818414  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:03.818442  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:03.818370  847786 retry.go:31] will retry after 1.875493951s: waiting for machine to come up

	I1028 12:21:05.695585  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:05.696083  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:05.696162  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:05.696062  847786 retry.go:31] will retry after 1.76924265s: waiting for machine to come up

	I1028 12:21:07.468282  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:07.468762  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:07.468798  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:07.468702  847786 retry.go:31] will retry after 2.298886387s: waiting for machine to come up

	I1028 12:21:09.771200  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:09.771698  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:09.771727  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:09.771648  847786 retry.go:31] will retry after 3.785102906s: waiting for machine to come up

	I1028 12:21:13.561209  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:13.561579  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find current IP address of domain addons-823670 in network mk-addons-823670

	I1028 12:21:13.561604  847764 main.go:141] libmachine: (addons-823670) DBG | I1028 12:21:13.561511  847786 retry.go:31] will retry after 4.114279674s: waiting for machine to come up

	I1028 12:21:17.679049  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:17.679570  847764 main.go:141] libmachine: (addons-823670) Found IP for machine: 192.168.39.173

	I1028 12:21:17.679595  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has current primary IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:17.679601  847764 main.go:141] libmachine: (addons-823670) Reserving static IP address...

	I1028 12:21:17.679955  847764 main.go:141] libmachine: (addons-823670) DBG | unable to find host DHCP lease matching {name: "addons-823670", mac: "52:54:00:54:7a:e3", ip: "192.168.39.173"} in network mk-addons-823670

	I1028 12:21:17.763686  847764 main.go:141] libmachine: (addons-823670) DBG | Getting to WaitForSSH function...

	I1028 12:21:17.763722  847764 main.go:141] libmachine: (addons-823670) Reserved static IP address: 192.168.39.173

	I1028 12:21:17.763736  847764 main.go:141] libmachine: (addons-823670) Waiting for SSH to be available...

	I1028 12:21:17.766270  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:17.766684  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:minikube Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:17.766710  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:17.766888  847764 main.go:141] libmachine: (addons-823670) DBG | Using SSH client type: external

	I1028 12:21:17.766917  847764 main.go:141] libmachine: (addons-823670) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa (-rw-------)

	I1028 12:21:17.766954  847764 main.go:141] libmachine: (addons-823670) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.173 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 12:21:17.766971  847764 main.go:141] libmachine: (addons-823670) DBG | About to run SSH command:

	I1028 12:21:17.766987  847764 main.go:141] libmachine: (addons-823670) DBG | exit 0

	I1028 12:21:17.895884  847764 main.go:141] libmachine: (addons-823670) DBG | SSH cmd err, output: <nil>: 

	I1028 12:21:17.896254  847764 main.go:141] libmachine: (addons-823670) KVM machine creation complete!

	I1028 12:21:17.896559  847764 main.go:141] libmachine: (addons-823670) Calling .GetConfigRaw

	I1028 12:21:17.897316  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:17.897568  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:17.897780  847764 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I1028 12:21:17.897799  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:17.899368  847764 main.go:141] libmachine: Detecting operating system of created instance...

	I1028 12:21:17.899386  847764 main.go:141] libmachine: Waiting for SSH to be available...

	I1028 12:21:17.899394  847764 main.go:141] libmachine: Getting to WaitForSSH function...

	I1028 12:21:17.899402  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:17.901710  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:17.902130  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:17.902156  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:17.902304  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:17.902529  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:17.902699  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:17.902842  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:17.903009  847764 main.go:141] libmachine: Using SSH client type: native

	I1028 12:21:17.903215  847764 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.173 22 <nil> <nil>}

	I1028 12:21:17.903227  847764 main.go:141] libmachine: About to run SSH command:

	exit 0

	I1028 12:21:18.015251  847764 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 12:21:18.015284  847764 main.go:141] libmachine: Detecting the provisioner...

	I1028 12:21:18.015295  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.018659  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.018994  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.019035  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.019231  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:18.019469  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.019646  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.019794  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:18.019944  847764 main.go:141] libmachine: Using SSH client type: native

	I1028 12:21:18.020118  847764 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.173 22 <nil> <nil>}

	I1028 12:21:18.020128  847764 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I1028 12:21:18.132514  847764 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I1028 12:21:18.132619  847764 main.go:141] libmachine: found compatible host: buildroot

	I1028 12:21:18.132631  847764 main.go:141] libmachine: Provisioning with buildroot...

	I1028 12:21:18.132640  847764 main.go:141] libmachine: (addons-823670) Calling .GetMachineName

	I1028 12:21:18.132929  847764 buildroot.go:166] provisioning hostname "addons-823670"

	I1028 12:21:18.132969  847764 main.go:141] libmachine: (addons-823670) Calling .GetMachineName

	I1028 12:21:18.133140  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.135825  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.136295  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.136326  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.136509  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:18.136757  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.136950  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.137173  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:18.137341  847764 main.go:141] libmachine: Using SSH client type: native

	I1028 12:21:18.137515  847764 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.173 22 <nil> <nil>}

	I1028 12:21:18.137528  847764 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-823670 && echo "addons-823670" | sudo tee /etc/hostname

	I1028 12:21:18.261705  847764 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-823670

	I1028 12:21:18.261740  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.264888  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.265297  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.265326  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.265518  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:18.265724  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.265896  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.265991  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:18.266126  847764 main.go:141] libmachine: Using SSH client type: native

	I1028 12:21:18.266350  847764 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.173 22 <nil> <nil>}

	I1028 12:21:18.266378  847764 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-823670' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-823670/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-823670' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1028 12:21:18.385253  847764 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 12:21:18.385289  847764 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19865-839778/.minikube CaCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19865-839778/.minikube}

	I1028 12:21:18.385339  847764 buildroot.go:174] setting up certificates

	I1028 12:21:18.385357  847764 provision.go:84] configureAuth start

	I1028 12:21:18.385371  847764 main.go:141] libmachine: (addons-823670) Calling .GetMachineName

	I1028 12:21:18.385743  847764 main.go:141] libmachine: (addons-823670) Calling .GetIP

	I1028 12:21:18.388876  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.389278  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.389305  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.389455  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.392090  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.392459  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.392487  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.392678  847764 provision.go:143] copyHostCerts

	I1028 12:21:18.392779  847764 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem (1082 bytes)

	I1028 12:21:18.392945  847764 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem (1123 bytes)

	I1028 12:21:18.393045  847764 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem (1679 bytes)

	I1028 12:21:18.393116  847764 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem org=jenkins.addons-823670 san=[127.0.0.1 192.168.39.173 addons-823670 localhost minikube]

	I1028 12:21:18.470165  847764 provision.go:177] copyRemoteCerts

	I1028 12:21:18.470233  847764 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1028 12:21:18.470261  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.473261  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.473773  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.473812  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.474097  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:18.474297  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.474468  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:18.474637  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:18.561948  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1028 12:21:18.585803  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I1028 12:21:18.609335  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1028 12:21:18.632272  847764 provision.go:87] duration metric: took 246.89778ms to configureAuth

	I1028 12:21:18.632308  847764 buildroot.go:189] setting minikube options for container-runtime

	I1028 12:21:18.632510  847764 config.go:182] Loaded profile config "addons-823670": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 12:21:18.632598  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.635595  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.636017  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.636045  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.636307  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:18.636523  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.636703  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.636831  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:18.637013  847764 main.go:141] libmachine: Using SSH client type: native

	I1028 12:21:18.637253  847764 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.173 22 <nil> <nil>}

	I1028 12:21:18.637276  847764 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1028 12:21:18.864231  847764 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1028 12:21:18.864263  847764 main.go:141] libmachine: Checking connection to Docker...

	I1028 12:21:18.864272  847764 main.go:141] libmachine: (addons-823670) Calling .GetURL

	I1028 12:21:18.865808  847764 main.go:141] libmachine: (addons-823670) DBG | Using libvirt version 6000000

	I1028 12:21:18.868151  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.868499  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.868532  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.868724  847764 main.go:141] libmachine: Docker is up and running!

	I1028 12:21:18.868743  847764 main.go:141] libmachine: Reticulating splines...

	I1028 12:21:18.868751  847764 client.go:171] duration metric: took 24.022087856s to LocalClient.Create

	I1028 12:21:18.868786  847764 start.go:167] duration metric: took 24.022169812s to libmachine.API.Create "addons-823670"

	I1028 12:21:18.868814  847764 start.go:293] postStartSetup for "addons-823670" (driver="kvm2")

	I1028 12:21:18.868833  847764 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1028 12:21:18.868860  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:18.869146  847764 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1028 12:21:18.869174  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.871188  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.871478  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.871509  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.871585  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:18.871803  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.871958  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:18.872186  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:18.958534  847764 ssh_runner.go:195] Run: cat /etc/os-release

	I1028 12:21:18.962761  847764 info.go:137] Remote host: Buildroot 2023.02.9

	I1028 12:21:18.962789  847764 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/addons for local assets ...

	I1028 12:21:18.962865  847764 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/files for local assets ...

	I1028 12:21:18.962890  847764 start.go:296] duration metric: took 94.065663ms for postStartSetup

	I1028 12:21:18.962930  847764 main.go:141] libmachine: (addons-823670) Calling .GetConfigRaw

	I1028 12:21:18.963503  847764 main.go:141] libmachine: (addons-823670) Calling .GetIP

	I1028 12:21:18.966322  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.966756  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.966790  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.967064  847764 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/config.json ...

	I1028 12:21:18.967255  847764 start.go:128] duration metric: took 24.140051665s to createHost

	I1028 12:21:18.967281  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:18.969461  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.969854  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:18.969890  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:18.970074  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:18.970306  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.970480  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:18.970632  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:18.970787  847764 main.go:141] libmachine: Using SSH client type: native

	I1028 12:21:18.970999  847764 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.173 22 <nil> <nil>}

	I1028 12:21:18.971014  847764 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1028 12:21:19.084339  847764 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730118079.059202296

	I1028 12:21:19.084377  847764 fix.go:216] guest clock: 1730118079.059202296

	I1028 12:21:19.084391  847764 fix.go:229] Guest: 2024-10-28 12:21:19.059202296 +0000 UTC Remote: 2024-10-28 12:21:18.967268411 +0000 UTC m=+24.252536372 (delta=91.933885ms)

	I1028 12:21:19.084416  847764 fix.go:200] guest clock delta is within tolerance: 91.933885ms

	I1028 12:21:19.084421  847764 start.go:83] releasing machines lock for "addons-823670", held for 24.25737241s

	I1028 12:21:19.084449  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:19.084775  847764 main.go:141] libmachine: (addons-823670) Calling .GetIP

	I1028 12:21:19.087281  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:19.087633  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:19.087664  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:19.087816  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:19.088417  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:19.088627  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:19.088757  847764 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1028 12:21:19.088832  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:19.088881  847764 ssh_runner.go:195] Run: cat /version.json

	I1028 12:21:19.088910  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:19.091961  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:19.092069  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:19.092349  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:19.092382  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:19.092417  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:19.092431  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:19.092545  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:19.092733  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:19.092788  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:19.092890  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:19.092962  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:19.093018  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:19.093088  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:19.093122  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:19.206899  847764 ssh_runner.go:195] Run: systemctl --version

	I1028 12:21:19.213069  847764 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1028 12:21:19.371842  847764 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1028 12:21:19.377978  847764 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1028 12:21:19.378070  847764 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1028 12:21:19.394105  847764 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1028 12:21:19.394146  847764 start.go:495] detecting cgroup driver to use...

	I1028 12:21:19.394234  847764 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1028 12:21:19.409779  847764 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1028 12:21:19.424207  847764 docker.go:217] disabling cri-docker service (if available) ...

	I1028 12:21:19.424298  847764 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1028 12:21:19.438369  847764 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1028 12:21:19.452499  847764 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1028 12:21:19.564264  847764 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1028 12:21:19.729385  847764 docker.go:233] disabling docker service ...

	I1028 12:21:19.729478  847764 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1028 12:21:19.743075  847764 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1028 12:21:19.756051  847764 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1028 12:21:19.874334  847764 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1028 12:21:19.985104  847764 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1028 12:21:19.999914  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1028 12:21:20.020046  847764 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I1028 12:21:20.020127  847764 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 12:21:20.031411  847764 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1028 12:21:20.031497  847764 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 12:21:20.043905  847764 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 12:21:20.056706  847764 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 12:21:20.068989  847764 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1028 12:21:20.079685  847764 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 12:21:20.090388  847764 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 12:21:20.107348  847764 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 12:21:20.117437  847764 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1028 12:21:20.126327  847764 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1028 12:21:20.126395  847764 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1028 12:21:20.139247  847764 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1028 12:21:20.148912  847764 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 12:21:20.259698  847764 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1028 12:21:20.347113  847764 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I1028 12:21:20.347223  847764 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1028 12:21:20.352480  847764 start.go:563] Will wait 60s for crictl version

	I1028 12:21:20.352587  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:21:20.356377  847764 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1028 12:21:20.394166  847764 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I1028 12:21:20.394280  847764 ssh_runner.go:195] Run: crio --version

	I1028 12:21:20.422074  847764 ssh_runner.go:195] Run: crio --version

	I1028 12:21:20.450778  847764 out.go:177] * Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	I1028 12:21:20.452217  847764 main.go:141] libmachine: (addons-823670) Calling .GetIP

	I1028 12:21:20.455113  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:20.455530  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:20.455561  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:20.455788  847764 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I1028 12:21:20.459978  847764 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 12:21:20.471972  847764 kubeadm.go:883] updating cluster {Name:addons-823670 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.

2 ClusterName:addons-823670 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.173 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT

ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1028 12:21:20.472122  847764 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 12:21:20.472170  847764 ssh_runner.go:195] Run: sudo crictl images --output json

	I1028 12:21:20.503374  847764 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.31.2". assuming images are not preloaded.

	I1028 12:21:20.503487  847764 ssh_runner.go:195] Run: which lz4

	I1028 12:21:20.507471  847764 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I1028 12:21:20.511406  847764 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1028 12:21:20.511452  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (392059347 bytes)

	I1028 12:21:21.666202  847764 crio.go:462] duration metric: took 1.15877631s to copy over tarball

	I1028 12:21:21.666293  847764 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I1028 12:21:23.916434  847764 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.250106301s)

	I1028 12:21:23.916469  847764 crio.go:469] duration metric: took 2.250224369s to extract the tarball

	I1028 12:21:23.916478  847764 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1028 12:21:23.953715  847764 ssh_runner.go:195] Run: sudo crictl images --output json

	I1028 12:21:23.996053  847764 crio.go:514] all images are preloaded for cri-o runtime.

	I1028 12:21:23.996090  847764 cache_images.go:84] Images are preloaded, skipping loading

	I1028 12:21:23.996100  847764 kubeadm.go:934] updating node { 192.168.39.173 8443 v1.31.2 crio true true} ...

	I1028 12:21:23.996252  847764 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-823670 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.173

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:addons-823670 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1028 12:21:23.996336  847764 ssh_runner.go:195] Run: crio config

	I1028 12:21:24.042058  847764 cni.go:84] Creating CNI manager for ""

	I1028 12:21:24.042085  847764 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I1028 12:21:24.042099  847764 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1028 12:21:24.042143  847764 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.173 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-823670 NodeName:addons-823670 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.173"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.173 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k

ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1028 12:21:24.042311  847764 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.173

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-823670"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.39.173"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.173"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      - name: "proxy-refresh-interval"

	        value: "70000"

	kubernetesVersion: v1.31.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1028 12:21:24.042383  847764 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1028 12:21:24.052086  847764 binaries.go:44] Found k8s binaries, skipping transfer

	I1028 12:21:24.052181  847764 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I1028 12:21:24.061286  847764 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I1028 12:21:24.077513  847764 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1028 12:21:24.093354  847764 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2293 bytes)

	I1028 12:21:24.109951  847764 ssh_runner.go:195] Run: grep 192.168.39.173	control-plane.minikube.internal$ /etc/hosts

	I1028 12:21:24.113801  847764 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.173	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 12:21:24.125619  847764 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 12:21:24.249270  847764 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 12:21:24.266173  847764 certs.go:68] Setting up /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670 for IP: 192.168.39.173

	I1028 12:21:24.266206  847764 certs.go:194] generating shared ca certs ...

	I1028 12:21:24.266230  847764 certs.go:226] acquiring lock for ca certs: {Name:mk72dd610cd229d2e25ba7be15f7e5f7b195435a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.266413  847764 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key

	I1028 12:21:24.465430  847764 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt ...

	I1028 12:21:24.465464  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt: {Name:mk50913350dc6e26d6c11aac2612b12749d5d12d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.465665  847764 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key ...

	I1028 12:21:24.465681  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key: {Name:mk75b41ecb60d7634a9f07704a607681c0b1344b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.465783  847764 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key

	I1028 12:21:24.552437  847764 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt ...

	I1028 12:21:24.552474  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt: {Name:mk32a23f86d0c1ce1766726cbbec036b33587a32 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.552684  847764 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key ...

	I1028 12:21:24.552701  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key: {Name:mk5f999bbc9aeeec83a94857f4e349c4881059b5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.552806  847764 certs.go:256] generating profile certs ...

	I1028 12:21:24.552867  847764 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/client.key

	I1028 12:21:24.552883  847764 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/client.crt with IP's: []

	I1028 12:21:24.729346  847764 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/client.crt ...

	I1028 12:21:24.729382  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/client.crt: {Name:mk0c3662c2360b8cdf0205e0909b3e09316c60ff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.729585  847764 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/client.key ...

	I1028 12:21:24.729601  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/client.key: {Name:mk1a94368c1699f637e4cfee50dd910ef0c25e72 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.729712  847764 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.key.814a30e6

	I1028 12:21:24.729734  847764 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.crt.814a30e6 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.173]

	I1028 12:21:24.828442  847764 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.crt.814a30e6 ...

	I1028 12:21:24.828478  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.crt.814a30e6: {Name:mkfaa045fdb3f7827afd6fed8fd484deb3e7ee8f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.828659  847764 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.key.814a30e6 ...

	I1028 12:21:24.828675  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.key.814a30e6: {Name:mk2b861c16f983d257f267eb79f504966d83c7c4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.828747  847764 certs.go:381] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.crt.814a30e6 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.crt

	I1028 12:21:24.828825  847764 certs.go:385] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.key.814a30e6 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.key

	I1028 12:21:24.828870  847764 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.key

	I1028 12:21:24.828890  847764 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.crt with IP's: []

	I1028 12:21:24.912952  847764 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.crt ...

	I1028 12:21:24.912993  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.crt: {Name:mk06380f44f4bccd57781521c2a8748111b6db42 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.913184  847764 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.key ...

	I1028 12:21:24.913198  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.key: {Name:mkc1b4d09bca2d6225179fb2a2d08cf18c14fc39 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:24.913372  847764 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem (1679 bytes)

	I1028 12:21:24.913410  847764 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem (1082 bytes)

	I1028 12:21:24.913436  847764 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem (1123 bytes)

	I1028 12:21:24.913458  847764 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem (1679 bytes)

	I1028 12:21:24.914067  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1028 12:21:24.939652  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1028 12:21:24.968192  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1028 12:21:24.997641  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1028 12:21:25.021515  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I1028 12:21:25.045814  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1028 12:21:25.069780  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1028 12:21:25.093722  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/addons-823670/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1028 12:21:25.117746  847764 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1028 12:21:25.140834  847764 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1028 12:21:25.157157  847764 ssh_runner.go:195] Run: openssl version

	I1028 12:21:25.162835  847764 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1028 12:21:25.173751  847764 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1028 12:21:25.178565  847764 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:21 /usr/share/ca-certificates/minikubeCA.pem

	I1028 12:21:25.178652  847764 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1028 12:21:25.184678  847764 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1028 12:21:25.195778  847764 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1028 12:21:25.200205  847764 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1028 12:21:25.200269  847764 kubeadm.go:392] StartCluster: {Name:addons-823670 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 C

lusterName:addons-823670 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.173 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType

:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 12:21:25.200358  847764 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I1028 12:21:25.200407  847764 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1028 12:21:25.236545  847764 cri.go:89] found id: ""

	I1028 12:21:25.236626  847764 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1028 12:21:25.246983  847764 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1028 12:21:25.257514  847764 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1028 12:21:25.267180  847764 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1028 12:21:25.267201  847764 kubeadm.go:157] found existing configuration files:

	I1028 12:21:25.267249  847764 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1028 12:21:25.276388  847764 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1028 12:21:25.276477  847764 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1028 12:21:25.285894  847764 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1028 12:21:25.294977  847764 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1028 12:21:25.295065  847764 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1028 12:21:25.304683  847764 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1028 12:21:25.314311  847764 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1028 12:21:25.314390  847764 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1028 12:21:25.323954  847764 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1028 12:21:25.333071  847764 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1028 12:21:25.333144  847764 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1028 12:21:25.343217  847764 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I1028 12:21:25.402625  847764 kubeadm.go:310] [init] Using Kubernetes version: v1.31.2

	I1028 12:21:25.402717  847764 kubeadm.go:310] [preflight] Running pre-flight checks

	I1028 12:21:25.505393  847764 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1028 12:21:25.505566  847764 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1028 12:21:25.505724  847764 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I1028 12:21:25.512881  847764 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1028 12:21:25.636168  847764 out.go:235]   - Generating certificates and keys ...

	I1028 12:21:25.636326  847764 kubeadm.go:310] [certs] Using existing ca certificate authority

	I1028 12:21:25.636428  847764 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I1028 12:21:25.901917  847764 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1028 12:21:26.226998  847764 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I1028 12:21:26.303916  847764 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I1028 12:21:26.582119  847764 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I1028 12:21:26.626558  847764 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I1028 12:21:26.626751  847764 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [addons-823670 localhost] and IPs [192.168.39.173 127.0.0.1 ::1]

	I1028 12:21:26.828235  847764 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I1028 12:21:26.828396  847764 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [addons-823670 localhost] and IPs [192.168.39.173 127.0.0.1 ::1]

	I1028 12:21:27.150600  847764 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1028 12:21:27.349998  847764 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I1028 12:21:27.448726  847764 kubeadm.go:310] [certs] Generating "sa" key and public key

	I1028 12:21:27.448811  847764 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1028 12:21:27.524292  847764 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1028 12:21:27.739265  847764 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I1028 12:21:27.987261  847764 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1028 12:21:28.150971  847764 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1028 12:21:28.307632  847764 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1028 12:21:28.308891  847764 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1028 12:21:28.312885  847764 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1028 12:21:28.404790  847764 out.go:235]   - Booting up control plane ...

	I1028 12:21:28.405004  847764 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1028 12:21:28.405171  847764 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1028 12:21:28.405267  847764 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1028 12:21:28.405447  847764 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1028 12:21:28.405599  847764 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1028 12:21:28.405668  847764 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I1028 12:21:28.471624  847764 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I1028 12:21:28.471764  847764 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I1028 12:21:28.973099  847764 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 502.047421ms

	I1028 12:21:28.973215  847764 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I1028 12:21:34.471365  847764 kubeadm.go:310] [api-check] The API server is healthy after 5.501699261s

	I1028 12:21:34.489727  847764 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1028 12:21:34.509107  847764 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1028 12:21:34.544401  847764 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I1028 12:21:34.544698  847764 kubeadm.go:310] [mark-control-plane] Marking the node addons-823670 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1028 12:21:34.564125  847764 kubeadm.go:310] [bootstrap-token] Using token: tufq2s.erzpgx67pz86jjci

	I1028 12:21:34.566056  847764 out.go:235]   - Configuring RBAC rules ...

	I1028 12:21:34.566212  847764 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1028 12:21:34.578204  847764 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1028 12:21:34.589309  847764 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1028 12:21:34.594660  847764 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1028 12:21:34.603284  847764 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1028 12:21:34.611856  847764 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1028 12:21:34.878733  847764 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1028 12:21:35.305783  847764 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I1028 12:21:35.882291  847764 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I1028 12:21:35.883974  847764 kubeadm.go:310] 

	I1028 12:21:35.884131  847764 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I1028 12:21:35.884151  847764 kubeadm.go:310] 

	I1028 12:21:35.884272  847764 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I1028 12:21:35.884282  847764 kubeadm.go:310] 

	I1028 12:21:35.884303  847764 kubeadm.go:310]   mkdir -p $HOME/.kube

	I1028 12:21:35.884379  847764 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1028 12:21:35.884435  847764 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1028 12:21:35.884449  847764 kubeadm.go:310] 

	I1028 12:21:35.884522  847764 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I1028 12:21:35.884541  847764 kubeadm.go:310] 

	I1028 12:21:35.884610  847764 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1028 12:21:35.884618  847764 kubeadm.go:310] 

	I1028 12:21:35.884689  847764 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I1028 12:21:35.884793  847764 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1028 12:21:35.884885  847764 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1028 12:21:35.884898  847764 kubeadm.go:310] 

	I1028 12:21:35.885014  847764 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I1028 12:21:35.885138  847764 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I1028 12:21:35.885150  847764 kubeadm.go:310] 

	I1028 12:21:35.885271  847764 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token tufq2s.erzpgx67pz86jjci \

	I1028 12:21:35.885405  847764 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d \

	I1028 12:21:35.885433  847764 kubeadm.go:310] 	--control-plane 

	I1028 12:21:35.885440  847764 kubeadm.go:310] 

	I1028 12:21:35.885573  847764 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I1028 12:21:35.885588  847764 kubeadm.go:310] 

	I1028 12:21:35.885686  847764 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token tufq2s.erzpgx67pz86jjci \

	I1028 12:21:35.885846  847764 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d 

	I1028 12:21:35.886974  847764 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1028 12:21:35.887005  847764 cni.go:84] Creating CNI manager for ""

	I1028 12:21:35.887016  847764 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I1028 12:21:35.889076  847764 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I1028 12:21:35.890537  847764 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I1028 12:21:35.901475  847764 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I1028 12:21:35.922791  847764 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1028 12:21:35.922883  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:35.922883  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-823670 minikube.k8s.io/updated_at=2024_10_28T12_21_35_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=addons-823670 minikube.k8s.io/primary=true

	I1028 12:21:36.072956  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:36.072957  847764 ops.go:34] apiserver oom_adj: -16

	I1028 12:21:36.573164  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:37.073494  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:37.573156  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:38.073656  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:38.573414  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:39.073275  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:39.573399  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:40.073999  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:40.573414  847764 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 12:21:40.708508  847764 kubeadm.go:1113] duration metric: took 4.785697008s to wait for elevateKubeSystemPrivileges

	I1028 12:21:40.708560  847764 kubeadm.go:394] duration metric: took 15.508297583s to StartCluster

	I1028 12:21:40.708581  847764 settings.go:142] acquiring lock: {Name:mk5bff38fc6565138d7b896c5c59f693f2cf271a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:40.708712  847764 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 12:21:40.709120  847764 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/kubeconfig: {Name:mk593b26e38c75daf24e9303475967cc0bb4e68e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 12:21:40.709346  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1028 12:21:40.709365  847764 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:true auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I1028 12:21:40.709341  847764 start.go:235] Will wait 6m0s for node &{Name: IP:192.168.39.173 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 12:21:40.709468  847764 addons.go:69] Setting yakd=true in profile "addons-823670"

	I1028 12:21:40.709508  847764 addons.go:69] Setting inspektor-gadget=true in profile "addons-823670"

	I1028 12:21:40.709521  847764 addons.go:69] Setting storage-provisioner=true in profile "addons-823670"

	I1028 12:21:40.709527  847764 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-823670"

	I1028 12:21:40.709539  847764 addons.go:234] Setting addon inspektor-gadget=true in "addons-823670"

	I1028 12:21:40.709542  847764 addons.go:234] Setting addon storage-provisioner=true in "addons-823670"

	I1028 12:21:40.709549  847764 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-823670"

	I1028 12:21:40.709554  847764 addons.go:69] Setting metrics-server=true in profile "addons-823670"

	I1028 12:21:40.709558  847764 addons.go:69] Setting registry=true in profile "addons-823670"

	I1028 12:21:40.709578  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.709580  847764 addons.go:234] Setting addon metrics-server=true in "addons-823670"

	I1028 12:21:40.709586  847764 addons.go:69] Setting amd-gpu-device-plugin=true in profile "addons-823670"

	I1028 12:21:40.709593  847764 addons.go:234] Setting addon registry=true in "addons-823670"

	I1028 12:21:40.709597  847764 addons.go:234] Setting addon amd-gpu-device-plugin=true in "addons-823670"

	I1028 12:21:40.709612  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.709617  847764 addons.go:69] Setting cloud-spanner=true in profile "addons-823670"

	I1028 12:21:40.709628  847764 addons.go:234] Setting addon cloud-spanner=true in "addons-823670"

	I1028 12:21:40.709635  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.709647  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.709687  847764 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-823670"

	I1028 12:21:40.709710  847764 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-823670"

	I1028 12:21:40.709580  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.710040  847764 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-823670"

	I1028 12:21:40.710075  847764 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-823670"

	I1028 12:21:40.710078  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710094  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.710110  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710136  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710149  847764 addons.go:69] Setting gcp-auth=true in profile "addons-823670"

	I1028 12:21:40.710155  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.710169  847764 mustload.go:65] Loading cluster: addons-823670

	I1028 12:21:40.710181  847764 addons.go:69] Setting volcano=true in profile "addons-823670"

	I1028 12:21:40.710194  847764 addons.go:234] Setting addon volcano=true in "addons-823670"

	I1028 12:21:40.710218  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.710335  847764 config.go:182] Loaded profile config "addons-823670": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 12:21:40.710399  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710428  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.710460  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710480  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.710555  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710582  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.710598  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710633  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.710653  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.710682  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.709490  847764 addons.go:234] Setting addon yakd=true in "addons-823670"

	I1028 12:21:40.710762  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.710894  847764 addons.go:69] Setting ingress=true in profile "addons-823670"

	I1028 12:21:40.710916  847764 config.go:182] Loaded profile config "addons-823670": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 12:21:40.710920  847764 addons.go:234] Setting addon ingress=true in "addons-823670"

	I1028 12:21:40.710955  847764 addons.go:69] Setting ingress-dns=true in profile "addons-823670"

	I1028 12:21:40.710993  847764 addons.go:234] Setting addon ingress-dns=true in "addons-823670"

	I1028 12:21:40.711029  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.711072  847764 addons.go:69] Setting volumesnapshots=true in profile "addons-823670"

	I1028 12:21:40.711090  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.711096  847764 addons.go:234] Setting addon volumesnapshots=true in "addons-823670"

	I1028 12:21:40.710959  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.711278  847764 addons.go:69] Setting default-storageclass=true in profile "addons-823670"

	I1028 12:21:40.711321  847764 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-823670"

	I1028 12:21:40.711567  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.711592  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.711714  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.711782  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.711043  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.709613  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.710169  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.709578  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.718177  847764 out.go:177] * Verifying Kubernetes components...

	I1028 12:21:40.710137  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.718308  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.718792  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.718838  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.720089  847764 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 12:21:40.730247  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44993

	I1028 12:21:40.730809  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.731286  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42363

	I1028 12:21:40.731698  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.731718  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.731742  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.732242  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.732258  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.732261  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.732394  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34143

	I1028 12:21:40.732941  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.732987  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.733222  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.733309  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.733804  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.733830  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.733863  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.733892  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.734204  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.736655  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.736678  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.736709  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.736721  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.736727  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.736685  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.736843  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.736874  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.754387  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34917

	I1028 12:21:40.754435  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46173

	I1028 12:21:40.754592  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34791

	I1028 12:21:40.754814  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.754863  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.755206  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.755213  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.755985  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.756007  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.756022  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.756039  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.756474  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.756541  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.757028  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.757070  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.757346  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.757686  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.757728  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.758217  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.758241  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.758670  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.758892  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.760938  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.761368  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.761393  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.774514  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36539

	I1028 12:21:40.774913  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37793

	I1028 12:21:40.775122  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.775447  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.776231  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.776251  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.776735  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.777396  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.777422  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.777652  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44539

	I1028 12:21:40.778222  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.778698  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.778721  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.779180  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.779390  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.782090  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39097

	I1028 12:21:40.782097  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34627

	I1028 12:21:40.782356  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.782372  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.782622  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41177

	I1028 12:21:40.782822  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.783326  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.783339  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.783357  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.783861  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37889

	I1028 12:21:40.783877  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.784020  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.784037  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.784042  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.784174  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.784231  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.784391  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.784702  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.785234  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.785256  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.785369  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.785427  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.785654  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.785923  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.785944  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.786177  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.786431  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.786601  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I1028 12:21:40.786651  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.786690  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.787379  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.789832  847764 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-823670"

	I1028 12:21:40.789885  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.789967  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I1028 12:21:40.790276  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.790317  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.790717  847764 addons.go:234] Setting addon default-storageclass=true in "addons-823670"

	I1028 12:21:40.790757  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:40.791120  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.791151  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.791628  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.791671  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.792263  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I1028 12:21:40.793705  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I1028 12:21:40.794365  847764 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.33.0

	I1028 12:21:40.794512  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46533

	I1028 12:21:40.795250  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.795903  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.795924  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.796006  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37765

	I1028 12:21:40.796106  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I1028 12:21:40.796253  847764 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I1028 12:21:40.796275  847764 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5248 bytes)

	I1028 12:21:40.796305  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.798446  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I1028 12:21:40.798710  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34083

	I1028 12:21:40.800786  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.801204  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I1028 12:21:40.801496  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.801520  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.801773  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.802142  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.802244  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.802406  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.803016  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.803034  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.803126  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.803142  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.803176  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.803437  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I1028 12:21:40.803651  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.803677  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.803838  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.803884  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.804163  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.804233  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.804441  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.804582  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.804657  847764 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I1028 12:21:40.804684  847764 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I1028 12:21:40.804724  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.806946  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.808819  847764 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.24

	I1028 12:21:40.808897  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.809427  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.809458  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.809671  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.809901  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.810094  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.810200  847764 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I1028 12:21:40.810223  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I1028 12:21:40.810247  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.810252  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.810981  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.812248  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42345

	I1028 12:21:40.812741  847764 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.8

	I1028 12:21:40.812850  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.813393  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.813413  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.813844  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.813848  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.813972  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.814478  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.814262  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.814444  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.814648  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.814982  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.815216  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.815389  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.815994  847764 out.go:177]   - Using image docker.io/registry:2.8.3

	I1028 12:21:40.817514  847764 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I1028 12:21:40.817535  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (860 bytes)

	I1028 12:21:40.817557  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.818262  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39897

	I1028 12:21:40.819098  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.819987  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.820010  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.820500  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.820737  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.820935  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.821254  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.821274  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.823042  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.823298  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.823502  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.824005  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.826607  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38045

	I1028 12:21:40.826762  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35835

	I1028 12:21:40.827211  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.827274  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.827792  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.827815  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.827833  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.827855  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.828221  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.828815  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.828864  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.829101  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.829675  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.829714  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.833615  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46497

	I1028 12:21:40.839080  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41167

	I1028 12:21:40.839920  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.840050  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.840575  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.840597  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.840762  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.840772  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.841191  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.841850  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.841902  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.842136  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43029

	I1028 12:21:40.842170  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38183

	I1028 12:21:40.842294  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.842309  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37339

	I1028 12:21:40.842809  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.842878  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.843433  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.843455  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.843503  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38709

	I1028 12:21:40.843530  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41159

	I1028 12:21:40.844121  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.844135  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44733

	I1028 12:21:40.844145  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.844158  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.844124  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.844250  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.844440  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.844526  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.844684  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.844703  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.844824  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.844834  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.844945  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.844957  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.845175  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.845308  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.845424  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.845492  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.846098  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.846172  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.846459  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.846527  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.846580  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.847126  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.847792  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:40.847835  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:40.847859  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.847912  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.848325  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.848438  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.848498  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.849287  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.849355  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.849831  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:40.849849  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:40.851157  847764 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I1028 12:21:40.852212  847764 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.2

	I1028 12:21:40.851256  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.853322  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42197

	I1028 12:21:40.851265  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40557

	I1028 12:21:40.851275  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.851277  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:40.851309  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:40.853436  847764 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I1028 12:21:40.853959  847764 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I1028 12:21:40.853960  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.853982  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.854022  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:40.854061  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:40.854069  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:40.854197  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.854911  847764 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I1028 12:21:40.854931  847764 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I1028 12:21:40.854959  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.855372  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:40.855414  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:40.855420  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	W1028 12:21:40.855506  847764 out.go:270] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	I1028 12:21:40.855727  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.855801  847764 out.go:177]   - Using image docker.io/rocm/k8s-device-plugin:1.25.2.8

	I1028 12:21:40.855874  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.856048  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.856066  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.856677  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.857695  847764 addons.go:431] installing /etc/kubernetes/addons/amd-gpu-device-plugin.yaml

	I1028 12:21:40.857715  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/amd-gpu-device-plugin.yaml (1868 bytes)

	I1028 12:21:40.857737  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.858520  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.858625  847764 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.5

	I1028 12:21:40.859393  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.860539  847764 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I1028 12:21:40.860563  847764 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I1028 12:21:40.860587  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.861452  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.861751  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37881

	I1028 12:21:40.862260  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.862759  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.862774  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.863362  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.863390  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.863475  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.863493  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.863825  847764 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.11.3

	I1028 12:21:40.864103  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.864186  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.864222  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.864240  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.864255  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.864280  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.864309  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.864608  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.864661  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.864617  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.864707  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.864732  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.865048  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.864827  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.865346  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.865391  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.865346  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.865668  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.866002  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.866230  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.866640  847764 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4

	I1028 12:21:40.866813  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.867435  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.867448  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.867454  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.867709  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.867964  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.868158  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.868219  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.868497  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.869309  847764 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4

	I1028 12:21:40.869395  847764 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.3

	I1028 12:21:40.870145  847764 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1028 12:21:40.870942  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43325

	I1028 12:21:40.871100  847764 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I1028 12:21:40.871120  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I1028 12:21:40.871137  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.871235  847764 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I1028 12:21:40.871287  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I1028 12:21:40.871307  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.871682  847764 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1028 12:21:40.871698  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1028 12:21:40.871715  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.871963  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.872542  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.872564  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.873664  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.874113  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.875547  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.876000  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.876115  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.876131  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.876259  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.876294  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.876450  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.876588  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.876653  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.876667  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.876773  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.876794  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.876812  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.876820  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.877008  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.877180  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.877190  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.877348  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.877379  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.877402  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.877508  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.877584  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38095

	I1028 12:21:40.877640  847764 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1028 12:21:40.877641  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.877654  847764 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1028 12:21:40.877675  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.878067  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.878774  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.878798  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.879156  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.879485  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.881036  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.881474  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.881497  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.881805  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.881978  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.882128  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.882277  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.882826  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.884816  847764 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I1028 12:21:40.885931  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39721

	I1028 12:21:40.886503  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:40.886968  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:40.886989  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:40.887390  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:40.887554  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:40.887586  847764 out.go:177]   - Using image docker.io/busybox:stable

	I1028 12:21:40.889140  847764 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1028 12:21:40.889161  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I1028 12:21:40.889182  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.889545  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:40.891247  847764 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.16.2

	I1028 12:21:40.892088  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.892576  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.892600  847764 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I1028 12:21:40.892603  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.892616  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I1028 12:21:40.892638  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:40.892794  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.892969  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.893110  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.893252  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:40.895617  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.896040  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:40.896063  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:40.896209  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:40.896381  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:40.896506  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:40.896590  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:41.144341  847764 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I1028 12:21:41.144376  847764 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I1028 12:21:41.168905  847764 addons.go:431] installing /etc/kubernetes/addons/ig-deployment.yaml

	I1028 12:21:41.168931  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-deployment.yaml (14451 bytes)

	I1028 12:21:41.216057  847764 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I1028 12:21:41.216090  847764 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I1028 12:21:41.249332  847764 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I1028 12:21:41.249372  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I1028 12:21:41.250298  847764 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I1028 12:21:41.250324  847764 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I1028 12:21:41.259270  847764 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I1028 12:21:41.259303  847764 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I1028 12:21:41.278559  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1028 12:21:41.324122  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I1028 12:21:41.327238  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml

	I1028 12:21:41.352345  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I1028 12:21:41.377931  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml

	I1028 12:21:41.411140  847764 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I1028 12:21:41.411183  847764 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I1028 12:21:41.424847  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1028 12:21:41.430045  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I1028 12:21:41.431997  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I1028 12:21:41.445707  847764 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I1028 12:21:41.445742  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I1028 12:21:41.456679  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I1028 12:21:41.467849  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I1028 12:21:41.479134  847764 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I1028 12:21:41.479166  847764 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I1028 12:21:41.485467  847764 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I1028 12:21:41.485494  847764 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I1028 12:21:41.552280  847764 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I1028 12:21:41.552309  847764 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I1028 12:21:41.592460  847764 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I1028 12:21:41.592494  847764 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I1028 12:21:41.651126  847764 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I1028 12:21:41.651159  847764 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I1028 12:21:41.655680  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1028 12:21:41.655683  847764 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 12:21:41.658256  847764 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I1028 12:21:41.658281  847764 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I1028 12:21:41.767473  847764 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I1028 12:21:41.767516  847764 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I1028 12:21:41.810232  847764 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I1028 12:21:41.810262  847764 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I1028 12:21:41.816477  847764 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I1028 12:21:41.816502  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I1028 12:21:41.877339  847764 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I1028 12:21:41.877377  847764 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I1028 12:21:41.959705  847764 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I1028 12:21:41.959768  847764 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I1028 12:21:42.016112  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I1028 12:21:42.043726  847764 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1028 12:21:42.043773  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I1028 12:21:42.044635  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I1028 12:21:42.228429  847764 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I1028 12:21:42.228464  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I1028 12:21:42.333673  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1028 12:21:42.545850  847764 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I1028 12:21:42.545881  847764 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I1028 12:21:42.623536  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.344931375s)

	I1028 12:21:42.623590  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:42.623602  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:42.623994  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:42.624078  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:42.624099  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:42.624113  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:42.624124  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:42.624513  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:42.624540  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:42.624550  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:42.635679  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:42.635713  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:42.636201  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:42.636225  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:42.636246  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:42.852258  847764 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I1028 12:21:42.852288  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I1028 12:21:43.123596  847764 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I1028 12:21:43.123632  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I1028 12:21:43.406009  847764 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1028 12:21:43.406054  847764 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I1028 12:21:43.734396  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I1028 12:21:47.848202  847764 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I1028 12:21:47.848256  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:47.851947  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:47.852516  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:47.852543  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:47.852747  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:47.852968  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:47.853204  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:47.853378  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:48.092374  847764 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I1028 12:21:48.145431  847764 addons.go:234] Setting addon gcp-auth=true in "addons-823670"

	I1028 12:21:48.145502  847764 host.go:66] Checking if "addons-823670" exists ...

	I1028 12:21:48.145948  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:48.145986  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:48.162906  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42767

	I1028 12:21:48.163517  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:48.164096  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:48.164128  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:48.164478  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:48.164993  847764 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 12:21:48.165029  847764 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 12:21:48.182322  847764 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32935

	I1028 12:21:48.182850  847764 main.go:141] libmachine: () Calling .GetVersion

	I1028 12:21:48.183399  847764 main.go:141] libmachine: Using API Version  1

	I1028 12:21:48.183429  847764 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 12:21:48.183849  847764 main.go:141] libmachine: () Calling .GetMachineName

	I1028 12:21:48.184046  847764 main.go:141] libmachine: (addons-823670) Calling .GetState

	I1028 12:21:48.185869  847764 main.go:141] libmachine: (addons-823670) Calling .DriverName

	I1028 12:21:48.186160  847764 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I1028 12:21:48.186187  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHHostname

	I1028 12:21:48.189380  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:48.189730  847764 main.go:141] libmachine: (addons-823670) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:54:7a:e3", ip: ""} in network mk-addons-823670: {Iface:virbr1 ExpiryTime:2024-10-28 13:21:10 +0000 UTC Type:0 Mac:52:54:00:54:7a:e3 Iaid: IPaddr:192.168.39.173 Prefix:24 Hostname:addons-823670 Clientid:01:52:54:00:54:7a:e3}

	I1028 12:21:48.189768  847764 main.go:141] libmachine: (addons-823670) DBG | domain addons-823670 has defined IP address 192.168.39.173 and MAC address 52:54:00:54:7a:e3 in network mk-addons-823670

	I1028 12:21:48.189907  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHPort

	I1028 12:21:48.190094  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHKeyPath

	I1028 12:21:48.190369  847764 main.go:141] libmachine: (addons-823670) Calling .GetSSHUsername

	I1028 12:21:48.190573  847764 sshutil.go:53] new ssh client: &{IP:192.168.39.173 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/addons-823670/id_rsa Username:docker}

	I1028 12:21:48.801026  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.476856048s)

	I1028 12:21:48.801113  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801117  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-deployment.yaml: (7.473841906s)

	I1028 12:21:48.801168  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801186  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801203  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.448823997s)

	I1028 12:21:48.801125  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801242  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801258  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801323  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/amd-gpu-device-plugin.yaml: (7.423354965s)

	I1028 12:21:48.801363  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801379  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801439  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.376555655s)

	I1028 12:21:48.801468  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801476  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801489  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (7.371417345s)

	I1028 12:21:48.801506  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801517  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801566  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.369542267s)

	I1028 12:21:48.801584  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801590  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (7.344883728s)

	I1028 12:21:48.801609  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801618  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801594  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801650  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (7.333767626s)

	I1028 12:21:48.801699  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801707  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801738  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.801775  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.801783  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.801792  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801811  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801874  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.801881  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.801887  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.801889  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.801895  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801903  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801935  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.801896  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801952  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.801960  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.801967  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.801975  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.801983  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.802025  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.802234  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.802247  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.802492  847764 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (7.146714097s)

	I1028 12:21:48.803582  847764 node_ready.go:35] waiting up to 6m0s for node "addons-823670" to be "Ready" ...

	I1028 12:21:48.803783  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.787629507s)

	I1028 12:21:48.803817  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.803818  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.803833  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.803863  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (6.759201962s)

	I1028 12:21:48.803878  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.803883  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.803887  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.803899  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.803925  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.803932  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.803943  847764 addons.go:475] Verifying addon ingress=true in "addons-823670"

	I1028 12:21:48.807312  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.807338  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.807348  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.807357  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.807437  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.807444  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.807452  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.807459  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.807509  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.807530  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.807545  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.807552  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.807558  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.807597  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.807620  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.807640  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.807645  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.807657  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.807663  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.807706  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.807717  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.807725  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.807731  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.808726  847764 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (7.145971348s)

	I1028 12:21:48.808764  847764 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I1028 12:21:48.810382  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.810427  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.810450  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.810463  847764 addons.go:475] Verifying addon registry=true in "addons-823670"

	I1028 12:21:48.810488  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.810513  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.810522  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.810529  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.810622  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.810638  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.810657  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.810673  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.810735  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.810773  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.810785  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.810816  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.810830  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.810901  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.810955  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.810977  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.811021  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.811054  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.811057  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.811064  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.811067  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.811074  847764 addons.go:475] Verifying addon metrics-server=true in "addons-823670"

	I1028 12:21:48.811115  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.810432  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.811345  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.811372  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.811405  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.811445  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.811465  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.811464  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.47771908s)

	I1028 12:21:48.811884  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:48.811920  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.811932  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	W1028 12:21:48.811516  847764 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1028 12:21:48.812705  847764 retry.go:31] will retry after 234.801378ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I1028 12:21:48.812760  847764 out.go:177] * Verifying ingress addon...

	I1028 12:21:48.812837  847764 out.go:177] * Verifying registry addon...

	I1028 12:21:48.813582  847764 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-823670 service yakd-dashboard -n yakd-dashboard

	I1028 12:21:48.815503  847764 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I1028 12:21:48.815540  847764 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I1028 12:21:48.822839  847764 node_ready.go:49] node "addons-823670" has status "Ready":"True"

	I1028 12:21:48.822874  847764 node_ready.go:38] duration metric: took 19.263953ms for node "addons-823670" to be "Ready" ...

	I1028 12:21:48.822888  847764 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 12:21:48.830159  847764 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I1028 12:21:48.830191  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:48.830318  847764 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I1028 12:21:48.830350  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:48.850145  847764 pod_ready.go:79] waiting up to 6m0s for pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace to be "Ready" ...

	I1028 12:21:48.888839  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:48.888870  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:48.889226  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:48.889251  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:48.889265  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:49.048757  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I1028 12:21:49.315052  847764 kapi.go:214] "coredns" deployment in "kube-system" namespace and "addons-823670" context rescaled to 1 replicas

	I1028 12:21:49.321111  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:49.321557  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:49.837876  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:49.838136  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:50.335867  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:50.346227  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:50.675680  847764 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.48949324s)

	I1028 12:21:50.675830  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.941378523s)

	I1028 12:21:50.675903  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:50.675924  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:50.675830  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (1.627015787s)

	I1028 12:21:50.675985  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:50.676006  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:50.677190  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:50.677214  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:50.677224  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:50.677233  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:50.677233  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:50.677236  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:50.677248  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:50.677263  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:50.677273  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:50.677281  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:50.677486  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:50.677579  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:50.677593  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:50.677590  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:50.677608  847764 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-823670"

	I1028 12:21:50.677616  847764 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.3

	I1028 12:21:50.677887  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:50.677903  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:50.679571  847764 out.go:177] * Verifying csi-hostpath-driver addon...

	I1028 12:21:50.681211  847764 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.4

	I1028 12:21:50.682180  847764 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I1028 12:21:50.682699  847764 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I1028 12:21:50.682723  847764 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I1028 12:21:50.698804  847764 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I1028 12:21:50.698830  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:50.746510  847764 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I1028 12:21:50.746547  847764 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I1028 12:21:50.801534  847764 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1028 12:21:50.801562  847764 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I1028 12:21:50.820411  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:50.821144  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:50.840675  847764 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I1028 12:21:50.857975  847764 pod_ready.go:103] pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace has status "Ready":"False"

	I1028 12:21:51.186729  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:51.327124  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:51.327986  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:51.687026  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:51.840213  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:51.841979  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:51.979566  847764 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.138836332s)

	I1028 12:21:51.979646  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:51.979663  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:51.980054  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:51.980137  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:51.980159  847764 main.go:141] libmachine: Making call to close driver server

	I1028 12:21:51.980170  847764 main.go:141] libmachine: (addons-823670) Calling .Close

	I1028 12:21:51.980177  847764 main.go:141] libmachine: (addons-823670) DBG | Closing plugin on server side

	I1028 12:21:51.980504  847764 main.go:141] libmachine: Successfully made call to close driver server

	I1028 12:21:51.980527  847764 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 12:21:51.981764  847764 addons.go:475] Verifying addon gcp-auth=true in "addons-823670"

	I1028 12:21:51.983959  847764 out.go:177] * Verifying gcp-auth addon...

	I1028 12:21:51.986628  847764 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I1028 12:21:52.049607  847764 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I1028 12:21:52.049633  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:52.191580  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:52.320976  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:52.321670  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:52.491971  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:52.687242  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:52.820903  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:52.821311  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:52.993389  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:53.186334  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:53.321365  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:53.321627  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:53.356327  847764 pod_ready.go:103] pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace has status "Ready":"False"

	I1028 12:21:53.490334  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:53.686585  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:53.819668  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:53.819872  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:53.996268  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:54.187195  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:54.321643  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:54.321780  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:54.491190  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:54.687310  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:54.820226  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:54.820616  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:54.990000  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:55.186952  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:55.327186  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:55.328577  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:55.358094  847764 pod_ready.go:103] pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace has status "Ready":"False"

	I1028 12:21:55.606312  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:55.687680  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:55.820863  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:55.822164  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:55.990515  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:56.186138  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:56.320972  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:56.321053  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:56.491121  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:56.691469  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:56.823731  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:56.824116  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:56.991217  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:57.187440  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:57.321311  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:57.321318  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:57.360713  847764 pod_ready.go:103] pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace has status "Ready":"False"

	I1028 12:21:57.490753  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:57.686980  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:57.820161  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:57.821571  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:57.991317  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:58.186765  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:58.319862  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:58.320051  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:58.490775  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:58.686522  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:58.820730  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:58.820883  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:58.990588  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:59.187127  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:59.320543  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:59.321145  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:59.490614  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:21:59.686878  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:21:59.820838  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:21:59.821893  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:21:59.855996  847764 pod_ready.go:103] pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace has status "Ready":"False"

	I1028 12:21:59.990557  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:00.186691  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:00.319911  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:00.320497  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:00.491071  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:00.687420  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:00.819969  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:00.820699  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:00.857336  847764 pod_ready.go:93] pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace has status "Ready":"True"

	I1028 12:22:00.857375  847764 pod_ready.go:82] duration metric: took 12.007193125s for pod "amd-gpu-device-plugin-dtc8c" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.857389  847764 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-btjkt" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.862873  847764 pod_ready.go:93] pod "coredns-7c65d6cfc9-btjkt" in "kube-system" namespace has status "Ready":"True"

	I1028 12:22:00.862905  847764 pod_ready.go:82] duration metric: took 5.507271ms for pod "coredns-7c65d6cfc9-btjkt" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.862918  847764 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-vzhrd" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.864826  847764 pod_ready.go:98] error getting pod "coredns-7c65d6cfc9-vzhrd" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-vzhrd" not found

	I1028 12:22:00.864852  847764 pod_ready.go:82] duration metric: took 1.925251ms for pod "coredns-7c65d6cfc9-vzhrd" in "kube-system" namespace to be "Ready" ...

	E1028 12:22:00.864866  847764 pod_ready.go:67] WaitExtra: waitPodCondition: error getting pod "coredns-7c65d6cfc9-vzhrd" in "kube-system" namespace (skipping!): pods "coredns-7c65d6cfc9-vzhrd" not found

	I1028 12:22:00.864874  847764 pod_ready.go:79] waiting up to 6m0s for pod "etcd-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.870326  847764 pod_ready.go:93] pod "etcd-addons-823670" in "kube-system" namespace has status "Ready":"True"

	I1028 12:22:00.870352  847764 pod_ready.go:82] duration metric: took 5.47013ms for pod "etcd-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.870365  847764 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.874762  847764 pod_ready.go:93] pod "kube-apiserver-addons-823670" in "kube-system" namespace has status "Ready":"True"

	I1028 12:22:00.874790  847764 pod_ready.go:82] duration metric: took 4.41739ms for pod "kube-apiserver-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.874802  847764 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:00.990882  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:01.054633  847764 pod_ready.go:93] pod "kube-controller-manager-addons-823670" in "kube-system" namespace has status "Ready":"True"

	I1028 12:22:01.054663  847764 pod_ready.go:82] duration metric: took 179.853266ms for pod "kube-controller-manager-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:01.054677  847764 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-przxw" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:01.187069  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:01.322393  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:01.322438  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:01.577903  847764 pod_ready.go:93] pod "kube-proxy-przxw" in "kube-system" namespace has status "Ready":"True"

	I1028 12:22:01.577942  847764 pod_ready.go:82] duration metric: took 523.25748ms for pod "kube-proxy-przxw" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:01.577964  847764 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:01.578639  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:01.687935  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:01.819674  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:01.819689  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:01.854630  847764 pod_ready.go:93] pod "kube-scheduler-addons-823670" in "kube-system" namespace has status "Ready":"True"

	I1028 12:22:01.854668  847764 pod_ready.go:82] duration metric: took 276.693703ms for pod "kube-scheduler-addons-823670" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:01.854687  847764 pod_ready.go:79] waiting up to 6m0s for pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace to be "Ready" ...

	I1028 12:22:01.991354  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:02.187476  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:02.320243  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:02.320801  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:02.490441  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:02.688443  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:02.819991  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:02.820639  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:02.990171  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:03.188000  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:03.321342  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:03.321566  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:03.490262  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:03.688624  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:03.820005  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:03.820110  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:03.860993  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:03.991096  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:04.187728  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:04.321355  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:04.322046  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:04.490305  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:04.687420  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:04.819894  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:04.820254  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:04.989827  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:05.187292  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:05.319581  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:05.320417  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:05.490005  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:05.687230  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:05.819932  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:05.820164  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:06.012907  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:06.525969  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:06.526031  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:06.526659  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:06.526877  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:06.530798  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:06.686860  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:06.820615  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:06.820622  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:06.990764  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:07.186783  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:07.320593  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:07.320776  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:07.490826  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:07.687332  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:07.821660  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:07.821836  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:08.178815  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:08.301590  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:08.324217  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:08.324582  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:08.490896  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:08.687274  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:08.819732  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:08.819954  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:08.860618  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:08.990627  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:09.187073  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:09.319517  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:09.319576  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:09.491313  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:09.690747  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:09.820915  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:09.821236  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:09.990930  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:10.187819  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:10.322308  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:10.322443  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:10.490867  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:10.687307  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:10.821236  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:10.821596  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:10.862143  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:10.990262  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:11.187436  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:11.320282  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:11.321494  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:11.490506  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:11.690056  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:11.820573  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:11.820693  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:11.991103  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:12.187648  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:12.326086  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:12.326327  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:12.491604  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:12.686459  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:12.819656  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:12.820113  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:12.990945  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:13.187718  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:13.320471  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:13.320626  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:13.360590  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:13.490601  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:13.686951  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:13.820334  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:13.820722  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:13.989992  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:14.187121  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:14.851251  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:14.851375  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:14.851895  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:14.852622  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:14.869715  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:14.869791  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:14.990491  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:15.186727  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:15.323080  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:15.323114  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:15.363790  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:15.491933  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:15.687909  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:15.824620  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:15.826673  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:15.991483  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:16.186704  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:16.320320  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:16.320772  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:16.489978  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:16.687587  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:16.819946  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:16.820402  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:16.990797  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:17.187182  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:17.320488  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:17.320556  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:17.489994  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:17.687482  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:17.820327  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:17.820647  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:17.860484  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:17.990668  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:18.186902  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:18.320797  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:18.321007  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:18.491649  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:18.686893  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:18.825041  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:18.825073  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:18.991349  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:19.187475  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:19.319178  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:19.319544  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:19.491255  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:19.687631  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:19.820705  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:19.821386  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:19.861398  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:19.991386  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:20.188060  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:20.320370  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:20.320540  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:20.490854  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:20.691046  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:20.820519  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:20.820880  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:20.990696  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:21.187887  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:21.320683  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:21.320960  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:21.490466  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:21.687381  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:21.821713  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:21.821872  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:21.991163  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:22.187677  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:22.320461  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:22.320700  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:22.361828  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:22.491173  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:22.687391  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:22.820291  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:22.820350  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:22.991031  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:23.187189  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:23.320233  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:23.321835  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:23.490769  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:23.686844  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:23.821413  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:23.821975  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:23.990924  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:24.186858  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:24.320632  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:24.321538  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:24.490684  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:24.686811  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:24.820347  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:24.820825  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:24.861023  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:24.990816  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:25.188859  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:25.319565  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:25.321958  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:25.490768  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:25.687060  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:25.819917  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:25.820007  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:25.989814  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:26.188151  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:26.320347  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:26.320670  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:26.490493  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:26.688794  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:26.820216  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:26.820972  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:26.869979  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:26.994963  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:27.187241  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:27.320875  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:27.321091  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:27.490599  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:27.687035  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:27.819735  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:27.821576  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:27.991011  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:28.187548  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:28.319248  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:28.319535  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:28.490565  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:28.686983  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:28.820281  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:28.820545  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:28.991102  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:29.187407  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:29.320096  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:29.320727  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:29.360232  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:29.490171  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:29.687662  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:29.821108  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:29.821395  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:29.990833  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:30.188048  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:30.320185  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:30.321762  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:30.490164  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:30.687445  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:30.820193  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I1028 12:22:30.820726  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:30.993524  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:31.187188  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:31.319744  847764 kapi.go:107] duration metric: took 42.504199564s to wait for kubernetes.io/minikube-addons=registry ...

	I1028 12:22:31.320203  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:31.363013  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:31.490047  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:31.688258  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:31.822144  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:31.990851  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:32.187511  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:32.319378  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:32.489719  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:32.687646  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:32.820877  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:32.990905  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:33.186931  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:33.320457  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:33.490516  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:33.687572  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:33.821094  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:33.860997  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:33.990017  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:34.187459  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:34.321412  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:34.491448  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:34.687585  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:34.819687  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:34.990276  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:35.188672  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:35.322926  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:35.490189  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:35.688298  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:35.819944  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:35.861360  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:35.990491  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:36.188283  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:36.320905  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:36.490975  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:37.061599  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:37.062322  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:37.062942  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:37.189786  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:37.319463  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:37.490622  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:37.686942  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:37.819868  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:37.861708  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:37.991094  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:38.187350  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:38.319554  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:38.489729  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:38.687861  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:38.820772  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:38.990766  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:39.189670  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:39.321306  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:39.490761  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:39.687574  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:39.820666  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:39.861956  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:39.990026  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:40.187911  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:40.319694  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:40.491537  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:40.690223  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:40.820255  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:40.990167  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:41.194854  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:41.320396  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:41.490510  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:41.686962  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:41.822793  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:41.990940  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:42.187551  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:42.320537  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:42.361920  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:42.492270  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:42.689847  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:42.820320  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:42.993233  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:43.188318  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:43.321146  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:43.490244  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:43.687671  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:43.819963  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:43.994622  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:44.186853  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:44.437618  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:44.440346  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:44.499998  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:44.692740  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:44.830588  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:44.990743  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:45.189478  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:45.327480  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:45.489776  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:45.686838  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:45.819143  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:45.990977  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:46.187781  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:46.320643  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:46.499604  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:46.687118  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:46.820391  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:46.861489  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:46.991534  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:47.206998  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:47.322473  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:47.490104  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:47.687511  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:47.820384  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:47.990883  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:48.190257  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:48.320374  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:48.489865  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:48.687200  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:48.820474  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:48.861778  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:48.990380  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:49.187314  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:49.385292  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:49.490772  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:49.686822  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:49.821571  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:49.990231  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:50.188489  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:50.325787  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:50.490951  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:50.688194  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:50.819035  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:50.990548  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:51.187238  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:51.740122  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:51.740763  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:51.740760  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:51.751830  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:51.821932  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:51.994047  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:52.188395  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:52.321127  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:52.490459  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:52.688037  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:52.824525  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:52.990929  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:53.186275  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:53.320116  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:53.490444  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:53.687150  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:53.824090  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:53.863013  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:53.990794  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:54.188110  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:54.320944  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:54.490600  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:54.687201  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:54.825852  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:54.990511  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:55.187625  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:55.319561  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:55.490566  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:55.686777  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:55.827518  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:55.896999  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:55.991131  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:56.188898  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:56.319946  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:56.490021  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:56.687085  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:56.820338  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:56.993343  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:57.188537  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:57.320214  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:57.491018  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:57.688496  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:57.821169  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:57.991109  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:58.187422  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:58.321303  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:58.363255  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:22:58.490198  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:58.687822  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:58.820127  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:58.991142  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:59.218188  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:59.320353  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:59.490805  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:22:59.687233  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:22:59.820038  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:22:59.991909  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:00.187696  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:00.321269  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:23:00.490887  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:00.687508  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:00.821363  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:23:00.864738  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:00.990943  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:01.187120  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:01.323482  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:23:01.490646  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:01.686813  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:01.820522  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:23:01.992147  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:02.189968  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:02.324248  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:23:02.490923  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:02.691192  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:02.822724  847764 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I1028 12:23:02.873774  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:02.992706  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:03.187041  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:03.320129  847764 kapi.go:107] duration metric: took 1m14.50462252s to wait for app.kubernetes.io/name=ingress-nginx ...

	I1028 12:23:03.490072  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:03.687849  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:03.990432  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:04.194273  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:04.490872  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:04.687027  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:04.991554  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:05.186677  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:05.362767  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:05.490999  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:05.687489  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:05.991496  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:06.186639  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:06.491894  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:06.689167  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:06.991118  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:07.187704  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:07.491295  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:07.687413  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:07.867282  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:08.012927  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:08.191076  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:08.493509  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:08.693356  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:08.992969  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I1028 12:23:09.188185  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:09.490461  847764 kapi.go:107] duration metric: took 1m17.503827556s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I1028 12:23:09.492614  847764 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-823670 cluster.

	I1028 12:23:09.494014  847764 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I1028 12:23:09.495455  847764 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I1028 12:23:09.688457  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:10.096212  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:10.188627  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:10.687772  847764 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I1028 12:23:11.187778  847764 kapi.go:107] duration metric: took 1m20.505592369s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I1028 12:23:11.189752  847764 out.go:177] * Enabled addons: default-storageclass, inspektor-gadget, amd-gpu-device-plugin, storage-provisioner, ingress-dns, cloud-spanner, nvidia-device-plugin, metrics-server, yakd, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I1028 12:23:11.191282  847764 addons.go:510] duration metric: took 1m30.481914504s for enable addons: enabled=[default-storageclass inspektor-gadget amd-gpu-device-plugin storage-provisioner ingress-dns cloud-spanner nvidia-device-plugin metrics-server yakd storage-provisioner-rancher volumesnapshots registry ingress gcp-auth csi-hostpath-driver]

	I1028 12:23:12.361444  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:14.362210  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:16.861797  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:19.361242  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:21.362164  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:23.862475  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:26.361694  847764 pod_ready.go:103] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"False"

	I1028 12:23:26.860580  847764 pod_ready.go:93] pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace has status "Ready":"True"

	I1028 12:23:26.860608  847764 pod_ready.go:82] duration metric: took 1m25.00591349s for pod "metrics-server-84c5f94fbc-l86dn" in "kube-system" namespace to be "Ready" ...

	I1028 12:23:26.860620  847764 pod_ready.go:79] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-b4vng" in "kube-system" namespace to be "Ready" ...

	I1028 12:23:26.867564  847764 pod_ready.go:93] pod "nvidia-device-plugin-daemonset-b4vng" in "kube-system" namespace has status "Ready":"True"

	I1028 12:23:26.867596  847764 pod_ready.go:82] duration metric: took 6.969526ms for pod "nvidia-device-plugin-daemonset-b4vng" in "kube-system" namespace to be "Ready" ...

	I1028 12:23:26.867616  847764 pod_ready.go:39] duration metric: took 1m38.044714918s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 12:23:26.867637  847764 api_server.go:52] waiting for apiserver process to appear ...

	I1028 12:23:26.867669  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1028 12:23:26.867727  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1028 12:23:26.952562  847764 cri.go:89] found id: "720f2c340b92392d8699d22887202c0d4effce1808033629e4d96f39f074c9a2"

	I1028 12:23:26.952595  847764 cri.go:89] found id: ""

	I1028 12:23:26.952607  847764 logs.go:282] 1 containers: [720f2c340b92392d8699d22887202c0d4effce1808033629e4d96f39f074c9a2]

	I1028 12:23:26.952679  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:26.957630  847764 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1028 12:23:26.957704  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1028 12:23:26.999959  847764 cri.go:89] found id: "5dc2bf0437acd5baaf2ebcc1fef301b25858ad37e46e1e1dc067c085aacf36aa"

	I1028 12:23:26.999994  847764 cri.go:89] found id: ""

	I1028 12:23:27.000011  847764 logs.go:282] 1 containers: [5dc2bf0437acd5baaf2ebcc1fef301b25858ad37e46e1e1dc067c085aacf36aa]

	I1028 12:23:27.000098  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:27.004358  847764 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1028 12:23:27.004453  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1028 12:23:27.046152  847764 cri.go:89] found id: "5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364"

	I1028 12:23:27.046180  847764 cri.go:89] found id: ""

	I1028 12:23:27.046190  847764 logs.go:282] 1 containers: [5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364]

	I1028 12:23:27.046251  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:27.051645  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1028 12:23:27.051725  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1028 12:23:27.088645  847764 cri.go:89] found id: "bb295c28e9bc36509789e63e8b1577aa9ebe3877d2095a4d11eda224fafdc201"

	I1028 12:23:27.088675  847764 cri.go:89] found id: ""

	I1028 12:23:27.088685  847764 logs.go:282] 1 containers: [bb295c28e9bc36509789e63e8b1577aa9ebe3877d2095a4d11eda224fafdc201]

	I1028 12:23:27.088740  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:27.092963  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1028 12:23:27.093082  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1028 12:23:27.145245  847764 cri.go:89] found id: "f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e"

	I1028 12:23:27.145279  847764 cri.go:89] found id: ""

	I1028 12:23:27.145294  847764 logs.go:282] 1 containers: [f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e]

	I1028 12:23:27.145378  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:27.150165  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1028 12:23:27.150243  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1028 12:23:27.190048  847764 cri.go:89] found id: "e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027"

	I1028 12:23:27.190077  847764 cri.go:89] found id: ""

	I1028 12:23:27.190086  847764 logs.go:282] 1 containers: [e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027]

	I1028 12:23:27.190140  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:27.194155  847764 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1028 12:23:27.194230  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1028 12:23:27.241260  847764 cri.go:89] found id: ""

	I1028 12:23:27.241295  847764 logs.go:282] 0 containers: []

	W1028 12:23:27.241305  847764 logs.go:284] No container was found matching "kindnet"

	I1028 12:23:27.241317  847764 logs.go:123] Gathering logs for dmesg ...

	I1028 12:23:27.241332  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I1028 12:23:27.255866  847764 logs.go:123] Gathering logs for kube-apiserver [720f2c340b92392d8699d22887202c0d4effce1808033629e4d96f39f074c9a2] ...

	I1028 12:23:27.255901  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 720f2c340b92392d8699d22887202c0d4effce1808033629e4d96f39f074c9a2"

	I1028 12:23:27.307673  847764 logs.go:123] Gathering logs for etcd [5dc2bf0437acd5baaf2ebcc1fef301b25858ad37e46e1e1dc067c085aacf36aa] ...

	I1028 12:23:27.307720  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5dc2bf0437acd5baaf2ebcc1fef301b25858ad37e46e1e1dc067c085aacf36aa"

	I1028 12:23:27.366150  847764 logs.go:123] Gathering logs for kube-scheduler [bb295c28e9bc36509789e63e8b1577aa9ebe3877d2095a4d11eda224fafdc201] ...

	I1028 12:23:27.366196  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bb295c28e9bc36509789e63e8b1577aa9ebe3877d2095a4d11eda224fafdc201"

	I1028 12:23:27.416182  847764 logs.go:123] Gathering logs for kube-proxy [f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e] ...

	I1028 12:23:27.416227  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e"

	I1028 12:23:27.453816  847764 logs.go:123] Gathering logs for container status ...

	I1028 12:23:27.453850  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I1028 12:23:27.504001  847764 logs.go:123] Gathering logs for kubelet ...

	I1028 12:23:27.504061  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1028 12:23:27.558952  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:45 addons-823670 kubelet[1196]: W1028 12:21:45.623642    1196 reflector.go:561] object-"gadget"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "gadget": no relationship found between node 'addons-823670' and this object

	W1028 12:23:27.559179  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:45 addons-823670 kubelet[1196]: E1028 12:21:45.623682    1196 reflector.go:158] "Unhandled Error" err="object-\"gadget\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"gadget\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	W1028 12:23:27.562561  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:46 addons-823670 kubelet[1196]: W1028 12:21:46.362335    1196 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-823670' and this object

	W1028 12:23:27.562768  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:46 addons-823670 kubelet[1196]: E1028 12:21:46.362372    1196 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	I1028 12:23:27.590190  847764 logs.go:123] Gathering logs for describe nodes ...

	I1028 12:23:27.590241  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I1028 12:23:27.746881  847764 logs.go:123] Gathering logs for coredns [5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364] ...

	I1028 12:23:27.746922  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364"

	I1028 12:23:27.793346  847764 logs.go:123] Gathering logs for kube-controller-manager [e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027] ...

	I1028 12:23:27.793383  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027"

	I1028 12:23:27.856230  847764 logs.go:123] Gathering logs for CRI-O ...

	I1028 12:23:27.856277  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I1028 12:23:28.865805  847764 out.go:358] Setting ErrFile to fd 2...

	I1028 12:23:28.865863  847764 out.go:392] TERM=,COLORTERM=, which probably does not support color

	W1028 12:23:28.865935  847764 out.go:270] X Problems detected in kubelet:

	X Problems detected in kubelet:

	W1028 12:23:28.865949  847764 out.go:270]   Oct 28 12:21:45 addons-823670 kubelet[1196]: W1028 12:21:45.623642    1196 reflector.go:561] object-"gadget"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "gadget": no relationship found between node 'addons-823670' and this object

	  Oct 28 12:21:45 addons-823670 kubelet[1196]: W1028 12:21:45.623642    1196 reflector.go:561] object-"gadget"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "gadget": no relationship found between node 'addons-823670' and this object

	W1028 12:23:28.865959  847764 out.go:270]   Oct 28 12:21:45 addons-823670 kubelet[1196]: E1028 12:21:45.623682    1196 reflector.go:158] "Unhandled Error" err="object-\"gadget\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"gadget\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	  Oct 28 12:21:45 addons-823670 kubelet[1196]: E1028 12:21:45.623682    1196 reflector.go:158] "Unhandled Error" err="object-\"gadget\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"gadget\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	W1028 12:23:28.865968  847764 out.go:270]   Oct 28 12:21:46 addons-823670 kubelet[1196]: W1028 12:21:46.362335    1196 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-823670' and this object

	  Oct 28 12:21:46 addons-823670 kubelet[1196]: W1028 12:21:46.362335    1196 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-823670' and this object

	W1028 12:23:28.865981  847764 out.go:270]   Oct 28 12:21:46 addons-823670 kubelet[1196]: E1028 12:21:46.362372    1196 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	  Oct 28 12:21:46 addons-823670 kubelet[1196]: E1028 12:21:46.362372    1196 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	I1028 12:23:28.865986  847764 out.go:358] Setting ErrFile to fd 2...

	I1028 12:23:28.865993  847764 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 12:23:38.866335  847764 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1028 12:23:38.887348  847764 api_server.go:72] duration metric: took 1m58.177867167s to wait for apiserver process to appear ...

	I1028 12:23:38.887388  847764 api_server.go:88] waiting for apiserver healthz status ...

	I1028 12:23:38.887438  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I1028 12:23:38.887508  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I1028 12:23:38.925295  847764 cri.go:89] found id: "720f2c340b92392d8699d22887202c0d4effce1808033629e4d96f39f074c9a2"

	I1028 12:23:38.925332  847764 cri.go:89] found id: ""

	I1028 12:23:38.925344  847764 logs.go:282] 1 containers: [720f2c340b92392d8699d22887202c0d4effce1808033629e4d96f39f074c9a2]

	I1028 12:23:38.925407  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:38.929523  847764 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I1028 12:23:38.929612  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I1028 12:23:38.967743  847764 cri.go:89] found id: "5dc2bf0437acd5baaf2ebcc1fef301b25858ad37e46e1e1dc067c085aacf36aa"

	I1028 12:23:38.967799  847764 cri.go:89] found id: ""

	I1028 12:23:38.967809  847764 logs.go:282] 1 containers: [5dc2bf0437acd5baaf2ebcc1fef301b25858ad37e46e1e1dc067c085aacf36aa]

	I1028 12:23:38.967888  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:38.972138  847764 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I1028 12:23:38.972223  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I1028 12:23:39.008598  847764 cri.go:89] found id: "5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364"

	I1028 12:23:39.008630  847764 cri.go:89] found id: ""

	I1028 12:23:39.008641  847764 logs.go:282] 1 containers: [5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364]

	I1028 12:23:39.008708  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:39.014107  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I1028 12:23:39.014184  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I1028 12:23:39.063782  847764 cri.go:89] found id: "bb295c28e9bc36509789e63e8b1577aa9ebe3877d2095a4d11eda224fafdc201"

	I1028 12:23:39.063816  847764 cri.go:89] found id: ""

	I1028 12:23:39.063827  847764 logs.go:282] 1 containers: [bb295c28e9bc36509789e63e8b1577aa9ebe3877d2095a4d11eda224fafdc201]

	I1028 12:23:39.063886  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:39.068313  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I1028 12:23:39.068393  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I1028 12:23:39.107788  847764 cri.go:89] found id: "f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e"

	I1028 12:23:39.107816  847764 cri.go:89] found id: ""

	I1028 12:23:39.107826  847764 logs.go:282] 1 containers: [f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e]

	I1028 12:23:39.107886  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:39.111915  847764 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I1028 12:23:39.111995  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I1028 12:23:39.157874  847764 cri.go:89] found id: "e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027"

	I1028 12:23:39.157910  847764 cri.go:89] found id: ""

	I1028 12:23:39.157922  847764 logs.go:282] 1 containers: [e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027]

	I1028 12:23:39.157981  847764 ssh_runner.go:195] Run: which crictl

	I1028 12:23:39.162235  847764 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I1028 12:23:39.162325  847764 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I1028 12:23:39.206470  847764 cri.go:89] found id: ""

	I1028 12:23:39.206513  847764 logs.go:282] 0 containers: []

	W1028 12:23:39.206528  847764 logs.go:284] No container was found matching "kindnet"

	I1028 12:23:39.206544  847764 logs.go:123] Gathering logs for kubelet ...

	I1028 12:23:39.206562  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W1028 12:23:39.268056  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:45 addons-823670 kubelet[1196]: W1028 12:21:45.623642    1196 reflector.go:561] object-"gadget"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "gadget": no relationship found between node 'addons-823670' and this object

	W1028 12:23:39.268248  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:45 addons-823670 kubelet[1196]: E1028 12:21:45.623682    1196 reflector.go:158] "Unhandled Error" err="object-\"gadget\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"gadget\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	W1028 12:23:39.271278  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:46 addons-823670 kubelet[1196]: W1028 12:21:46.362335    1196 reflector.go:561] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-823670" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-823670' and this object

	W1028 12:23:39.271448  847764 logs.go:138] Found kubelet problem: Oct 28 12:21:46 addons-823670 kubelet[1196]: E1028 12:21:46.362372    1196 reflector.go:158] "Unhandled Error" err="object-\"local-path-storage\"/\"kube-root-ca.crt\": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:addons-823670\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"local-path-storage\": no relationship found between node 'addons-823670' and this object" logger="UnhandledError"

	I1028 12:23:39.298661  847764 logs.go:123] Gathering logs for coredns [5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364] ...

	I1028 12:23:39.298704  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 5ca74af5014b9ad11f8b659fc6dccfeb72e15220cad9968b474fafd0bb724364"

	I1028 12:23:39.343547  847764 logs.go:123] Gathering logs for kube-proxy [f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e] ...

	I1028 12:23:39.343593  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f6f8a232e814c14018426c3473fd883a9a942132d0796bd71cafd7e0bcdd454e"

	I1028 12:23:39.383348  847764 logs.go:123] Gathering logs for kube-controller-manager [e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027] ...

	I1028 12:23:39.383396  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 e36e59e46feff92412f7b9600e0e8687aea10487cb23f8134d75ce367ea39027"

	I1028 12:23:39.449064  847764 logs.go:123] Gathering logs for CRI-O ...

	I1028 12:23:39.449115  847764 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

** /stderr **

addons_test.go:109: out/minikube-linux-amd64 start -p addons-823670 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=nvidia-device-plugin --addons=yakd --addons=volcano --addons=amd-gpu-device-plugin --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=storage-provisioner-rancher failed: signal: killed

--- FAIL: TestAddons/Setup (2400.05s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:365: (dbg) Run:  out/minikube-linux-amd64 -p ha-798963 node stop m02 -v=7 --alsologtostderr

E1028 13:13:48.291671  847062 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/functional-963359/client.crt: no such file or directory" logger="UnhandledError"

E1028 13:14:29.253153  847062 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/functional-963359/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:365: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-798963 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.50431641s)

-- stdout --

	* Stopping node "ha-798963-m02"  ...

-- /stdout --

** stderr ** 

	I1028 13:13:35.101811  866197 out.go:345] Setting OutFile to fd 1 ...

	I1028 13:13:35.102215  866197 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 13:13:35.102252  866197 out.go:358] Setting ErrFile to fd 2...

	I1028 13:13:35.102269  866197 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 13:13:35.102668  866197 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19865-839778/.minikube/bin

	I1028 13:13:35.102979  866197 mustload.go:65] Loading cluster: ha-798963

	I1028 13:13:35.103416  866197 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:13:35.103435  866197 stop.go:39] StopHost: ha-798963-m02

	I1028 13:13:35.103809  866197 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:13:35.103863  866197 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:13:35.120566  866197 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38709

	I1028 13:13:35.121150  866197 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:13:35.121796  866197 main.go:141] libmachine: Using API Version  1

	I1028 13:13:35.121841  866197 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:13:35.122226  866197 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:13:35.124701  866197 out.go:177] * Stopping node "ha-798963-m02"  ...

	I1028 13:13:35.126150  866197 machine.go:156] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]

	I1028 13:13:35.126200  866197 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:13:35.126464  866197 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup

	I1028 13:13:35.126492  866197 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:13:35.129933  866197 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:13:35.130361  866197 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:13:35.130384  866197 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:13:35.130551  866197 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:13:35.130741  866197 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:13:35.130973  866197 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:13:35.131195  866197 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:13:35.222848  866197 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/cni /var/lib/minikube/backup

	I1028 13:13:35.277404  866197 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/kubernetes /var/lib/minikube/backup

	I1028 13:13:35.332288  866197 main.go:141] libmachine: Stopping "ha-798963-m02"...

	I1028 13:13:35.332334  866197 main.go:141] libmachine: (ha-798963-m02) Calling .GetState

	I1028 13:13:35.334571  866197 main.go:141] libmachine: (ha-798963-m02) Calling .Stop

	I1028 13:13:35.338639  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 0/120

	I1028 13:13:36.340128  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 1/120

	I1028 13:13:37.342813  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 2/120

	I1028 13:13:38.345007  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 3/120

	I1028 13:13:39.346525  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 4/120

	I1028 13:13:40.348758  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 5/120

	I1028 13:13:41.350651  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 6/120

	I1028 13:13:42.352481  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 7/120

	I1028 13:13:43.354586  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 8/120

	I1028 13:13:44.356128  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 9/120

	I1028 13:13:45.358086  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 10/120

	I1028 13:13:46.360013  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 11/120

	I1028 13:13:47.361507  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 12/120

	I1028 13:13:48.363086  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 13/120

	I1028 13:13:49.364645  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 14/120

	I1028 13:13:50.366642  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 15/120

	I1028 13:13:51.368208  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 16/120

	I1028 13:13:52.369815  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 17/120

	I1028 13:13:53.371277  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 18/120

	I1028 13:13:54.372924  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 19/120

	I1028 13:13:55.375213  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 20/120

	I1028 13:13:56.376944  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 21/120

	I1028 13:13:57.378927  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 22/120

	I1028 13:13:58.380592  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 23/120

	I1028 13:13:59.382842  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 24/120

	I1028 13:14:00.385193  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 25/120

	I1028 13:14:01.387157  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 26/120

	I1028 13:14:02.389173  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 27/120

	I1028 13:14:03.390792  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 28/120

	I1028 13:14:04.392559  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 29/120

	I1028 13:14:05.395383  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 30/120

	I1028 13:14:06.396846  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 31/120

	I1028 13:14:07.398369  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 32/120

	I1028 13:14:08.399869  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 33/120

	I1028 13:14:09.401381  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 34/120

	I1028 13:14:10.403479  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 35/120

	I1028 13:14:11.405065  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 36/120

	I1028 13:14:12.406660  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 37/120

	I1028 13:14:13.408041  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 38/120

	I1028 13:14:14.409334  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 39/120

	I1028 13:14:15.410642  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 40/120

	I1028 13:14:16.412366  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 41/120

	I1028 13:14:17.413948  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 42/120

	I1028 13:14:18.415561  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 43/120

	I1028 13:14:19.416988  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 44/120

	I1028 13:14:20.419028  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 45/120

	I1028 13:14:21.420920  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 46/120

	I1028 13:14:22.422166  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 47/120

	I1028 13:14:23.424119  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 48/120

	I1028 13:14:24.425848  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 49/120

	I1028 13:14:25.427387  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 50/120

	I1028 13:14:26.428837  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 51/120

	I1028 13:14:27.430449  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 52/120

	I1028 13:14:28.432015  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 53/120

	I1028 13:14:29.434702  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 54/120

	I1028 13:14:30.437011  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 55/120

	I1028 13:14:31.438634  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 56/120

	I1028 13:14:32.441271  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 57/120

	I1028 13:14:33.442786  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 58/120

	I1028 13:14:34.444687  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 59/120

	I1028 13:14:35.447014  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 60/120

	I1028 13:14:36.448499  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 61/120

	I1028 13:14:37.450625  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 62/120

	I1028 13:14:38.452118  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 63/120

	I1028 13:14:39.454547  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 64/120

	I1028 13:14:40.456534  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 65/120

	I1028 13:14:41.458576  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 66/120

	I1028 13:14:42.460279  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 67/120

	I1028 13:14:43.462720  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 68/120

	I1028 13:14:44.464193  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 69/120

	I1028 13:14:45.466719  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 70/120

	I1028 13:14:46.468392  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 71/120

	I1028 13:14:47.469933  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 72/120

	I1028 13:14:48.471822  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 73/120

	I1028 13:14:49.473228  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 74/120

	I1028 13:14:50.475604  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 75/120

	I1028 13:14:51.477342  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 76/120

	I1028 13:14:52.479141  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 77/120

	I1028 13:14:53.480834  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 78/120

	I1028 13:14:54.482500  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 79/120

	I1028 13:14:55.484854  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 80/120

	I1028 13:14:56.486331  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 81/120

	I1028 13:14:57.487611  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 82/120

	I1028 13:14:58.489012  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 83/120

	I1028 13:14:59.490620  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 84/120

	I1028 13:15:00.492216  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 85/120

	I1028 13:15:01.493765  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 86/120

	I1028 13:15:02.495140  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 87/120

	I1028 13:15:03.496841  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 88/120

	I1028 13:15:04.498552  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 89/120

	I1028 13:15:05.500851  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 90/120

	I1028 13:15:06.503581  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 91/120

	I1028 13:15:07.505150  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 92/120

	I1028 13:15:08.506559  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 93/120

	I1028 13:15:09.508062  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 94/120

	I1028 13:15:10.510613  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 95/120

	I1028 13:15:11.513037  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 96/120

	I1028 13:15:12.514725  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 97/120

	I1028 13:15:13.516561  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 98/120

	I1028 13:15:14.518598  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 99/120

	I1028 13:15:15.520188  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 100/120

	I1028 13:15:16.522555  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 101/120

	I1028 13:15:17.524446  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 102/120

	I1028 13:15:18.525878  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 103/120

	I1028 13:15:19.527544  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 104/120

	I1028 13:15:20.529352  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 105/120

	I1028 13:15:21.530828  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 106/120

	I1028 13:15:22.532403  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 107/120

	I1028 13:15:23.534440  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 108/120

	I1028 13:15:24.535977  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 109/120

	I1028 13:15:25.537462  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 110/120

	I1028 13:15:26.539147  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 111/120

	I1028 13:15:27.540689  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 112/120

	I1028 13:15:28.542219  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 113/120

	I1028 13:15:29.544297  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 114/120

	I1028 13:15:30.546461  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 115/120

	I1028 13:15:31.548171  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 116/120

	I1028 13:15:32.550682  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 117/120

	I1028 13:15:33.552291  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 118/120

	I1028 13:15:34.554425  866197 main.go:141] libmachine: (ha-798963-m02) Waiting for machine to stop 119/120

	I1028 13:15:35.555050  866197 stop.go:66] stop err: unable to stop vm, current state "Running"

	W1028 13:15:35.555221  866197 out.go:270] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

	X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

** /stderr **

ha_test.go:367: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-798963 node stop m02 -v=7 --alsologtostderr": exit status 30

ha_test.go:371: (dbg) Run:  out/minikube-linux-amd64 -p ha-798963 status -v=7 --alsologtostderr

E1028 13:15:51.176032  847062 cert_rotation.go:171] "Unhandled Error" err="key failed with : open /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/functional-963359/client.crt: no such file or directory" logger="UnhandledError"

ha_test.go:371: (dbg) Done: out/minikube-linux-amd64 -p ha-798963 status -v=7 --alsologtostderr: (18.877670591s)

ha_test.go:377: status says not all three control-plane nodes are present: args "out/minikube-linux-amd64 -p ha-798963 status -v=7 --alsologtostderr": 

ha_test.go:380: status says not three hosts are running: args "out/minikube-linux-amd64 -p ha-798963 status -v=7 --alsologtostderr": 

ha_test.go:383: status says not three kubelets are running: args "out/minikube-linux-amd64 -p ha-798963 status -v=7 --alsologtostderr": 

ha_test.go:386: status says not two apiservers are running: args "out/minikube-linux-amd64 -p ha-798963 status -v=7 --alsologtostderr": 

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-798963 -n ha-798963

helpers_test.go:244: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-798963 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-798963 logs -n 25: (1.558016844s)

helpers_test.go:252: TestMultiControlPlane/serial/StopSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1851781028/001/cp-test_ha-798963-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963:/home/docker/cp-test_ha-798963-m03_ha-798963.txt                       |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963 sudo cat                                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m03_ha-798963.txt                                 |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m02:/home/docker/cp-test_ha-798963-m03_ha-798963-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m02 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m03_ha-798963-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04:/home/docker/cp-test_ha-798963-m03_ha-798963-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m04 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m03_ha-798963-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-798963 cp testdata/cp-test.txt                                                | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1851781028/001/cp-test_ha-798963-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963:/home/docker/cp-test_ha-798963-m04_ha-798963.txt                       |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963 sudo cat                                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m04_ha-798963.txt                                 |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m02:/home/docker/cp-test_ha-798963-m04_ha-798963-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m02 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m04_ha-798963-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03:/home/docker/cp-test_ha-798963-m04_ha-798963-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m03 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m04_ha-798963-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-798963 node stop m02 -v=7                                                     | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/10/28 13:08:55

	Running on machine: ubuntu-20-agent-9

	Binary: Built with gc go1.23.2 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1028 13:08:55.396734  862106 out.go:345] Setting OutFile to fd 1 ...

	I1028 13:08:55.396862  862106 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 13:08:55.396874  862106 out.go:358] Setting ErrFile to fd 2...

	I1028 13:08:55.396880  862106 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 13:08:55.397096  862106 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19865-839778/.minikube/bin

	I1028 13:08:55.397865  862106 out.go:352] Setting JSON to false

	I1028 13:08:55.399109  862106 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":10276,"bootTime":1730110659,"procs":172,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I1028 13:08:55.399259  862106 start.go:139] virtualization: kvm guest

	I1028 13:08:55.401661  862106 out.go:177] * [ha-798963] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	I1028 13:08:55.403130  862106 notify.go:220] Checking for updates...

	I1028 13:08:55.403153  862106 out.go:177]   - MINIKUBE_LOCATION=19865

	I1028 13:08:55.404738  862106 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1028 13:08:55.406304  862106 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:08:55.407792  862106 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:08:55.409272  862106 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1028 13:08:55.410669  862106 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1028 13:08:55.412138  862106 driver.go:394] Setting default libvirt URI to qemu:///system

	I1028 13:08:55.449966  862106 out.go:177] * Using the kvm2 driver based on user configuration

	I1028 13:08:55.451668  862106 start.go:297] selected driver: kvm2

	I1028 13:08:55.451694  862106 start.go:901] validating driver "kvm2" against <nil>

	I1028 13:08:55.451711  862106 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1028 13:08:55.452545  862106 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1028 13:08:55.452630  862106 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19865-839778/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I1028 13:08:55.469294  862106 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0

	I1028 13:08:55.469371  862106 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1028 13:08:55.469691  862106 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1028 13:08:55.469735  862106 cni.go:84] Creating CNI manager for ""

	I1028 13:08:55.469797  862106 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I1028 13:08:55.469807  862106 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I1028 13:08:55.469869  862106 start.go:340] cluster config:

	{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I1028 13:08:55.469974  862106 iso.go:125] acquiring lock: {Name:mk3969ab3dff5daa2fa05bc5981fbcf53106ccb3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1028 13:08:55.472934  862106 out.go:177] * Starting "ha-798963" primary control-plane node in "ha-798963" cluster

	I1028 13:08:55.475043  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:08:55.475104  862106 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4

	I1028 13:08:55.475117  862106 cache.go:56] Caching tarball of preloaded images

	I1028 13:08:55.475209  862106 preload.go:172] Found /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I1028 13:08:55.475221  862106 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on crio

	I1028 13:08:55.475546  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:08:55.475571  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json: {Name:mk88d37d80cc1effe317fe2f2b3e4f503f332549 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:08:55.475717  862106 start.go:360] acquireMachinesLock for ha-798963: {Name:mk3d8412df30fd3411bfb6262eb0fa70b21bf365 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1028 13:08:55.475747  862106 start.go:364] duration metric: took 17.194µs to acquireMachinesLock for "ha-798963"

	I1028 13:08:55.475787  862106 start.go:93] Provisioning new machine with config: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:08:55.475890  862106 start.go:125] createHost starting for "" (driver="kvm2")

	I1028 13:08:55.477815  862106 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1028 13:08:55.477964  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:08:55.478002  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:08:55.493524  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43493

	I1028 13:08:55.494183  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:08:55.494740  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:08:55.494766  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:08:55.495290  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:08:55.495576  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:08:55.495795  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:08:55.495993  862106 start.go:159] libmachine.API.Create for "ha-798963" (driver="kvm2")

	I1028 13:08:55.496028  862106 client.go:168] LocalClient.Create starting

	I1028 13:08:55.496066  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem

	I1028 13:08:55.496101  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:08:55.496124  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:08:55.496187  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem

	I1028 13:08:55.496217  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:08:55.496235  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:08:55.496258  862106 main.go:141] libmachine: Running pre-create checks...

	I1028 13:08:55.496270  862106 main.go:141] libmachine: (ha-798963) Calling .PreCreateCheck

	I1028 13:08:55.496705  862106 main.go:141] libmachine: (ha-798963) Calling .GetConfigRaw

	I1028 13:08:55.497203  862106 main.go:141] libmachine: Creating machine...

	I1028 13:08:55.497223  862106 main.go:141] libmachine: (ha-798963) Calling .Create

	I1028 13:08:55.497452  862106 main.go:141] libmachine: (ha-798963) Creating KVM machine...

	I1028 13:08:55.498924  862106 main.go:141] libmachine: (ha-798963) DBG | found existing default KVM network

	I1028 13:08:55.499788  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:55.499621  862129 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000121ba0}

	I1028 13:08:55.499889  862106 main.go:141] libmachine: (ha-798963) DBG | created network xml: 

	I1028 13:08:55.499918  862106 main.go:141] libmachine: (ha-798963) DBG | <network>

	I1028 13:08:55.499933  862106 main.go:141] libmachine: (ha-798963) DBG |   <name>mk-ha-798963</name>

	I1028 13:08:55.499940  862106 main.go:141] libmachine: (ha-798963) DBG |   <dns enable='no'/>

	I1028 13:08:55.499947  862106 main.go:141] libmachine: (ha-798963) DBG |   

	I1028 13:08:55.499960  862106 main.go:141] libmachine: (ha-798963) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I1028 13:08:55.499972  862106 main.go:141] libmachine: (ha-798963) DBG |     <dhcp>

	I1028 13:08:55.499992  862106 main.go:141] libmachine: (ha-798963) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I1028 13:08:55.500004  862106 main.go:141] libmachine: (ha-798963) DBG |     </dhcp>

	I1028 13:08:55.500014  862106 main.go:141] libmachine: (ha-798963) DBG |   </ip>

	I1028 13:08:55.500023  862106 main.go:141] libmachine: (ha-798963) DBG |   

	I1028 13:08:55.500037  862106 main.go:141] libmachine: (ha-798963) DBG | </network>

	I1028 13:08:55.500046  862106 main.go:141] libmachine: (ha-798963) DBG | 

	I1028 13:08:55.505348  862106 main.go:141] libmachine: (ha-798963) DBG | trying to create private KVM network mk-ha-798963 192.168.39.0/24...

	I1028 13:08:55.578263  862106 main.go:141] libmachine: (ha-798963) Setting up store path in /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963 ...

	I1028 13:08:55.578316  862106 main.go:141] libmachine: (ha-798963) Building disk image from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso

	I1028 13:08:55.578336  862106 main.go:141] libmachine: (ha-798963) DBG | private KVM network mk-ha-798963 192.168.39.0/24 created

	I1028 13:08:55.578402  862106 main.go:141] libmachine: (ha-798963) Downloading /home/jenkins/minikube-integration/19865-839778/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...

	I1028 13:08:55.578445  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:55.578108  862129 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:08:55.855435  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:55.855281  862129 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa...

	I1028 13:08:56.195891  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:56.195666  862129 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/ha-798963.rawdisk...

	I1028 13:08:56.195933  862106 main.go:141] libmachine: (ha-798963) DBG | Writing magic tar header

	I1028 13:08:56.195946  862106 main.go:141] libmachine: (ha-798963) DBG | Writing SSH key tar header

	I1028 13:08:56.195957  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:56.195841  862129 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963 ...

	I1028 13:08:56.195975  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963

	I1028 13:08:56.196033  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963 (perms=drwx------)

	I1028 13:08:56.196067  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines (perms=drwxr-xr-x)

	I1028 13:08:56.196078  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines

	I1028 13:08:56.196096  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:08:56.196110  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778

	I1028 13:08:56.196120  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube (perms=drwxr-xr-x)

	I1028 13:08:56.196133  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778 (perms=drwxrwxr-x)

	I1028 13:08:56.196143  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I1028 13:08:56.196154  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I1028 13:08:56.196172  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins

	I1028 13:08:56.196182  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home

	I1028 13:08:56.196192  862106 main.go:141] libmachine: (ha-798963) DBG | Skipping /home - not owner

	I1028 13:08:56.196205  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I1028 13:08:56.196214  862106 main.go:141] libmachine: (ha-798963) Creating domain...

	I1028 13:08:56.197516  862106 main.go:141] libmachine: (ha-798963) define libvirt domain using xml: 

	I1028 13:08:56.197547  862106 main.go:141] libmachine: (ha-798963) <domain type='kvm'>

	I1028 13:08:56.197557  862106 main.go:141] libmachine: (ha-798963)   <name>ha-798963</name>

	I1028 13:08:56.197564  862106 main.go:141] libmachine: (ha-798963)   <memory unit='MiB'>2200</memory>

	I1028 13:08:56.197573  862106 main.go:141] libmachine: (ha-798963)   <vcpu>2</vcpu>

	I1028 13:08:56.197579  862106 main.go:141] libmachine: (ha-798963)   <features>

	I1028 13:08:56.197586  862106 main.go:141] libmachine: (ha-798963)     <acpi/>

	I1028 13:08:56.197591  862106 main.go:141] libmachine: (ha-798963)     <apic/>

	I1028 13:08:56.197596  862106 main.go:141] libmachine: (ha-798963)     <pae/>

	I1028 13:08:56.197602  862106 main.go:141] libmachine: (ha-798963)     

	I1028 13:08:56.197607  862106 main.go:141] libmachine: (ha-798963)   </features>

	I1028 13:08:56.197611  862106 main.go:141] libmachine: (ha-798963)   <cpu mode='host-passthrough'>

	I1028 13:08:56.197616  862106 main.go:141] libmachine: (ha-798963)   

	I1028 13:08:56.197625  862106 main.go:141] libmachine: (ha-798963)   </cpu>

	I1028 13:08:56.197632  862106 main.go:141] libmachine: (ha-798963)   <os>

	I1028 13:08:56.197639  862106 main.go:141] libmachine: (ha-798963)     <type>hvm</type>

	I1028 13:08:56.197674  862106 main.go:141] libmachine: (ha-798963)     <boot dev='cdrom'/>

	I1028 13:08:56.197696  862106 main.go:141] libmachine: (ha-798963)     <boot dev='hd'/>

	I1028 13:08:56.197701  862106 main.go:141] libmachine: (ha-798963)     <bootmenu enable='no'/>

	I1028 13:08:56.197706  862106 main.go:141] libmachine: (ha-798963)   </os>

	I1028 13:08:56.197711  862106 main.go:141] libmachine: (ha-798963)   <devices>

	I1028 13:08:56.197716  862106 main.go:141] libmachine: (ha-798963)     <disk type='file' device='cdrom'>

	I1028 13:08:56.197723  862106 main.go:141] libmachine: (ha-798963)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/boot2docker.iso'/>

	I1028 13:08:56.197730  862106 main.go:141] libmachine: (ha-798963)       <target dev='hdc' bus='scsi'/>

	I1028 13:08:56.197735  862106 main.go:141] libmachine: (ha-798963)       <readonly/>

	I1028 13:08:56.197738  862106 main.go:141] libmachine: (ha-798963)     </disk>

	I1028 13:08:56.197744  862106 main.go:141] libmachine: (ha-798963)     <disk type='file' device='disk'>

	I1028 13:08:56.197752  862106 main.go:141] libmachine: (ha-798963)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I1028 13:08:56.197763  862106 main.go:141] libmachine: (ha-798963)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/ha-798963.rawdisk'/>

	I1028 13:08:56.197767  862106 main.go:141] libmachine: (ha-798963)       <target dev='hda' bus='virtio'/>

	I1028 13:08:56.197804  862106 main.go:141] libmachine: (ha-798963)     </disk>

	I1028 13:08:56.197832  862106 main.go:141] libmachine: (ha-798963)     <interface type='network'>

	I1028 13:08:56.197845  862106 main.go:141] libmachine: (ha-798963)       <source network='mk-ha-798963'/>

	I1028 13:08:56.197863  862106 main.go:141] libmachine: (ha-798963)       <model type='virtio'/>

	I1028 13:08:56.197876  862106 main.go:141] libmachine: (ha-798963)     </interface>

	I1028 13:08:56.197886  862106 main.go:141] libmachine: (ha-798963)     <interface type='network'>

	I1028 13:08:56.197897  862106 main.go:141] libmachine: (ha-798963)       <source network='default'/>

	I1028 13:08:56.197906  862106 main.go:141] libmachine: (ha-798963)       <model type='virtio'/>

	I1028 13:08:56.197919  862106 main.go:141] libmachine: (ha-798963)     </interface>

	I1028 13:08:56.197931  862106 main.go:141] libmachine: (ha-798963)     <serial type='pty'>

	I1028 13:08:56.197942  862106 main.go:141] libmachine: (ha-798963)       <target port='0'/>

	I1028 13:08:56.197958  862106 main.go:141] libmachine: (ha-798963)     </serial>

	I1028 13:08:56.197974  862106 main.go:141] libmachine: (ha-798963)     <console type='pty'>

	I1028 13:08:56.197986  862106 main.go:141] libmachine: (ha-798963)       <target type='serial' port='0'/>

	I1028 13:08:56.198007  862106 main.go:141] libmachine: (ha-798963)     </console>

	I1028 13:08:56.198027  862106 main.go:141] libmachine: (ha-798963)     <rng model='virtio'>

	I1028 13:08:56.198042  862106 main.go:141] libmachine: (ha-798963)       <backend model='random'>/dev/random</backend>

	I1028 13:08:56.198051  862106 main.go:141] libmachine: (ha-798963)     </rng>

	I1028 13:08:56.198056  862106 main.go:141] libmachine: (ha-798963)     

	I1028 13:08:56.198063  862106 main.go:141] libmachine: (ha-798963)     

	I1028 13:08:56.198069  862106 main.go:141] libmachine: (ha-798963)   </devices>

	I1028 13:08:56.198076  862106 main.go:141] libmachine: (ha-798963) </domain>

	I1028 13:08:56.198082  862106 main.go:141] libmachine: (ha-798963) 

	I1028 13:08:56.202525  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:4f:cc:0e in network default

	I1028 13:08:56.203296  862106 main.go:141] libmachine: (ha-798963) Ensuring networks are active...

	I1028 13:08:56.203318  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:56.204420  862106 main.go:141] libmachine: (ha-798963) Ensuring network default is active

	I1028 13:08:56.204735  862106 main.go:141] libmachine: (ha-798963) Ensuring network mk-ha-798963 is active

	I1028 13:08:56.205186  862106 main.go:141] libmachine: (ha-798963) Getting domain xml...

	I1028 13:08:56.205974  862106 main.go:141] libmachine: (ha-798963) Creating domain...

	I1028 13:08:57.450815  862106 main.go:141] libmachine: (ha-798963) Waiting to get IP...

	I1028 13:08:57.451824  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:57.452254  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:57.452279  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:57.452215  862129 retry.go:31] will retry after 268.624303ms: waiting for machine to come up

	I1028 13:08:57.722823  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:57.723433  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:57.723462  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:57.723362  862129 retry.go:31] will retry after 349.830937ms: waiting for machine to come up

	I1028 13:08:58.075208  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:58.075792  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:58.075819  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:58.075721  862129 retry.go:31] will retry after 472.134429ms: waiting for machine to come up

	I1028 13:08:58.549371  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:58.549849  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:58.549880  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:58.549790  862129 retry.go:31] will retry after 405.301216ms: waiting for machine to come up

	I1028 13:08:58.956374  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:58.956791  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:58.956814  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:58.956738  862129 retry.go:31] will retry after 571.611338ms: waiting for machine to come up

	I1028 13:08:59.529663  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:59.530055  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:59.530081  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:59.529988  862129 retry.go:31] will retry after 594.15345ms: waiting for machine to come up

	I1028 13:09:00.126014  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:00.126568  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:00.126602  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:00.126497  862129 retry.go:31] will retry after 931.486225ms: waiting for machine to come up

	I1028 13:09:01.059347  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:01.059884  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:01.059912  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:01.059826  862129 retry.go:31] will retry after 1.289585172s: waiting for machine to come up

	I1028 13:09:02.351400  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:02.351788  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:02.351818  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:02.351708  862129 retry.go:31] will retry after 1.134418163s: waiting for machine to come up

	I1028 13:09:03.488383  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:03.488885  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:03.488917  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:03.488824  862129 retry.go:31] will retry after 1.513685236s: waiting for machine to come up

	I1028 13:09:05.004006  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:05.004447  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:05.004470  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:05.004406  862129 retry.go:31] will retry after 2.686675992s: waiting for machine to come up

	I1028 13:09:07.693670  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:07.694165  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:07.694192  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:07.694104  862129 retry.go:31] will retry after 2.606904929s: waiting for machine to come up

	I1028 13:09:10.303922  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:10.304313  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:10.304346  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:10.304269  862129 retry.go:31] will retry after 4.103114671s: waiting for machine to come up

	I1028 13:09:14.412327  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:14.412781  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:14.412806  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:14.412733  862129 retry.go:31] will retry after 4.75577582s: waiting for machine to come up

	I1028 13:09:19.172536  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.172987  862106 main.go:141] libmachine: (ha-798963) Found IP for machine: 192.168.39.179

	I1028 13:09:19.173030  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has current primary IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.173041  862106 main.go:141] libmachine: (ha-798963) Reserving static IP address...

	I1028 13:09:19.173375  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find host DHCP lease matching {name: "ha-798963", mac: "52:54:00:aa:02:0b", ip: "192.168.39.179"} in network mk-ha-798963

	I1028 13:09:19.257414  862106 main.go:141] libmachine: (ha-798963) DBG | Getting to WaitForSSH function...

	I1028 13:09:19.257461  862106 main.go:141] libmachine: (ha-798963) Reserved static IP address: 192.168.39.179

	I1028 13:09:19.257508  862106 main.go:141] libmachine: (ha-798963) Waiting for SSH to be available...

	I1028 13:09:19.260202  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.260679  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:minikube Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.260709  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.260838  862106 main.go:141] libmachine: (ha-798963) DBG | Using SSH client type: external

	I1028 13:09:19.260863  862106 main.go:141] libmachine: (ha-798963) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa (-rw-------)

	I1028 13:09:19.260893  862106 main.go:141] libmachine: (ha-798963) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.179 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:09:19.260910  862106 main.go:141] libmachine: (ha-798963) DBG | About to run SSH command:

	I1028 13:09:19.260920  862106 main.go:141] libmachine: (ha-798963) DBG | exit 0

	I1028 13:09:19.384105  862106 main.go:141] libmachine: (ha-798963) DBG | SSH cmd err, output: <nil>: 

	I1028 13:09:19.384339  862106 main.go:141] libmachine: (ha-798963) KVM machine creation complete!

	I1028 13:09:19.384705  862106 main.go:141] libmachine: (ha-798963) Calling .GetConfigRaw

	I1028 13:09:19.385308  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:19.385505  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:19.385674  862106 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I1028 13:09:19.385689  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:19.386906  862106 main.go:141] libmachine: Detecting operating system of created instance...

	I1028 13:09:19.386920  862106 main.go:141] libmachine: Waiting for SSH to be available...

	I1028 13:09:19.386925  862106 main.go:141] libmachine: Getting to WaitForSSH function...

	I1028 13:09:19.386935  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.389223  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.389616  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.389642  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.389816  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.390063  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.390241  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.390430  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.390602  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.390908  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.390922  862106 main.go:141] libmachine: About to run SSH command:

	exit 0

	I1028 13:09:19.494932  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:09:19.494958  862106 main.go:141] libmachine: Detecting the provisioner...

	I1028 13:09:19.494966  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.498030  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.498432  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.498460  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.498630  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.498802  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.498956  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.499166  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.499331  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.499503  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.499513  862106 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I1028 13:09:19.604279  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I1028 13:09:19.604383  862106 main.go:141] libmachine: found compatible host: buildroot

	I1028 13:09:19.604397  862106 main.go:141] libmachine: Provisioning with buildroot...

	I1028 13:09:19.604409  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:09:19.604692  862106 buildroot.go:166] provisioning hostname "ha-798963"

	I1028 13:09:19.604726  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:09:19.604925  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.607444  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.607818  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.607848  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.608040  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.608228  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.608368  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.608474  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.608668  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.608871  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.608887  862106 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-798963 && echo "ha-798963" | sudo tee /etc/hostname

	I1028 13:09:19.727542  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-798963

	I1028 13:09:19.727570  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.730940  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.731280  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.731308  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.731555  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.731799  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.731992  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.732166  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.732356  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.732521  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.732541  862106 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-798963' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-798963/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-798963' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1028 13:09:19.844253  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:09:19.844294  862106 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19865-839778/.minikube CaCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19865-839778/.minikube}

	I1028 13:09:19.844365  862106 buildroot.go:174] setting up certificates

	I1028 13:09:19.844386  862106 provision.go:84] configureAuth start

	I1028 13:09:19.844414  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:09:19.844728  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:19.847340  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.847685  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.847721  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.847839  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.850024  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.850338  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.850367  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.850513  862106 provision.go:143] copyHostCerts

	I1028 13:09:19.850546  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:09:19.850604  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem, removing ...

	I1028 13:09:19.850623  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:09:19.850713  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem (1082 bytes)

	I1028 13:09:19.850830  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:09:19.850862  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem, removing ...

	I1028 13:09:19.850870  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:09:19.850911  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem (1123 bytes)

	I1028 13:09:19.850976  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:09:19.851001  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem, removing ...

	I1028 13:09:19.851010  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:09:19.851044  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem (1679 bytes)

	I1028 13:09:19.851110  862106 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem org=jenkins.ha-798963 san=[127.0.0.1 192.168.39.179 ha-798963 localhost minikube]

	I1028 13:09:19.944962  862106 provision.go:177] copyRemoteCerts

	I1028 13:09:19.945027  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1028 13:09:19.945057  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.947923  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.948268  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.948298  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.948469  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.948656  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.948851  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.948981  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.029506  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1028 13:09:20.029619  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1028 13:09:20.053591  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1028 13:09:20.053689  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I1028 13:09:20.077096  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1028 13:09:20.077186  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1028 13:09:20.102201  862106 provision.go:87] duration metric: took 257.791422ms to configureAuth

	I1028 13:09:20.102242  862106 buildroot.go:189] setting minikube options for container-runtime

	I1028 13:09:20.102472  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:09:20.102561  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.106247  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.106588  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.106618  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.106797  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.106995  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.107163  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.107303  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.107440  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:20.107613  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:20.107632  862106 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1028 13:09:20.330306  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1028 13:09:20.330338  862106 main.go:141] libmachine: Checking connection to Docker...

	I1028 13:09:20.330359  862106 main.go:141] libmachine: (ha-798963) Calling .GetURL

	I1028 13:09:20.331808  862106 main.go:141] libmachine: (ha-798963) DBG | Using libvirt version 6000000

	I1028 13:09:20.334358  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.334708  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.334738  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.334885  862106 main.go:141] libmachine: Docker is up and running!

	I1028 13:09:20.334902  862106 main.go:141] libmachine: Reticulating splines...

	I1028 13:09:20.334910  862106 client.go:171] duration metric: took 24.838873329s to LocalClient.Create

	I1028 13:09:20.334939  862106 start.go:167] duration metric: took 24.838947558s to libmachine.API.Create "ha-798963"

	I1028 13:09:20.334953  862106 start.go:293] postStartSetup for "ha-798963" (driver="kvm2")

	I1028 13:09:20.334965  862106 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1028 13:09:20.334985  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.335336  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1028 13:09:20.335366  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.337911  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.338253  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.338276  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.338457  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.338716  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.338919  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.339098  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.422233  862106 ssh_runner.go:195] Run: cat /etc/os-release

	I1028 13:09:20.426489  862106 info.go:137] Remote host: Buildroot 2023.02.9

	I1028 13:09:20.426523  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/addons for local assets ...

	I1028 13:09:20.426601  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/files for local assets ...

	I1028 13:09:20.426728  862106 filesync.go:149] local asset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> 8470622.pem in /etc/ssl/certs

	I1028 13:09:20.426747  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /etc/ssl/certs/8470622.pem

	I1028 13:09:20.426887  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1028 13:09:20.436333  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:09:20.462007  862106 start.go:296] duration metric: took 127.035486ms for postStartSetup

	I1028 13:09:20.462077  862106 main.go:141] libmachine: (ha-798963) Calling .GetConfigRaw

	I1028 13:09:20.462723  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:20.465600  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.465974  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.466013  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.466234  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:09:20.466443  862106 start.go:128] duration metric: took 24.990541312s to createHost

	I1028 13:09:20.466470  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.468887  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.469391  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.469420  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.469677  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.469912  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.470079  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.470250  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.470488  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:20.470723  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:20.470765  862106 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1028 13:09:20.576433  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730120960.555377796

	I1028 13:09:20.576471  862106 fix.go:216] guest clock: 1730120960.555377796

	I1028 13:09:20.576484  862106 fix.go:229] Guest: 2024-10-28 13:09:20.555377796 +0000 UTC Remote: 2024-10-28 13:09:20.466457798 +0000 UTC m=+25.112511060 (delta=88.919998ms)

	I1028 13:09:20.576517  862106 fix.go:200] guest clock delta is within tolerance: 88.919998ms

	I1028 13:09:20.576525  862106 start.go:83] releasing machines lock for "ha-798963", held for 25.100750756s

	I1028 13:09:20.576549  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.576859  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:20.579943  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.580302  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.580333  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.580518  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.580966  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.581142  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.581247  862106 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1028 13:09:20.581328  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.581399  862106 ssh_runner.go:195] Run: cat /version.json

	I1028 13:09:20.581428  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.584211  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584263  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584590  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.584635  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584678  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.584700  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584799  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.584973  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.585103  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.585242  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.585249  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.585473  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.585483  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.585582  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.660496  862106 ssh_runner.go:195] Run: systemctl --version

	I1028 13:09:20.694123  862106 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1028 13:09:20.855514  862106 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1028 13:09:20.861807  862106 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1028 13:09:20.861875  862106 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1028 13:09:20.877941  862106 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1028 13:09:20.877968  862106 start.go:495] detecting cgroup driver to use...

	I1028 13:09:20.878035  862106 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1028 13:09:20.893964  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1028 13:09:20.909067  862106 docker.go:217] disabling cri-docker service (if available) ...

	I1028 13:09:20.909138  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1028 13:09:20.922578  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1028 13:09:20.936106  862106 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1028 13:09:21.050986  862106 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1028 13:09:21.194453  862106 docker.go:233] disabling docker service ...

	I1028 13:09:21.194538  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1028 13:09:21.208683  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1028 13:09:21.221205  862106 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1028 13:09:21.354881  862106 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1028 13:09:21.489372  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1028 13:09:21.502821  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1028 13:09:21.520866  862106 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I1028 13:09:21.520931  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.531395  862106 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1028 13:09:21.531480  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.541782  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.551820  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.561848  862106 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1028 13:09:21.572350  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.582219  862106 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.598641  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.608821  862106 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1028 13:09:21.618174  862106 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1028 13:09:21.618247  862106 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1028 13:09:21.630845  862106 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1028 13:09:21.640219  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:09:21.757889  862106 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1028 13:09:21.845787  862106 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I1028 13:09:21.845872  862106 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1028 13:09:21.850845  862106 start.go:563] Will wait 60s for crictl version

	I1028 13:09:21.850902  862106 ssh_runner.go:195] Run: which crictl

	I1028 13:09:21.854415  862106 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1028 13:09:21.893000  862106 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I1028 13:09:21.893081  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:09:21.920604  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:09:21.950947  862106 out.go:177] * Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	I1028 13:09:21.952359  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:21.955372  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:21.955825  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:21.955844  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:21.956168  862106 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I1028 13:09:21.960053  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:09:21.972723  862106 kubeadm.go:883] updating cluster {Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Cl

usterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1028 13:09:21.972844  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:09:21.972886  862106 ssh_runner.go:195] Run: sudo crictl images --output json

	I1028 13:09:22.004515  862106 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.31.2". assuming images are not preloaded.

	I1028 13:09:22.004587  862106 ssh_runner.go:195] Run: which lz4

	I1028 13:09:22.008152  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I1028 13:09:22.008271  862106 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I1028 13:09:22.012016  862106 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1028 13:09:22.012053  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (392059347 bytes)

	I1028 13:09:23.241520  862106 crio.go:462] duration metric: took 1.233279918s to copy over tarball

	I1028 13:09:23.241597  862106 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I1028 13:09:25.333757  862106 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.092116025s)

	I1028 13:09:25.333855  862106 crio.go:469] duration metric: took 2.092292987s to extract the tarball

	I1028 13:09:25.333890  862106 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1028 13:09:25.370210  862106 ssh_runner.go:195] Run: sudo crictl images --output json

	I1028 13:09:25.426062  862106 crio.go:514] all images are preloaded for cri-o runtime.

	I1028 13:09:25.426086  862106 cache_images.go:84] Images are preloaded, skipping loading

	I1028 13:09:25.426095  862106 kubeadm.go:934] updating node { 192.168.39.179 8443 v1.31.2 crio true true} ...

	I1028 13:09:25.426197  862106 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-798963 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.179

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1028 13:09:25.426265  862106 ssh_runner.go:195] Run: crio config

	I1028 13:09:25.479768  862106 cni.go:84] Creating CNI manager for ""

	I1028 13:09:25.479795  862106 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I1028 13:09:25.479808  862106 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1028 13:09:25.479839  862106 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.179 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-798963 NodeName:ha-798963 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.179"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.179 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1028 13:09:25.480019  862106 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.179

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-798963"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.39.179"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.179"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      - name: "proxy-refresh-interval"

	        value: "70000"

	kubernetesVersion: v1.31.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1028 13:09:25.480044  862106 kube-vip.go:115] generating kube-vip config ...

	I1028 13:09:25.480089  862106 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I1028 13:09:25.497899  862106 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I1028 13:09:25.498047  862106 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.4

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I1028 13:09:25.498116  862106 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1028 13:09:25.508120  862106 binaries.go:44] Found k8s binaries, skipping transfer

	I1028 13:09:25.508192  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I1028 13:09:25.517434  862106 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I1028 13:09:25.533166  862106 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1028 13:09:25.550308  862106 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2289 bytes)

	I1028 13:09:25.566379  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I1028 13:09:25.582510  862106 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I1028 13:09:25.586249  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:09:25.598206  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:09:25.723625  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:09:25.741116  862106 certs.go:68] Setting up /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963 for IP: 192.168.39.179

	I1028 13:09:25.741148  862106 certs.go:194] generating shared ca certs ...

	I1028 13:09:25.741175  862106 certs.go:226] acquiring lock for ca certs: {Name:mk72dd610cd229d2e25ba7be15f7e5f7b195435a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:25.741384  862106 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key

	I1028 13:09:25.741443  862106 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key

	I1028 13:09:25.741456  862106 certs.go:256] generating profile certs ...

	I1028 13:09:25.741552  862106 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key

	I1028 13:09:25.741573  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt with IP's: []

	I1028 13:09:26.090079  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt ...

	I1028 13:09:26.090117  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt: {Name:mk3fe8f323d83f4ebd84a8d786303da577fe6766 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.090331  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key ...

	I1028 13:09:26.090348  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key: {Name:mk594d3d79345e53ffa841fb25dd9e698fdb4fdf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.090459  862106 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762

	I1028 13:09:26.090478  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.179 192.168.39.254]

	I1028 13:09:26.298909  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762 ...

	I1028 13:09:26.298948  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762: {Name:mka9a8156a429a9cb509b5b1fc05a7fdfb56c428 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.299159  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762 ...

	I1028 13:09:26.299178  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762: {Name:mke17162bd0b6171ceec8286f5ff7299dd69297a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.299286  862106 certs.go:381] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt

	I1028 13:09:26.299386  862106 certs.go:385] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key

	I1028 13:09:26.299438  862106 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key

	I1028 13:09:26.299456  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt with IP's: []

	I1028 13:09:26.376199  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt ...

	I1028 13:09:26.376234  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt: {Name:mk48e71bedfedfcf6c26ee161c72f8db6a8d385d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.376440  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key ...

	I1028 13:09:26.376460  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key: {Name:mkf9647dc083a6381ed0c40db86a25190abd9cfc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.376564  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1028 13:09:26.376586  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1028 13:09:26.376598  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1028 13:09:26.376608  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1028 13:09:26.376621  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1028 13:09:26.376632  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1028 13:09:26.376643  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1028 13:09:26.376658  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1028 13:09:26.376716  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem (1338 bytes)

	W1028 13:09:26.376755  862106 certs.go:480] ignoring /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062_empty.pem, impossibly tiny 0 bytes

	I1028 13:09:26.376767  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem (1679 bytes)

	I1028 13:09:26.376788  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem (1082 bytes)

	I1028 13:09:26.376810  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem (1123 bytes)

	I1028 13:09:26.376834  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem (1679 bytes)

	I1028 13:09:26.376869  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:09:26.376896  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.376912  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.376923  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem -> /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.377540  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1028 13:09:26.404102  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1028 13:09:26.429065  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1028 13:09:26.452305  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1028 13:09:26.475399  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I1028 13:09:26.502257  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1028 13:09:26.524571  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1028 13:09:26.547735  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1028 13:09:26.570342  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /usr/share/ca-certificates/8470622.pem (1708 bytes)

	I1028 13:09:26.592362  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1028 13:09:26.614638  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem --> /usr/share/ca-certificates/847062.pem (1338 bytes)

	I1028 13:09:26.638083  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1028 13:09:26.655519  862106 ssh_runner.go:195] Run: openssl version

	I1028 13:09:26.661194  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8470622.pem && ln -fs /usr/share/ca-certificates/8470622.pem /etc/ssl/certs/8470622.pem"

	I1028 13:09:26.672564  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.677254  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 13:01 /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.677324  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.683486  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8470622.pem /etc/ssl/certs/3ec20f2e.0"

	I1028 13:09:26.694953  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1028 13:09:26.706214  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.710632  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:21 /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.710703  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.716613  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1028 13:09:26.729112  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/847062.pem && ln -fs /usr/share/ca-certificates/847062.pem /etc/ssl/certs/847062.pem"

	I1028 13:09:26.739953  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.744420  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 13:01 /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.744500  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.750083  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/847062.pem /etc/ssl/certs/51391683.0"

	I1028 13:09:26.760868  862106 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1028 13:09:26.764911  862106 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1028 13:09:26.764981  862106 kubeadm.go:392] StartCluster: {Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Clust

erName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 13:09:26.765061  862106 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I1028 13:09:26.765135  862106 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1028 13:09:26.806599  862106 cri.go:89] found id: ""

	I1028 13:09:26.806689  862106 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1028 13:09:26.816715  862106 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1028 13:09:26.828480  862106 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1028 13:09:26.839134  862106 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1028 13:09:26.839173  862106 kubeadm.go:157] found existing configuration files:

	I1028 13:09:26.839222  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1028 13:09:26.853826  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1028 13:09:26.853915  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1028 13:09:26.865744  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1028 13:09:26.875021  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1028 13:09:26.875114  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1028 13:09:26.884628  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1028 13:09:26.894266  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1028 13:09:26.894337  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1028 13:09:26.904159  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1028 13:09:26.913908  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1028 13:09:26.913976  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1028 13:09:26.923694  862106 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I1028 13:09:27.043881  862106 kubeadm.go:310] [init] Using Kubernetes version: v1.31.2

	I1028 13:09:27.044005  862106 kubeadm.go:310] [preflight] Running pre-flight checks

	I1028 13:09:27.141924  862106 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1028 13:09:27.142065  862106 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1028 13:09:27.142222  862106 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I1028 13:09:27.150765  862106 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1028 13:09:27.244897  862106 out.go:235]   - Generating certificates and keys ...

	I1028 13:09:27.245109  862106 kubeadm.go:310] [certs] Using existing ca certificate authority

	I1028 13:09:27.245229  862106 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I1028 13:09:27.499100  862106 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1028 13:09:27.698770  862106 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I1028 13:09:27.943509  862106 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I1028 13:09:28.169621  862106 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I1028 13:09:28.268655  862106 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I1028 13:09:28.268883  862106 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-798963 localhost] and IPs [192.168.39.179 127.0.0.1 ::1]

	I1028 13:09:28.417767  862106 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I1028 13:09:28.417980  862106 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-798963 localhost] and IPs [192.168.39.179 127.0.0.1 ::1]

	I1028 13:09:28.562634  862106 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1028 13:09:28.610851  862106 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I1028 13:09:28.789581  862106 kubeadm.go:310] [certs] Generating "sa" key and public key

	I1028 13:09:28.789681  862106 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1028 13:09:28.942051  862106 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1028 13:09:28.989198  862106 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I1028 13:09:29.060675  862106 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1028 13:09:29.244777  862106 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1028 13:09:29.323710  862106 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1028 13:09:29.324392  862106 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1028 13:09:29.328114  862106 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1028 13:09:29.398030  862106 out.go:235]   - Booting up control plane ...

	I1028 13:09:29.398228  862106 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1028 13:09:29.398317  862106 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1028 13:09:29.398410  862106 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1028 13:09:29.398547  862106 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1028 13:09:29.398661  862106 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1028 13:09:29.398724  862106 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I1028 13:09:29.492878  862106 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I1028 13:09:29.493016  862106 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I1028 13:09:30.496631  862106 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.003906465s

	I1028 13:09:30.496785  862106 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I1028 13:09:36.131691  862106 kubeadm.go:310] [api-check] The API server is healthy after 5.638328993s

	I1028 13:09:36.143587  862106 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1028 13:09:36.167327  862106 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1028 13:09:36.705076  862106 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I1028 13:09:36.705277  862106 kubeadm.go:310] [mark-control-plane] Marking the node ha-798963 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1028 13:09:36.719563  862106 kubeadm.go:310] [bootstrap-token] Using token: kgbmv9.ae55kcr18658q9sr

	I1028 13:09:36.721301  862106 out.go:235]   - Configuring RBAC rules ...

	I1028 13:09:36.721464  862106 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1028 13:09:36.732132  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1028 13:09:36.740506  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1028 13:09:36.748255  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1028 13:09:36.752567  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1028 13:09:36.756467  862106 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1028 13:09:36.773978  862106 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1028 13:09:37.042262  862106 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I1028 13:09:37.540410  862106 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I1028 13:09:37.540992  862106 kubeadm.go:310] 

	I1028 13:09:37.541101  862106 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I1028 13:09:37.541114  862106 kubeadm.go:310] 

	I1028 13:09:37.541220  862106 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I1028 13:09:37.541251  862106 kubeadm.go:310] 

	I1028 13:09:37.541299  862106 kubeadm.go:310]   mkdir -p $HOME/.kube

	I1028 13:09:37.541388  862106 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1028 13:09:37.541482  862106 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1028 13:09:37.541504  862106 kubeadm.go:310] 

	I1028 13:09:37.541582  862106 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I1028 13:09:37.541592  862106 kubeadm.go:310] 

	I1028 13:09:37.541666  862106 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1028 13:09:37.541674  862106 kubeadm.go:310] 

	I1028 13:09:37.541745  862106 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I1028 13:09:37.541863  862106 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1028 13:09:37.541958  862106 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1028 13:09:37.541968  862106 kubeadm.go:310] 

	I1028 13:09:37.542123  862106 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I1028 13:09:37.542224  862106 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I1028 13:09:37.542238  862106 kubeadm.go:310] 

	I1028 13:09:37.542402  862106 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token kgbmv9.ae55kcr18658q9sr \

	I1028 13:09:37.542555  862106 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d \

	I1028 13:09:37.542587  862106 kubeadm.go:310] 	--control-plane 

	I1028 13:09:37.542597  862106 kubeadm.go:310] 

	I1028 13:09:37.542725  862106 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I1028 13:09:37.542740  862106 kubeadm.go:310] 

	I1028 13:09:37.542842  862106 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token kgbmv9.ae55kcr18658q9sr \

	I1028 13:09:37.542970  862106 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d 

	I1028 13:09:37.543223  862106 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1028 13:09:37.543397  862106 cni.go:84] Creating CNI manager for ""

	I1028 13:09:37.543415  862106 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I1028 13:09:37.544963  862106 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1028 13:09:37.546271  862106 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1028 13:09:37.551746  862106 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.2/kubectl ...

	I1028 13:09:37.551777  862106 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)

	I1028 13:09:37.570362  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1028 13:09:37.946277  862106 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1028 13:09:37.946412  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:37.946428  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-798963 minikube.k8s.io/updated_at=2024_10_28T13_09_37_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=ha-798963 minikube.k8s.io/primary=true

	I1028 13:09:37.968277  862106 ops.go:34] apiserver oom_adj: -16

	I1028 13:09:38.075833  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:38.576438  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:39.076418  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:39.575915  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:40.076165  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:40.576271  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:41.076897  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:41.218170  862106 kubeadm.go:1113] duration metric: took 3.271834134s to wait for elevateKubeSystemPrivileges

	I1028 13:09:41.218217  862106 kubeadm.go:394] duration metric: took 14.453243119s to StartCluster

	I1028 13:09:41.218245  862106 settings.go:142] acquiring lock: {Name:mk5bff38fc6565138d7b896c5c59f693f2cf271a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:41.218339  862106 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:09:41.219153  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/kubeconfig: {Name:mk593b26e38c75daf24e9303475967cc0bb4e68e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:41.219425  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1028 13:09:41.219424  862106 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:09:41.219455  862106 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1028 13:09:41.219528  862106 start.go:241] waiting for startup goroutines ...

	I1028 13:09:41.219543  862106 addons.go:69] Setting storage-provisioner=true in profile "ha-798963"

	I1028 13:09:41.219550  862106 addons.go:69] Setting default-storageclass=true in profile "ha-798963"

	I1028 13:09:41.219560  862106 addons.go:234] Setting addon storage-provisioner=true in "ha-798963"

	I1028 13:09:41.219567  862106 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-798963"

	I1028 13:09:41.219628  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:09:41.219692  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:09:41.220097  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.220112  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.220137  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.220157  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.236056  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39907

	I1028 13:09:41.236463  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38395

	I1028 13:09:41.236704  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.237039  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.237367  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.237401  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.237626  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.237656  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.237798  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.238003  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:41.238051  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.238694  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.238740  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.240433  862106 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:09:41.240801  862106 kapi.go:59] client config for ha-798963: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt", KeyFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key", CAFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2439ec0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1028 13:09:41.241435  862106 cert_rotation.go:140] Starting client certificate rotation controller

	I1028 13:09:41.241785  862106 addons.go:234] Setting addon default-storageclass=true in "ha-798963"

	I1028 13:09:41.241838  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:09:41.242237  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.242292  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.254961  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34867

	I1028 13:09:41.255498  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.256018  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.256045  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.256430  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.256630  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:41.258371  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:41.258588  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38285

	I1028 13:09:41.259011  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.259612  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.259632  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.259998  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.260479  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.260516  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.260639  862106 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1028 13:09:41.262432  862106 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1028 13:09:41.262456  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1028 13:09:41.262479  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:41.266164  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.266666  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:41.266696  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.266845  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:41.267068  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:41.267293  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:41.267456  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:41.276996  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34343

	I1028 13:09:41.277475  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.278089  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.278117  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.278572  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.278776  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:41.280502  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:41.280724  862106 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1028 13:09:41.280740  862106 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1028 13:09:41.280756  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:41.283816  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.284254  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:41.284286  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.284617  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:41.284805  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:41.285005  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:41.285162  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:41.396479  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1028 13:09:41.465351  862106 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1028 13:09:41.548766  862106 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1028 13:09:41.969520  862106 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I1028 13:09:42.113999  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114028  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114061  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114079  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114389  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114405  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114405  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114422  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114431  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114439  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114413  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114490  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114678  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114691  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114769  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114784  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114802  862106 main.go:141] libmachine: (ha-798963) DBG | Closing plugin on server side

	I1028 13:09:42.114859  862106 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false

	I1028 13:09:42.114879  862106 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false

	I1028 13:09:42.114995  862106 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I1028 13:09:42.115007  862106 round_trippers.go:469] Request Headers:

	I1028 13:09:42.115018  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:09:42.115023  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:09:42.128731  862106 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I1028 13:09:42.129399  862106 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I1028 13:09:42.129419  862106 round_trippers.go:469] Request Headers:

	I1028 13:09:42.129430  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:09:42.129435  862106 round_trippers.go:473]     Content-Type: application/json

	I1028 13:09:42.129438  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:09:42.134236  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:09:42.134438  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.134455  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.134740  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.134761  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.137374  862106 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I1028 13:09:42.138538  862106 addons.go:510] duration metric: took 919.086468ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I1028 13:09:42.138580  862106 start.go:246] waiting for cluster config update ...

	I1028 13:09:42.138591  862106 start.go:255] writing updated cluster config ...

	I1028 13:09:42.140177  862106 out.go:201] 

	I1028 13:09:42.141615  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:09:42.141708  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:09:42.143352  862106 out.go:177] * Starting "ha-798963-m02" control-plane node in "ha-798963" cluster

	I1028 13:09:42.144914  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:09:42.144949  862106 cache.go:56] Caching tarball of preloaded images

	I1028 13:09:42.145078  862106 preload.go:172] Found /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I1028 13:09:42.145094  862106 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on crio

	I1028 13:09:42.145207  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:09:42.145441  862106 start.go:360] acquireMachinesLock for ha-798963-m02: {Name:mk3d8412df30fd3411bfb6262eb0fa70b21bf365 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1028 13:09:42.145510  862106 start.go:364] duration metric: took 40.785µs to acquireMachinesLock for "ha-798963-m02"

	I1028 13:09:42.145535  862106 start.go:93] Provisioning new machine with config: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:09:42.145645  862106 start.go:125] createHost starting for "m02" (driver="kvm2")

	I1028 13:09:42.147354  862106 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1028 13:09:42.147462  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:42.147504  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:42.164067  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33725

	I1028 13:09:42.164521  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:42.165132  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:42.165155  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:42.165511  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:42.165741  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:09:42.165883  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:09:42.166026  862106 start.go:159] libmachine.API.Create for "ha-798963" (driver="kvm2")

	I1028 13:09:42.166059  862106 client.go:168] LocalClient.Create starting

	I1028 13:09:42.166097  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem

	I1028 13:09:42.166139  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:09:42.166160  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:09:42.166238  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem

	I1028 13:09:42.166264  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:09:42.166282  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:09:42.166308  862106 main.go:141] libmachine: Running pre-create checks...

	I1028 13:09:42.166318  862106 main.go:141] libmachine: (ha-798963-m02) Calling .PreCreateCheck

	I1028 13:09:42.166546  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetConfigRaw

	I1028 13:09:42.166906  862106 main.go:141] libmachine: Creating machine...

	I1028 13:09:42.166917  862106 main.go:141] libmachine: (ha-798963-m02) Calling .Create

	I1028 13:09:42.167085  862106 main.go:141] libmachine: (ha-798963-m02) Creating KVM machine...

	I1028 13:09:42.168461  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found existing default KVM network

	I1028 13:09:42.168637  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found existing private KVM network mk-ha-798963

	I1028 13:09:42.168780  862106 main.go:141] libmachine: (ha-798963-m02) Setting up store path in /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02 ...

	I1028 13:09:42.168806  862106 main.go:141] libmachine: (ha-798963-m02) Building disk image from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso

	I1028 13:09:42.168902  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.168755  862476 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:09:42.168994  862106 main.go:141] libmachine: (ha-798963-m02) Downloading /home/jenkins/minikube-integration/19865-839778/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...

	I1028 13:09:42.452358  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.452201  862476 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa...

	I1028 13:09:42.765216  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.765047  862476 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/ha-798963-m02.rawdisk...

	I1028 13:09:42.765250  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Writing magic tar header

	I1028 13:09:42.765265  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Writing SSH key tar header

	I1028 13:09:42.765276  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.765165  862476 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02 ...

	I1028 13:09:42.765289  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02 (perms=drwx------)

	I1028 13:09:42.765302  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02

	I1028 13:09:42.765319  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines

	I1028 13:09:42.765337  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:09:42.765349  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines (perms=drwxr-xr-x)

	I1028 13:09:42.765360  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube (perms=drwxr-xr-x)

	I1028 13:09:42.765380  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778

	I1028 13:09:42.765390  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I1028 13:09:42.765402  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins

	I1028 13:09:42.765412  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home

	I1028 13:09:42.765420  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Skipping /home - not owner

	I1028 13:09:42.765434  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778 (perms=drwxrwxr-x)

	I1028 13:09:42.765475  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I1028 13:09:42.765508  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I1028 13:09:42.765528  862106 main.go:141] libmachine: (ha-798963-m02) Creating domain...

	I1028 13:09:42.766384  862106 main.go:141] libmachine: (ha-798963-m02) define libvirt domain using xml: 

	I1028 13:09:42.766405  862106 main.go:141] libmachine: (ha-798963-m02) <domain type='kvm'>

	I1028 13:09:42.766414  862106 main.go:141] libmachine: (ha-798963-m02)   <name>ha-798963-m02</name>

	I1028 13:09:42.766422  862106 main.go:141] libmachine: (ha-798963-m02)   <memory unit='MiB'>2200</memory>

	I1028 13:09:42.766437  862106 main.go:141] libmachine: (ha-798963-m02)   <vcpu>2</vcpu>

	I1028 13:09:42.766446  862106 main.go:141] libmachine: (ha-798963-m02)   <features>

	I1028 13:09:42.766451  862106 main.go:141] libmachine: (ha-798963-m02)     <acpi/>

	I1028 13:09:42.766455  862106 main.go:141] libmachine: (ha-798963-m02)     <apic/>

	I1028 13:09:42.766460  862106 main.go:141] libmachine: (ha-798963-m02)     <pae/>

	I1028 13:09:42.766466  862106 main.go:141] libmachine: (ha-798963-m02)     

	I1028 13:09:42.766471  862106 main.go:141] libmachine: (ha-798963-m02)   </features>

	I1028 13:09:42.766481  862106 main.go:141] libmachine: (ha-798963-m02)   <cpu mode='host-passthrough'>

	I1028 13:09:42.766491  862106 main.go:141] libmachine: (ha-798963-m02)   

	I1028 13:09:42.766506  862106 main.go:141] libmachine: (ha-798963-m02)   </cpu>

	I1028 13:09:42.766518  862106 main.go:141] libmachine: (ha-798963-m02)   <os>

	I1028 13:09:42.766527  862106 main.go:141] libmachine: (ha-798963-m02)     <type>hvm</type>

	I1028 13:09:42.766533  862106 main.go:141] libmachine: (ha-798963-m02)     <boot dev='cdrom'/>

	I1028 13:09:42.766540  862106 main.go:141] libmachine: (ha-798963-m02)     <boot dev='hd'/>

	I1028 13:09:42.766545  862106 main.go:141] libmachine: (ha-798963-m02)     <bootmenu enable='no'/>

	I1028 13:09:42.766552  862106 main.go:141] libmachine: (ha-798963-m02)   </os>

	I1028 13:09:42.766556  862106 main.go:141] libmachine: (ha-798963-m02)   <devices>

	I1028 13:09:42.766566  862106 main.go:141] libmachine: (ha-798963-m02)     <disk type='file' device='cdrom'>

	I1028 13:09:42.766586  862106 main.go:141] libmachine: (ha-798963-m02)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/boot2docker.iso'/>

	I1028 13:09:42.766601  862106 main.go:141] libmachine: (ha-798963-m02)       <target dev='hdc' bus='scsi'/>

	I1028 13:09:42.766609  862106 main.go:141] libmachine: (ha-798963-m02)       <readonly/>

	I1028 13:09:42.766616  862106 main.go:141] libmachine: (ha-798963-m02)     </disk>

	I1028 13:09:42.766628  862106 main.go:141] libmachine: (ha-798963-m02)     <disk type='file' device='disk'>

	I1028 13:09:42.766638  862106 main.go:141] libmachine: (ha-798963-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I1028 13:09:42.766646  862106 main.go:141] libmachine: (ha-798963-m02)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/ha-798963-m02.rawdisk'/>

	I1028 13:09:42.766653  862106 main.go:141] libmachine: (ha-798963-m02)       <target dev='hda' bus='virtio'/>

	I1028 13:09:42.766661  862106 main.go:141] libmachine: (ha-798963-m02)     </disk>

	I1028 13:09:42.766672  862106 main.go:141] libmachine: (ha-798963-m02)     <interface type='network'>

	I1028 13:09:42.766690  862106 main.go:141] libmachine: (ha-798963-m02)       <source network='mk-ha-798963'/>

	I1028 13:09:42.766706  862106 main.go:141] libmachine: (ha-798963-m02)       <model type='virtio'/>

	I1028 13:09:42.766714  862106 main.go:141] libmachine: (ha-798963-m02)     </interface>

	I1028 13:09:42.766721  862106 main.go:141] libmachine: (ha-798963-m02)     <interface type='network'>

	I1028 13:09:42.766727  862106 main.go:141] libmachine: (ha-798963-m02)       <source network='default'/>

	I1028 13:09:42.766734  862106 main.go:141] libmachine: (ha-798963-m02)       <model type='virtio'/>

	I1028 13:09:42.766741  862106 main.go:141] libmachine: (ha-798963-m02)     </interface>

	I1028 13:09:42.766751  862106 main.go:141] libmachine: (ha-798963-m02)     <serial type='pty'>

	I1028 13:09:42.766768  862106 main.go:141] libmachine: (ha-798963-m02)       <target port='0'/>

	I1028 13:09:42.766779  862106 main.go:141] libmachine: (ha-798963-m02)     </serial>

	I1028 13:09:42.766787  862106 main.go:141] libmachine: (ha-798963-m02)     <console type='pty'>

	I1028 13:09:42.766801  862106 main.go:141] libmachine: (ha-798963-m02)       <target type='serial' port='0'/>

	I1028 13:09:42.766837  862106 main.go:141] libmachine: (ha-798963-m02)     </console>

	I1028 13:09:42.766863  862106 main.go:141] libmachine: (ha-798963-m02)     <rng model='virtio'>

	I1028 13:09:42.766874  862106 main.go:141] libmachine: (ha-798963-m02)       <backend model='random'>/dev/random</backend>

	I1028 13:09:42.766885  862106 main.go:141] libmachine: (ha-798963-m02)     </rng>

	I1028 13:09:42.766896  862106 main.go:141] libmachine: (ha-798963-m02)     

	I1028 13:09:42.766903  862106 main.go:141] libmachine: (ha-798963-m02)     

	I1028 13:09:42.766914  862106 main.go:141] libmachine: (ha-798963-m02)   </devices>

	I1028 13:09:42.766920  862106 main.go:141] libmachine: (ha-798963-m02) </domain>

	I1028 13:09:42.766933  862106 main.go:141] libmachine: (ha-798963-m02) 

	I1028 13:09:42.773696  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:40:c9:62 in network default

	I1028 13:09:42.774241  862106 main.go:141] libmachine: (ha-798963-m02) Ensuring networks are active...

	I1028 13:09:42.774266  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:42.774978  862106 main.go:141] libmachine: (ha-798963-m02) Ensuring network default is active

	I1028 13:09:42.775278  862106 main.go:141] libmachine: (ha-798963-m02) Ensuring network mk-ha-798963 is active

	I1028 13:09:42.775572  862106 main.go:141] libmachine: (ha-798963-m02) Getting domain xml...

	I1028 13:09:42.776198  862106 main.go:141] libmachine: (ha-798963-m02) Creating domain...

	I1028 13:09:44.020748  862106 main.go:141] libmachine: (ha-798963-m02) Waiting to get IP...

	I1028 13:09:44.021632  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.022163  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.022194  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.022132  862476 retry.go:31] will retry after 254.828705ms: waiting for machine to come up

	I1028 13:09:44.278676  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.279192  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.279219  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.279139  862476 retry.go:31] will retry after 293.737826ms: waiting for machine to come up

	I1028 13:09:44.574780  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.575391  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.575422  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.575359  862476 retry.go:31] will retry after 359.509756ms: waiting for machine to come up

	I1028 13:09:44.936955  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.937409  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.937440  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.937340  862476 retry.go:31] will retry after 582.704584ms: waiting for machine to come up

	I1028 13:09:45.522130  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:45.522569  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:45.522599  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:45.522514  862476 retry.go:31] will retry after 727.740816ms: waiting for machine to come up

	I1028 13:09:46.252326  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:46.252817  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:46.252871  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:46.252779  862476 retry.go:31] will retry after 576.116476ms: waiting for machine to come up

	I1028 13:09:46.830599  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:46.831064  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:46.831091  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:46.831004  862476 retry.go:31] will retry after 959.377706ms: waiting for machine to come up

	I1028 13:09:47.791720  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:47.792294  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:47.792339  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:47.792234  862476 retry.go:31] will retry after 1.298463264s: waiting for machine to come up

	I1028 13:09:49.092707  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:49.093238  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:49.093259  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:49.093213  862476 retry.go:31] will retry after 1.838050456s: waiting for machine to come up

	I1028 13:09:50.934515  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:50.935015  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:50.935049  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:50.934937  862476 retry.go:31] will retry after 2.181424922s: waiting for machine to come up

	I1028 13:09:53.118307  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:53.118775  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:53.118794  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:53.118738  862476 retry.go:31] will retry after 2.226552366s: waiting for machine to come up

	I1028 13:09:55.346560  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:55.346919  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:55.346944  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:55.346874  862476 retry.go:31] will retry after 2.451757382s: waiting for machine to come up

	I1028 13:09:57.799825  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:57.800240  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:57.800264  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:57.800199  862476 retry.go:31] will retry after 4.138330848s: waiting for machine to come up

	I1028 13:10:01.943643  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:01.944310  862106 main.go:141] libmachine: (ha-798963-m02) Found IP for machine: 192.168.39.109

	I1028 13:10:01.944336  862106 main.go:141] libmachine: (ha-798963-m02) Reserving static IP address...

	I1028 13:10:01.944350  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has current primary IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:01.944812  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find host DHCP lease matching {name: "ha-798963-m02", mac: "52:54:00:f9:81:b1", ip: "192.168.39.109"} in network mk-ha-798963

	I1028 13:10:02.029987  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Getting to WaitForSSH function...

	I1028 13:10:02.030107  862106 main.go:141] libmachine: (ha-798963-m02) Reserved static IP address: 192.168.39.109

	I1028 13:10:02.030121  862106 main.go:141] libmachine: (ha-798963-m02) Waiting for SSH to be available...

	I1028 13:10:02.032593  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.033191  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:minikube Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.033225  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.033386  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Using SSH client type: external

	I1028 13:10:02.033412  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa (-rw-------)

	I1028 13:10:02.033473  862106 main.go:141] libmachine: (ha-798963-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.109 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:10:02.033505  862106 main.go:141] libmachine: (ha-798963-m02) DBG | About to run SSH command:

	I1028 13:10:02.033524  862106 main.go:141] libmachine: (ha-798963-m02) DBG | exit 0

	I1028 13:10:02.159978  862106 main.go:141] libmachine: (ha-798963-m02) DBG | SSH cmd err, output: <nil>: 

	I1028 13:10:02.160343  862106 main.go:141] libmachine: (ha-798963-m02) KVM machine creation complete!

	I1028 13:10:02.160622  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetConfigRaw

	I1028 13:10:02.161298  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:02.161540  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:02.161789  862106 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I1028 13:10:02.161807  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetState

	I1028 13:10:02.163343  862106 main.go:141] libmachine: Detecting operating system of created instance...

	I1028 13:10:02.163363  862106 main.go:141] libmachine: Waiting for SSH to be available...

	I1028 13:10:02.163371  862106 main.go:141] libmachine: Getting to WaitForSSH function...

	I1028 13:10:02.163379  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.165920  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.166393  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.166422  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.166641  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.166927  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.167157  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.167302  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.167565  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.167800  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.167813  862106 main.go:141] libmachine: About to run SSH command:

	exit 0

	I1028 13:10:02.279175  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:10:02.279209  862106 main.go:141] libmachine: Detecting the provisioner...

	I1028 13:10:02.279217  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.282405  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.282977  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.283011  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.283246  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.283527  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.283687  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.283846  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.284052  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.284278  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.284292  862106 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I1028 13:10:02.396543  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I1028 13:10:02.396635  862106 main.go:141] libmachine: found compatible host: buildroot

	I1028 13:10:02.396649  862106 main.go:141] libmachine: Provisioning with buildroot...

	I1028 13:10:02.396661  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:10:02.396929  862106 buildroot.go:166] provisioning hostname "ha-798963-m02"

	I1028 13:10:02.396961  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:10:02.397209  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.400037  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.400536  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.400564  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.400805  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.401051  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.401235  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.401358  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.401503  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.401697  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.401713  862106 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-798963-m02 && echo "ha-798963-m02" | sudo tee /etc/hostname

	I1028 13:10:02.526196  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-798963-m02

	I1028 13:10:02.526232  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.529297  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.529789  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.529825  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.530002  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.530231  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.530384  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.530540  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.530717  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.530936  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.530959  862106 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-798963-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-798963-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-798963-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1028 13:10:02.648659  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:10:02.648692  862106 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19865-839778/.minikube CaCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19865-839778/.minikube}

	I1028 13:10:02.648716  862106 buildroot.go:174] setting up certificates

	I1028 13:10:02.648738  862106 provision.go:84] configureAuth start

	I1028 13:10:02.648755  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:10:02.649077  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:02.652321  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.652726  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.652747  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.652918  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.655478  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.655902  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.655927  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.656134  862106 provision.go:143] copyHostCerts

	I1028 13:10:02.656175  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:10:02.656221  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem, removing ...

	I1028 13:10:02.656233  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:10:02.656322  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem (1082 bytes)

	I1028 13:10:02.656424  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:10:02.656447  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem, removing ...

	I1028 13:10:02.656456  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:10:02.656498  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem (1123 bytes)

	I1028 13:10:02.656571  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:10:02.656595  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem, removing ...

	I1028 13:10:02.656605  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:10:02.656630  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem (1679 bytes)

	I1028 13:10:02.656688  862106 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem org=jenkins.ha-798963-m02 san=[127.0.0.1 192.168.39.109 ha-798963-m02 localhost minikube]

	I1028 13:10:02.745309  862106 provision.go:177] copyRemoteCerts

	I1028 13:10:02.745388  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1028 13:10:02.745424  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.748382  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.748733  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.748758  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.749008  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.749206  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.749363  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.749509  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:02.834192  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1028 13:10:02.834275  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1028 13:10:02.857189  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1028 13:10:02.857279  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I1028 13:10:02.880207  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1028 13:10:02.880285  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1028 13:10:02.904157  862106 provision.go:87] duration metric: took 255.399126ms to configureAuth

	I1028 13:10:02.904193  862106 buildroot.go:189] setting minikube options for container-runtime

	I1028 13:10:02.904392  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:02.904473  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.907293  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.907679  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.907716  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.907951  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.908497  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.908677  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.908898  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.909092  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.909285  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.909307  862106 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1028 13:10:03.150577  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1028 13:10:03.150611  862106 main.go:141] libmachine: Checking connection to Docker...

	I1028 13:10:03.150623  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetURL

	I1028 13:10:03.152282  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Using libvirt version 6000000

	I1028 13:10:03.155208  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.155561  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.155584  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.155858  862106 main.go:141] libmachine: Docker is up and running!

	I1028 13:10:03.155878  862106 main.go:141] libmachine: Reticulating splines...

	I1028 13:10:03.155887  862106 client.go:171] duration metric: took 20.989819122s to LocalClient.Create

	I1028 13:10:03.155918  862106 start.go:167] duration metric: took 20.989892737s to libmachine.API.Create "ha-798963"

	I1028 13:10:03.155930  862106 start.go:293] postStartSetup for "ha-798963-m02" (driver="kvm2")

	I1028 13:10:03.155946  862106 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1028 13:10:03.155971  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.156307  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1028 13:10:03.156334  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:03.159123  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.159559  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.159587  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.159775  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.160057  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.160246  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.160491  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:03.247281  862106 ssh_runner.go:195] Run: cat /etc/os-release

	I1028 13:10:03.251671  862106 info.go:137] Remote host: Buildroot 2023.02.9

	I1028 13:10:03.251700  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/addons for local assets ...

	I1028 13:10:03.251809  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/files for local assets ...

	I1028 13:10:03.251900  862106 filesync.go:149] local asset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> 8470622.pem in /etc/ssl/certs

	I1028 13:10:03.251913  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /etc/ssl/certs/8470622.pem

	I1028 13:10:03.252022  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1028 13:10:03.262254  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:10:03.286390  862106 start.go:296] duration metric: took 130.439166ms for postStartSetup

	I1028 13:10:03.286462  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetConfigRaw

	I1028 13:10:03.287177  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:03.290506  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.290937  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.290965  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.291271  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:10:03.291515  862106 start.go:128] duration metric: took 21.145856579s to createHost

	I1028 13:10:03.291548  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:03.294268  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.294691  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.294729  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.294983  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.295212  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.295448  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.295659  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.295897  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:03.296093  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:03.296108  862106 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1028 13:10:03.412489  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730121003.383137059

	I1028 13:10:03.412521  862106 fix.go:216] guest clock: 1730121003.383137059

	I1028 13:10:03.412532  862106 fix.go:229] Guest: 2024-10-28 13:10:03.383137059 +0000 UTC Remote: 2024-10-28 13:10:03.291536289 +0000 UTC m=+67.937589543 (delta=91.60077ms)

	I1028 13:10:03.412558  862106 fix.go:200] guest clock delta is within tolerance: 91.60077ms

	I1028 13:10:03.412566  862106 start.go:83] releasing machines lock for "ha-798963-m02", held for 21.267041853s

	I1028 13:10:03.412617  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.412957  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:03.415783  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.416155  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.416187  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.418635  862106 out.go:177] * Found network options:

	I1028 13:10:03.420199  862106 out.go:177]   - NO_PROXY=192.168.39.179

	W1028 13:10:03.421452  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:10:03.421492  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.422162  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.422439  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.422563  862106 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1028 13:10:03.422611  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	W1028 13:10:03.422634  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:10:03.422717  862106 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1028 13:10:03.422740  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:03.425856  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.425952  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.426170  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.426198  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.426335  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.426401  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.426426  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.426560  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.426575  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.426709  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.426770  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.426841  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.426923  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:03.426957  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:03.664551  862106 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1028 13:10:03.671238  862106 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1028 13:10:03.671329  862106 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1028 13:10:03.688743  862106 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1028 13:10:03.688773  862106 start.go:495] detecting cgroup driver to use...

	I1028 13:10:03.688856  862106 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1028 13:10:03.706114  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1028 13:10:03.720558  862106 docker.go:217] disabling cri-docker service (if available) ...

	I1028 13:10:03.720634  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1028 13:10:03.736752  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1028 13:10:03.752420  862106 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1028 13:10:03.869419  862106 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1028 13:10:04.021825  862106 docker.go:233] disabling docker service ...

	I1028 13:10:04.021896  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1028 13:10:04.036467  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1028 13:10:04.050574  862106 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1028 13:10:04.161207  862106 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1028 13:10:04.275507  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1028 13:10:04.289594  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1028 13:10:04.308868  862106 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I1028 13:10:04.308947  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.319993  862106 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1028 13:10:04.320070  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.331199  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.342149  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.353484  862106 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1028 13:10:04.364548  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.375783  862106 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.393532  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.404230  862106 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1028 13:10:04.414432  862106 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1028 13:10:04.414522  862106 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1028 13:10:04.428507  862106 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1028 13:10:04.439205  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:10:04.555728  862106 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1028 13:10:04.650458  862106 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I1028 13:10:04.650533  862106 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1028 13:10:04.655509  862106 start.go:563] Will wait 60s for crictl version

	I1028 13:10:04.655596  862106 ssh_runner.go:195] Run: which crictl

	I1028 13:10:04.659379  862106 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1028 13:10:04.699051  862106 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I1028 13:10:04.699153  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:10:04.732192  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:10:04.763204  862106 out.go:177] * Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	I1028 13:10:04.764801  862106 out.go:177]   - env NO_PROXY=192.168.39.179

	I1028 13:10:04.766295  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:04.769786  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:04.770065  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:04.770091  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:04.770315  862106 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I1028 13:10:04.774265  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:10:04.787248  862106 mustload.go:65] Loading cluster: ha-798963

	I1028 13:10:04.787510  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:04.787910  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:04.787969  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:04.803374  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39961

	I1028 13:10:04.803933  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:04.804511  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:04.804543  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:04.804886  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:04.805256  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:10:04.807075  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:10:04.807379  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:04.807423  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:04.822680  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44657

	I1028 13:10:04.823219  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:04.823720  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:04.823747  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:04.824148  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:04.824334  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:10:04.824515  862106 certs.go:68] Setting up /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963 for IP: 192.168.39.109

	I1028 13:10:04.824530  862106 certs.go:194] generating shared ca certs ...

	I1028 13:10:04.824545  862106 certs.go:226] acquiring lock for ca certs: {Name:mk72dd610cd229d2e25ba7be15f7e5f7b195435a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:10:04.824680  862106 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key

	I1028 13:10:04.824717  862106 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key

	I1028 13:10:04.824727  862106 certs.go:256] generating profile certs ...

	I1028 13:10:04.824794  862106 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key

	I1028 13:10:04.824818  862106 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e

	I1028 13:10:04.824831  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.179 192.168.39.109 192.168.39.254]

	I1028 13:10:04.903924  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e ...

	I1028 13:10:04.903956  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e: {Name:mk3302003bd6f00a81bb48c8f525df3fa05a76e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:10:04.904156  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e ...

	I1028 13:10:04.904175  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e: {Name:mk38bc830309cc676ed8c95f6027dd71113302a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:10:04.904278  862106 certs.go:381] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt

	I1028 13:10:04.904422  862106 certs.go:385] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key

	I1028 13:10:04.904555  862106 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key

	I1028 13:10:04.904572  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1028 13:10:04.904585  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1028 13:10:04.904597  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1028 13:10:04.904609  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1028 13:10:04.904620  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1028 13:10:04.904630  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1028 13:10:04.904643  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1028 13:10:04.904655  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1028 13:10:04.904703  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem (1338 bytes)

	W1028 13:10:04.904727  862106 certs.go:480] ignoring /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062_empty.pem, impossibly tiny 0 bytes

	I1028 13:10:04.904737  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem (1679 bytes)

	I1028 13:10:04.904762  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem (1082 bytes)

	I1028 13:10:04.904785  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem (1123 bytes)

	I1028 13:10:04.904808  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem (1679 bytes)

	I1028 13:10:04.904848  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:10:04.904876  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:04.904890  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem -> /usr/share/ca-certificates/847062.pem

	I1028 13:10:04.904902  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /usr/share/ca-certificates/8470622.pem

	I1028 13:10:04.904935  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:10:04.908179  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:04.908587  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:10:04.908618  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:04.908846  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:10:04.909042  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:10:04.909218  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:10:04.909331  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:10:04.984250  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I1028 13:10:04.989850  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I1028 13:10:05.002396  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I1028 13:10:05.007262  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I1028 13:10:05.018834  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I1028 13:10:05.023378  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I1028 13:10:05.033476  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I1028 13:10:05.037515  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I1028 13:10:05.048068  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I1028 13:10:05.052307  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I1028 13:10:05.063097  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I1028 13:10:05.067455  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I1028 13:10:05.078689  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1028 13:10:05.103613  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1028 13:10:05.128647  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1028 13:10:05.152937  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1028 13:10:05.177303  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I1028 13:10:05.202285  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1028 13:10:05.226964  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1028 13:10:05.249927  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1028 13:10:05.272827  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1028 13:10:05.296188  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem --> /usr/share/ca-certificates/847062.pem (1338 bytes)

	I1028 13:10:05.319995  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /usr/share/ca-certificates/8470622.pem (1708 bytes)

	I1028 13:10:05.342239  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I1028 13:10:05.357550  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I1028 13:10:05.373358  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I1028 13:10:05.388854  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I1028 13:10:05.405266  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I1028 13:10:05.421621  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I1028 13:10:05.438496  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I1028 13:10:05.454647  862106 ssh_runner.go:195] Run: openssl version

	I1028 13:10:05.460185  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8470622.pem && ln -fs /usr/share/ca-certificates/8470622.pem /etc/ssl/certs/8470622.pem"

	I1028 13:10:05.470613  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8470622.pem

	I1028 13:10:05.474920  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 13:01 /usr/share/ca-certificates/8470622.pem

	I1028 13:10:05.474993  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8470622.pem

	I1028 13:10:05.480517  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8470622.pem /etc/ssl/certs/3ec20f2e.0"

	I1028 13:10:05.491256  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1028 13:10:05.501356  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:05.505593  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:21 /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:05.505653  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:05.511243  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1028 13:10:05.521727  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/847062.pem && ln -fs /usr/share/ca-certificates/847062.pem /etc/ssl/certs/847062.pem"

	I1028 13:10:05.533039  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/847062.pem

	I1028 13:10:05.537410  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 13:01 /usr/share/ca-certificates/847062.pem

	I1028 13:10:05.537476  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/847062.pem

	I1028 13:10:05.543201  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/847062.pem /etc/ssl/certs/51391683.0"

	I1028 13:10:05.554012  862106 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1028 13:10:05.557883  862106 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1028 13:10:05.557936  862106 kubeadm.go:934] updating node {m02 192.168.39.109 8443 v1.31.2 crio true true} ...

	I1028 13:10:05.558018  862106 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-798963-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.109

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1028 13:10:05.558042  862106 kube-vip.go:115] generating kube-vip config ...

	I1028 13:10:05.558077  862106 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I1028 13:10:05.576360  862106 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I1028 13:10:05.576436  862106 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.4

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I1028 13:10:05.576501  862106 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1028 13:10:05.587348  862106 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.2': No such file or directory

	Initiating transfer...

	I1028 13:10:05.587417  862106 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.2

	I1028 13:10:05.597912  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl.sha256

	I1028 13:10:05.597942  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl -> /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:10:05.598008  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:10:05.598030  862106 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm

	I1028 13:10:05.598009  862106 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet

	I1028 13:10:05.602384  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubectl': No such file or directory

	I1028 13:10:05.602413  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl --> /var/lib/minikube/binaries/v1.31.2/kubectl (56381592 bytes)

	I1028 13:10:06.558570  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm -> /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:10:06.558662  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:10:06.563325  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubeadm': No such file or directory

	I1028 13:10:06.563376  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm --> /var/lib/minikube/binaries/v1.31.2/kubeadm (58290328 bytes)

	I1028 13:10:06.691278  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:10:06.723373  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet -> /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:10:06.723504  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:10:06.733701  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubelet': No such file or directory

	I1028 13:10:06.733742  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet --> /var/lib/minikube/binaries/v1.31.2/kubelet (76902744 bytes)

	I1028 13:10:07.155554  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I1028 13:10:07.166555  862106 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I1028 13:10:07.183481  862106 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1028 13:10:07.202693  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I1028 13:10:07.220015  862106 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I1028 13:10:07.223991  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:10:07.237496  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:10:07.368677  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:10:07.388529  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:10:07.388876  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:07.388931  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:07.404449  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38669

	I1028 13:10:07.404901  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:07.405418  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:07.405441  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:07.405809  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:07.406000  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:10:07.406147  862106 start.go:317] joinCluster: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Cluster

Name:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiratio

n:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 13:10:07.406255  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I1028 13:10:07.406274  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:10:07.409554  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:07.409952  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:10:07.409982  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:07.410151  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:10:07.410364  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:10:07.410527  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:10:07.410658  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:10:07.561195  862106 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:10:07.561256  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 4x4oti.tzu8e9f2qalhbyyp --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m02 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443"

	I1028 13:10:29.194434  862106 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 4x4oti.tzu8e9f2qalhbyyp --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m02 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443": (21.633149132s)

	I1028 13:10:29.194477  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I1028 13:10:29.689152  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-798963-m02 minikube.k8s.io/updated_at=2024_10_28T13_10_29_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=ha-798963 minikube.k8s.io/primary=false

	I1028 13:10:29.794584  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-798963-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I1028 13:10:29.928171  862106 start.go:319] duration metric: took 22.522018271s to joinCluster

	I1028 13:10:29.928270  862106 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:10:29.928558  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:29.929878  862106 out.go:177] * Verifying Kubernetes components...

	I1028 13:10:29.931207  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:10:30.203706  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:10:30.234915  862106 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:10:30.235167  862106 kapi.go:59] client config for ha-798963: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt", KeyFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key", CAFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2439ec0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W1028 13:10:30.235233  862106 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.179:8443

	I1028 13:10:30.235442  862106 node_ready.go:35] waiting up to 6m0s for node "ha-798963-m02" to be "Ready" ...

	I1028 13:10:30.235565  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:30.235573  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:30.235581  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:30.235588  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:30.246224  862106 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I1028 13:10:30.735796  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:30.735820  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:30.735839  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:30.735845  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:30.743525  862106 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I1028 13:10:31.236356  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:31.236386  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:31.236396  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:31.236402  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:31.249202  862106 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I1028 13:10:31.735940  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:31.735962  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:31.735972  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:31.735975  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:31.739382  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:32.235849  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:32.235875  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:32.235884  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:32.235889  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:32.239431  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:32.239956  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:32.735863  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:32.735888  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:32.735896  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:32.735901  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:32.739892  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:33.235816  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:33.235852  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:33.235866  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:33.235873  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:33.239810  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:33.735931  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:33.735961  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:33.735973  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:33.735981  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:33.740986  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:34.236708  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:34.236735  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:34.236743  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:34.236747  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:34.240346  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:34.240874  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:34.736425  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:34.736457  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:34.736470  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:34.736478  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:34.740520  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:35.235691  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:35.235716  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:35.235725  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:35.235729  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:35.238909  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:35.736004  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:35.736034  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:35.736045  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:35.736051  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:35.739407  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:36.236607  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:36.236633  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:36.236642  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:36.236647  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:36.240587  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:36.241055  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:36.736513  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:36.736544  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:36.736555  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:36.736559  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:36.740131  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:37.236581  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:37.236605  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:37.236614  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:37.236619  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:37.240692  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:37.736413  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:37.736438  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:37.736447  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:37.736452  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:37.739597  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:38.236683  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:38.236714  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:38.236726  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:38.236731  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:38.240034  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:38.735831  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:38.735866  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:38.735878  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:38.735885  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:38.739044  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:38.739662  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:39.235830  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:39.235855  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:39.235864  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:39.235868  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:39.239608  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:39.736356  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:39.736383  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:39.736391  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:39.736397  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:39.739437  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:40.236423  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:40.236452  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:40.236462  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:40.236468  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:40.239827  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:40.736434  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:40.736459  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:40.736471  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:40.736480  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:40.740532  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:40.741072  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:41.236588  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:41.236613  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:41.236622  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:41.236627  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:41.240001  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:41.735862  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:41.735888  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:41.735896  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:41.735899  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:41.739493  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:42.235918  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:42.235947  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:42.235956  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:42.235959  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:42.240599  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:42.736378  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:42.736403  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:42.736413  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:42.736417  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:42.739919  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:43.235983  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:43.236012  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:43.236023  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:43.236028  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:43.240153  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:43.240759  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:43.735967  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:43.735991  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:43.736002  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:43.736007  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:43.740480  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:44.236351  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:44.236379  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:44.236388  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:44.236393  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:44.240702  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:44.735812  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:44.735841  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:44.735850  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:44.735857  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:44.739449  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:45.236500  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:45.236526  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:45.236534  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:45.236538  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:45.240237  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:45.735925  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:45.735976  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:45.735987  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:45.735994  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:45.739531  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:45.740129  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:46.236583  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:46.236609  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:46.236622  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:46.236628  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:46.240100  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:46.735943  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:46.735970  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:46.735978  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:46.735982  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:46.739043  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:47.236106  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:47.236141  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:47.236150  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:47.236154  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:47.239495  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:47.735791  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:47.735819  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:47.735827  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:47.735831  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:47.740271  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:47.740832  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:48.235954  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:48.235979  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.235987  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.235992  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.239602  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.240154  862106 node_ready.go:49] node "ha-798963-m02" has status "Ready":"True"

	I1028 13:10:48.240180  862106 node_ready.go:38] duration metric: took 18.004697309s for node "ha-798963-m02" to be "Ready" ...

	I1028 13:10:48.240191  862106 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:10:48.240308  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:48.240318  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.240330  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.240417  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.244764  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:48.253021  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.253146  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-7x97m

	I1028 13:10:48.253159  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.253170  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.253176  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.256204  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.256955  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.256974  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.256986  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.256991  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.259721  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.260335  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.260359  862106 pod_ready.go:82] duration metric: took 7.299723ms for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.260373  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.260456  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-bdv2v

	I1028 13:10:48.260466  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.260477  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.260487  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.262936  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.263701  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.263720  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.263731  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.263737  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.266331  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.266852  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.266875  862106 pod_ready.go:82] duration metric: took 6.490043ms for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.266886  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.266956  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963

	I1028 13:10:48.266966  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.266973  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.266979  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.269578  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.270283  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.270303  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.270312  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.270325  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.273059  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.273649  862106 pod_ready.go:93] pod "etcd-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.273670  862106 pod_ready.go:82] duration metric: took 6.776749ms for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.273679  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.273742  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m02

	I1028 13:10:48.273751  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.273758  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.273762  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.276403  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.276971  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:48.276986  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.276993  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.277005  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.279356  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.279816  862106 pod_ready.go:93] pod "etcd-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.279836  862106 pod_ready.go:82] duration metric: took 6.150003ms for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.279851  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.436280  862106 request.go:632] Waited for 156.345589ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:10:48.436387  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:10:48.436399  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.436411  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.436421  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.439791  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.636997  862106 request.go:632] Waited for 196.349982ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.637081  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.637089  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.637100  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.637108  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.640522  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.641056  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.641079  862106 pod_ready.go:82] duration metric: took 361.221986ms for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.641090  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.836017  862106 request.go:632] Waited for 194.83275ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:10:48.836108  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:10:48.836123  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.836131  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.836138  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.839410  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.036616  862106 request.go:632] Waited for 196.380427ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.036702  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.036707  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.036715  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.036722  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.039908  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.040476  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:49.040498  862106 pod_ready.go:82] duration metric: took 399.402073ms for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.040509  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.236494  862106 request.go:632] Waited for 195.898227ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:10:49.236563  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:10:49.236569  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.236576  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.236582  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.240432  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.436461  862106 request.go:632] Waited for 195.41836ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:49.436542  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:49.436548  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.436559  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.436569  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.439763  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.440330  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:49.440355  862106 pod_ready.go:82] duration metric: took 399.83902ms for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.440366  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.636358  862106 request.go:632] Waited for 195.885273ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:10:49.636427  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:10:49.636432  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.636439  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.636445  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.640151  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.836836  862106 request.go:632] Waited for 195.784481ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.836912  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.836919  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.836930  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.836937  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.839886  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:49.840468  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:49.840497  862106 pod_ready.go:82] duration metric: took 400.120509ms for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.840513  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.036441  862106 request.go:632] Waited for 195.825099ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:10:50.036536  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:10:50.036543  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.036550  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.036554  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.039699  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:50.236798  862106 request.go:632] Waited for 196.427488ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:50.236874  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:50.236879  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.236886  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.236890  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.240524  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:50.241106  862106 pod_ready.go:93] pod "kube-proxy-6j2hc" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:50.241131  862106 pod_ready.go:82] duration metric: took 400.610867ms for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.241143  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.436406  862106 request.go:632] Waited for 195.161489ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:10:50.436475  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:10:50.436480  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.436488  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.436494  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.440062  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:50.636278  862106 request.go:632] Waited for 195.438862ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:50.636347  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:50.636359  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.636368  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.636372  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.640599  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:50.641201  862106 pod_ready.go:93] pod "kube-proxy-ltx8s" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:50.641279  862106 pod_ready.go:82] duration metric: took 400.120305ms for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.641309  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.836230  862106 request.go:632] Waited for 194.82279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:10:50.836332  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:10:50.836342  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.836351  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.836361  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.840049  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.036964  862106 request.go:632] Waited for 196.236456ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:51.037110  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:51.037125  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.037136  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.037143  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.040383  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.040876  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:51.040898  862106 pod_ready.go:82] duration metric: took 399.581027ms for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:51.040909  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:51.236961  862106 request.go:632] Waited for 195.96375ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:10:51.237040  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:10:51.237045  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.237053  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.237057  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.240573  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.436373  862106 request.go:632] Waited for 195.113921ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:51.436450  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:51.436457  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.436465  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.436470  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.440059  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.440606  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:51.440629  862106 pod_ready.go:82] duration metric: took 399.712643ms for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:51.440645  862106 pod_ready.go:39] duration metric: took 3.200417219s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:10:51.440674  862106 api_server.go:52] waiting for apiserver process to appear ...

	I1028 13:10:51.440749  862106 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1028 13:10:51.458656  862106 api_server.go:72] duration metric: took 21.530345331s to wait for apiserver process to appear ...

	I1028 13:10:51.458688  862106 api_server.go:88] waiting for apiserver healthz status ...

	I1028 13:10:51.458767  862106 api_server.go:253] Checking apiserver healthz at https://192.168.39.179:8443/healthz ...

	I1028 13:10:51.465080  862106 api_server.go:279] https://192.168.39.179:8443/healthz returned 200:

	ok

	I1028 13:10:51.465199  862106 round_trippers.go:463] GET https://192.168.39.179:8443/version

	I1028 13:10:51.465212  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.465224  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.465232  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.466123  862106 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I1028 13:10:51.466239  862106 api_server.go:141] control plane version: v1.31.2

	I1028 13:10:51.466260  862106 api_server.go:131] duration metric: took 7.563996ms to wait for apiserver health ...

	I1028 13:10:51.466271  862106 system_pods.go:43] waiting for kube-system pods to appear ...

	I1028 13:10:51.636522  862106 request.go:632] Waited for 170.157104ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:51.636600  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:51.636608  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.636616  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.636624  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.641692  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:10:51.647540  862106 system_pods.go:59] 17 kube-system pods found

	I1028 13:10:51.647580  862106 system_pods.go:61] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:10:51.647585  862106 system_pods.go:61] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:10:51.647589  862106 system_pods.go:61] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:10:51.647593  862106 system_pods.go:61] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:10:51.647597  862106 system_pods.go:61] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:10:51.647602  862106 system_pods.go:61] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:10:51.647606  862106 system_pods.go:61] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:10:51.647609  862106 system_pods.go:61] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:10:51.647613  862106 system_pods.go:61] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:10:51.647617  862106 system_pods.go:61] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:10:51.647622  862106 system_pods.go:61] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:10:51.647627  862106 system_pods.go:61] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:10:51.647639  862106 system_pods.go:61] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:10:51.647645  862106 system_pods.go:61] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:10:51.647651  862106 system_pods.go:61] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:10:51.647655  862106 system_pods.go:61] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:10:51.647659  862106 system_pods.go:61] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:10:51.647671  862106 system_pods.go:74] duration metric: took 181.3897ms to wait for pod list to return data ...

	I1028 13:10:51.647684  862106 default_sa.go:34] waiting for default service account to be created ...

	I1028 13:10:51.836107  862106 request.go:632] Waited for 188.333802ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:10:51.836172  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:10:51.836180  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.836187  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.836193  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.840155  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.840433  862106 default_sa.go:45] found service account: "default"

	I1028 13:10:51.840458  862106 default_sa.go:55] duration metric: took 192.767866ms for default service account to be created ...

	I1028 13:10:51.840469  862106 system_pods.go:116] waiting for k8s-apps to be running ...

	I1028 13:10:52.036752  862106 request.go:632] Waited for 196.172497ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:52.036827  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:52.036838  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:52.036850  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:52.036924  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:52.042014  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:10:52.046598  862106 system_pods.go:86] 17 kube-system pods found

	I1028 13:10:52.046630  862106 system_pods.go:89] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:10:52.046636  862106 system_pods.go:89] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:10:52.046642  862106 system_pods.go:89] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:10:52.046646  862106 system_pods.go:89] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:10:52.046650  862106 system_pods.go:89] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:10:52.046654  862106 system_pods.go:89] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:10:52.046657  862106 system_pods.go:89] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:10:52.046660  862106 system_pods.go:89] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:10:52.046664  862106 system_pods.go:89] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:10:52.046667  862106 system_pods.go:89] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:10:52.046671  862106 system_pods.go:89] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:10:52.046674  862106 system_pods.go:89] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:10:52.046677  862106 system_pods.go:89] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:10:52.046681  862106 system_pods.go:89] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:10:52.046685  862106 system_pods.go:89] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:10:52.046688  862106 system_pods.go:89] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:10:52.046692  862106 system_pods.go:89] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:10:52.046701  862106 system_pods.go:126] duration metric: took 206.226504ms to wait for k8s-apps to be running ...

	I1028 13:10:52.046709  862106 system_svc.go:44] waiting for kubelet service to be running ....

	I1028 13:10:52.046756  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:10:52.071897  862106 system_svc.go:56] duration metric: took 25.171756ms WaitForService to wait for kubelet

	I1028 13:10:52.071945  862106 kubeadm.go:582] duration metric: took 22.143638967s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1028 13:10:52.071968  862106 node_conditions.go:102] verifying NodePressure condition ...

	I1028 13:10:52.236746  862106 request.go:632] Waited for 164.663134ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes

	I1028 13:10:52.236818  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes

	I1028 13:10:52.236826  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:52.236837  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:52.236847  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:52.240724  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:52.241486  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:10:52.241519  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:10:52.241533  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:10:52.241537  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:10:52.241541  862106 node_conditions.go:105] duration metric: took 169.568698ms to run NodePressure ...

	I1028 13:10:52.241553  862106 start.go:241] waiting for startup goroutines ...

	I1028 13:10:52.241578  862106 start.go:255] writing updated cluster config ...

	I1028 13:10:52.243670  862106 out.go:201] 

	I1028 13:10:52.245543  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:52.245644  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:10:52.247513  862106 out.go:177] * Starting "ha-798963-m03" control-plane node in "ha-798963" cluster

	I1028 13:10:52.248800  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:10:52.248835  862106 cache.go:56] Caching tarball of preloaded images

	I1028 13:10:52.248948  862106 preload.go:172] Found /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I1028 13:10:52.248960  862106 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on crio

	I1028 13:10:52.249078  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:10:52.249266  862106 start.go:360] acquireMachinesLock for ha-798963-m03: {Name:mk3d8412df30fd3411bfb6262eb0fa70b21bf365 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1028 13:10:52.249316  862106 start.go:364] duration metric: took 29.288µs to acquireMachinesLock for "ha-798963-m03"

	I1028 13:10:52.249334  862106 start.go:93] Provisioning new machine with config: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:fals

e ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bi

naryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:10:52.249429  862106 start.go:125] createHost starting for "m03" (driver="kvm2")

	I1028 13:10:52.251158  862106 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1028 13:10:52.251272  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:52.251314  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:52.267194  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40931

	I1028 13:10:52.267798  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:52.268419  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:52.268437  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:52.268806  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:52.269040  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:10:52.269224  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:10:52.269441  862106 start.go:159] libmachine.API.Create for "ha-798963" (driver="kvm2")

	I1028 13:10:52.269479  862106 client.go:168] LocalClient.Create starting

	I1028 13:10:52.269510  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem

	I1028 13:10:52.269546  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:10:52.269562  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:10:52.269625  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem

	I1028 13:10:52.269647  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:10:52.269658  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:10:52.269675  862106 main.go:141] libmachine: Running pre-create checks...

	I1028 13:10:52.269687  862106 main.go:141] libmachine: (ha-798963-m03) Calling .PreCreateCheck

	I1028 13:10:52.269862  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetConfigRaw

	I1028 13:10:52.270441  862106 main.go:141] libmachine: Creating machine...

	I1028 13:10:52.270460  862106 main.go:141] libmachine: (ha-798963-m03) Calling .Create

	I1028 13:10:52.270616  862106 main.go:141] libmachine: (ha-798963-m03) Creating KVM machine...

	I1028 13:10:52.272033  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found existing default KVM network

	I1028 13:10:52.272242  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found existing private KVM network mk-ha-798963

	I1028 13:10:52.272372  862106 main.go:141] libmachine: (ha-798963-m03) Setting up store path in /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03 ...

	I1028 13:10:52.272420  862106 main.go:141] libmachine: (ha-798963-m03) Building disk image from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso

	I1028 13:10:52.272474  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.272358  862861 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:10:52.272557  862106 main.go:141] libmachine: (ha-798963-m03) Downloading /home/jenkins/minikube-integration/19865-839778/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...

	I1028 13:10:52.562450  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.562285  862861 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa...

	I1028 13:10:52.747848  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.747684  862861 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/ha-798963-m03.rawdisk...

	I1028 13:10:52.747877  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Writing magic tar header

	I1028 13:10:52.747899  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Writing SSH key tar header

	I1028 13:10:52.747907  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.747857  862861 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03 ...

	I1028 13:10:52.748057  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03

	I1028 13:10:52.748094  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines

	I1028 13:10:52.748103  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03 (perms=drwx------)

	I1028 13:10:52.748114  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines (perms=drwxr-xr-x)

	I1028 13:10:52.748122  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube (perms=drwxr-xr-x)

	I1028 13:10:52.748129  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778 (perms=drwxrwxr-x)

	I1028 13:10:52.748140  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I1028 13:10:52.748151  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I1028 13:10:52.748159  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:10:52.748164  862106 main.go:141] libmachine: (ha-798963-m03) Creating domain...

	I1028 13:10:52.748206  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778

	I1028 13:10:52.748229  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I1028 13:10:52.748241  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins

	I1028 13:10:52.748258  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home

	I1028 13:10:52.748274  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Skipping /home - not owner

	I1028 13:10:52.749407  862106 main.go:141] libmachine: (ha-798963-m03) define libvirt domain using xml: 

	I1028 13:10:52.749440  862106 main.go:141] libmachine: (ha-798963-m03) <domain type='kvm'>

	I1028 13:10:52.749452  862106 main.go:141] libmachine: (ha-798963-m03)   <name>ha-798963-m03</name>

	I1028 13:10:52.749464  862106 main.go:141] libmachine: (ha-798963-m03)   <memory unit='MiB'>2200</memory>

	I1028 13:10:52.749472  862106 main.go:141] libmachine: (ha-798963-m03)   <vcpu>2</vcpu>

	I1028 13:10:52.749476  862106 main.go:141] libmachine: (ha-798963-m03)   <features>

	I1028 13:10:52.749481  862106 main.go:141] libmachine: (ha-798963-m03)     <acpi/>

	I1028 13:10:52.749486  862106 main.go:141] libmachine: (ha-798963-m03)     <apic/>

	I1028 13:10:52.749490  862106 main.go:141] libmachine: (ha-798963-m03)     <pae/>

	I1028 13:10:52.749494  862106 main.go:141] libmachine: (ha-798963-m03)     

	I1028 13:10:52.749499  862106 main.go:141] libmachine: (ha-798963-m03)   </features>

	I1028 13:10:52.749506  862106 main.go:141] libmachine: (ha-798963-m03)   <cpu mode='host-passthrough'>

	I1028 13:10:52.749510  862106 main.go:141] libmachine: (ha-798963-m03)   

	I1028 13:10:52.749517  862106 main.go:141] libmachine: (ha-798963-m03)   </cpu>

	I1028 13:10:52.749521  862106 main.go:141] libmachine: (ha-798963-m03)   <os>

	I1028 13:10:52.749527  862106 main.go:141] libmachine: (ha-798963-m03)     <type>hvm</type>

	I1028 13:10:52.749558  862106 main.go:141] libmachine: (ha-798963-m03)     <boot dev='cdrom'/>

	I1028 13:10:52.749590  862106 main.go:141] libmachine: (ha-798963-m03)     <boot dev='hd'/>

	I1028 13:10:52.749602  862106 main.go:141] libmachine: (ha-798963-m03)     <bootmenu enable='no'/>

	I1028 13:10:52.749613  862106 main.go:141] libmachine: (ha-798963-m03)   </os>

	I1028 13:10:52.749620  862106 main.go:141] libmachine: (ha-798963-m03)   <devices>

	I1028 13:10:52.749630  862106 main.go:141] libmachine: (ha-798963-m03)     <disk type='file' device='cdrom'>

	I1028 13:10:52.749647  862106 main.go:141] libmachine: (ha-798963-m03)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/boot2docker.iso'/>

	I1028 13:10:52.749656  862106 main.go:141] libmachine: (ha-798963-m03)       <target dev='hdc' bus='scsi'/>

	I1028 13:10:52.749687  862106 main.go:141] libmachine: (ha-798963-m03)       <readonly/>

	I1028 13:10:52.749712  862106 main.go:141] libmachine: (ha-798963-m03)     </disk>

	I1028 13:10:52.749728  862106 main.go:141] libmachine: (ha-798963-m03)     <disk type='file' device='disk'>

	I1028 13:10:52.749742  862106 main.go:141] libmachine: (ha-798963-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I1028 13:10:52.749760  862106 main.go:141] libmachine: (ha-798963-m03)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/ha-798963-m03.rawdisk'/>

	I1028 13:10:52.749770  862106 main.go:141] libmachine: (ha-798963-m03)       <target dev='hda' bus='virtio'/>

	I1028 13:10:52.749781  862106 main.go:141] libmachine: (ha-798963-m03)     </disk>

	I1028 13:10:52.749796  862106 main.go:141] libmachine: (ha-798963-m03)     <interface type='network'>

	I1028 13:10:52.749809  862106 main.go:141] libmachine: (ha-798963-m03)       <source network='mk-ha-798963'/>

	I1028 13:10:52.749817  862106 main.go:141] libmachine: (ha-798963-m03)       <model type='virtio'/>

	I1028 13:10:52.749829  862106 main.go:141] libmachine: (ha-798963-m03)     </interface>

	I1028 13:10:52.749840  862106 main.go:141] libmachine: (ha-798963-m03)     <interface type='network'>

	I1028 13:10:52.749851  862106 main.go:141] libmachine: (ha-798963-m03)       <source network='default'/>

	I1028 13:10:52.749861  862106 main.go:141] libmachine: (ha-798963-m03)       <model type='virtio'/>

	I1028 13:10:52.749872  862106 main.go:141] libmachine: (ha-798963-m03)     </interface>

	I1028 13:10:52.749882  862106 main.go:141] libmachine: (ha-798963-m03)     <serial type='pty'>

	I1028 13:10:52.749894  862106 main.go:141] libmachine: (ha-798963-m03)       <target port='0'/>

	I1028 13:10:52.749899  862106 main.go:141] libmachine: (ha-798963-m03)     </serial>

	I1028 13:10:52.749909  862106 main.go:141] libmachine: (ha-798963-m03)     <console type='pty'>

	I1028 13:10:52.749919  862106 main.go:141] libmachine: (ha-798963-m03)       <target type='serial' port='0'/>

	I1028 13:10:52.749931  862106 main.go:141] libmachine: (ha-798963-m03)     </console>

	I1028 13:10:52.749955  862106 main.go:141] libmachine: (ha-798963-m03)     <rng model='virtio'>

	I1028 13:10:52.749978  862106 main.go:141] libmachine: (ha-798963-m03)       <backend model='random'>/dev/random</backend>

	I1028 13:10:52.749987  862106 main.go:141] libmachine: (ha-798963-m03)     </rng>

	I1028 13:10:52.750004  862106 main.go:141] libmachine: (ha-798963-m03)     

	I1028 13:10:52.750019  862106 main.go:141] libmachine: (ha-798963-m03)     

	I1028 13:10:52.750031  862106 main.go:141] libmachine: (ha-798963-m03)   </devices>

	I1028 13:10:52.750040  862106 main.go:141] libmachine: (ha-798963-m03) </domain>

	I1028 13:10:52.750052  862106 main.go:141] libmachine: (ha-798963-m03) 

	I1028 13:10:52.757851  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:34:c0:77 in network default

	I1028 13:10:52.758497  862106 main.go:141] libmachine: (ha-798963-m03) Ensuring networks are active...

	I1028 13:10:52.758521  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:52.759215  862106 main.go:141] libmachine: (ha-798963-m03) Ensuring network default is active

	I1028 13:10:52.759526  862106 main.go:141] libmachine: (ha-798963-m03) Ensuring network mk-ha-798963 is active

	I1028 13:10:52.759835  862106 main.go:141] libmachine: (ha-798963-m03) Getting domain xml...

	I1028 13:10:52.760484  862106 main.go:141] libmachine: (ha-798963-m03) Creating domain...

	I1028 13:10:54.026756  862106 main.go:141] libmachine: (ha-798963-m03) Waiting to get IP...

	I1028 13:10:54.027506  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.027879  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.027923  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.027860  862861 retry.go:31] will retry after 251.74389ms: waiting for machine to come up

	I1028 13:10:54.281317  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.281757  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.281782  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.281727  862861 retry.go:31] will retry after 286.730458ms: waiting for machine to come up

	I1028 13:10:54.570404  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.570919  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.570950  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.570874  862861 retry.go:31] will retry after 393.328815ms: waiting for machine to come up

	I1028 13:10:54.965448  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.965919  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.965945  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.965874  862861 retry.go:31] will retry after 444.271511ms: waiting for machine to come up

	I1028 13:10:55.411623  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:55.412130  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:55.412161  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:55.412083  862861 retry.go:31] will retry after 699.973986ms: waiting for machine to come up

	I1028 13:10:56.114153  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:56.114727  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:56.114764  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:56.114672  862861 retry.go:31] will retry after 910.164635ms: waiting for machine to come up

	I1028 13:10:57.026041  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:57.026518  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:57.026548  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:57.026451  862861 retry.go:31] will retry after 1.075861946s: waiting for machine to come up

	I1028 13:10:58.103813  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:58.104358  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:58.104390  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:58.104296  862861 retry.go:31] will retry after 905.931409ms: waiting for machine to come up

	I1028 13:10:59.011395  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:59.011899  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:59.011923  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:59.011847  862861 retry.go:31] will retry after 1.277966088s: waiting for machine to come up

	I1028 13:11:00.291648  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:00.292106  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:00.292137  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:00.292061  862861 retry.go:31] will retry after 2.301762361s: waiting for machine to come up

	I1028 13:11:02.595250  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:02.595761  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:02.595793  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:02.595696  862861 retry.go:31] will retry after 2.324303503s: waiting for machine to come up

	I1028 13:11:04.922086  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:04.922525  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:04.922556  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:04.922471  862861 retry.go:31] will retry after 2.258709482s: waiting for machine to come up

	I1028 13:11:07.184047  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:07.184668  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:07.184700  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:07.184613  862861 retry.go:31] will retry after 3.777938273s: waiting for machine to come up

	I1028 13:11:10.964926  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:10.965437  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:10.965466  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:10.965385  862861 retry.go:31] will retry after 4.082429463s: waiting for machine to come up

	I1028 13:11:15.051490  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:15.052093  862106 main.go:141] libmachine: (ha-798963-m03) Found IP for machine: 192.168.39.22

	I1028 13:11:15.052129  862106 main.go:141] libmachine: (ha-798963-m03) Reserving static IP address...

	I1028 13:11:15.052144  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has current primary IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:15.052521  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find host DHCP lease matching {name: "ha-798963-m03", mac: "52:54:00:52:4f:47", ip: "192.168.39.22"} in network mk-ha-798963

	I1028 13:11:15.138332  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Getting to WaitForSSH function...

	I1028 13:11:15.138380  862106 main.go:141] libmachine: (ha-798963-m03) Reserved static IP address: 192.168.39.22

	I1028 13:11:15.138398  862106 main.go:141] libmachine: (ha-798963-m03) Waiting for SSH to be available...

	I1028 13:11:15.140946  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:15.141322  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963

	I1028 13:11:15.141356  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find defined IP address of network mk-ha-798963 interface with MAC address 52:54:00:52:4f:47

	I1028 13:11:15.141531  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH client type: external

	I1028 13:11:15.141564  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa (-rw-------)

	I1028 13:11:15.141623  862106 main.go:141] libmachine: (ha-798963-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:11:15.141659  862106 main.go:141] libmachine: (ha-798963-m03) DBG | About to run SSH command:

	I1028 13:11:15.141677  862106 main.go:141] libmachine: (ha-798963-m03) DBG | exit 0

	I1028 13:11:15.146235  862106 main.go:141] libmachine: (ha-798963-m03) DBG | SSH cmd err, output: exit status 255: 

	I1028 13:11:15.146272  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I1028 13:11:15.146283  862106 main.go:141] libmachine: (ha-798963-m03) DBG | command : exit 0

	I1028 13:11:15.146290  862106 main.go:141] libmachine: (ha-798963-m03) DBG | err     : exit status 255

	I1028 13:11:15.146302  862106 main.go:141] libmachine: (ha-798963-m03) DBG | output  : 

	I1028 13:11:18.146941  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Getting to WaitForSSH function...

	I1028 13:11:18.149944  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.150561  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.150599  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.150760  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH client type: external

	I1028 13:11:18.150785  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa (-rw-------)

	I1028 13:11:18.150804  862106 main.go:141] libmachine: (ha-798963-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.22 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:11:18.150821  862106 main.go:141] libmachine: (ha-798963-m03) DBG | About to run SSH command:

	I1028 13:11:18.150834  862106 main.go:141] libmachine: (ha-798963-m03) DBG | exit 0

	I1028 13:11:18.279852  862106 main.go:141] libmachine: (ha-798963-m03) DBG | SSH cmd err, output: <nil>: 

	I1028 13:11:18.280117  862106 main.go:141] libmachine: (ha-798963-m03) KVM machine creation complete!

	I1028 13:11:18.280471  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetConfigRaw

	I1028 13:11:18.281057  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:18.281286  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:18.281511  862106 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I1028 13:11:18.281528  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetState

	I1028 13:11:18.282967  862106 main.go:141] libmachine: Detecting operating system of created instance...

	I1028 13:11:18.282981  862106 main.go:141] libmachine: Waiting for SSH to be available...

	I1028 13:11:18.282987  862106 main.go:141] libmachine: Getting to WaitForSSH function...

	I1028 13:11:18.282993  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.285444  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.285855  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.285886  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.286065  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.286265  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.286456  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.286646  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.286860  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.287156  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.287177  862106 main.go:141] libmachine: About to run SSH command:

	exit 0

	I1028 13:11:18.391371  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:11:18.391403  862106 main.go:141] libmachine: Detecting the provisioner...

	I1028 13:11:18.391414  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.394495  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.394905  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.394928  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.395120  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.395350  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.395533  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.395690  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.395859  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.396080  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.396095  862106 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I1028 13:11:18.496700  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I1028 13:11:18.496787  862106 main.go:141] libmachine: found compatible host: buildroot

	I1028 13:11:18.496806  862106 main.go:141] libmachine: Provisioning with buildroot...

	I1028 13:11:18.496822  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:11:18.497107  862106 buildroot.go:166] provisioning hostname "ha-798963-m03"

	I1028 13:11:18.497145  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:11:18.497347  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.500364  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.500925  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.500975  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.501046  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.501354  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.501545  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.501739  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.501915  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.502138  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.502157  862106 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-798963-m03 && echo "ha-798963-m03" | sudo tee /etc/hostname

	I1028 13:11:18.618604  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-798963-m03

	I1028 13:11:18.618639  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.622283  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.622616  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.622651  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.622826  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.623108  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.623364  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.623516  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.623720  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.623962  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.623980  862106 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-798963-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-798963-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-798963-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1028 13:11:18.736595  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:11:18.736636  862106 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19865-839778/.minikube CaCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19865-839778/.minikube}

	I1028 13:11:18.736665  862106 buildroot.go:174] setting up certificates

	I1028 13:11:18.736682  862106 provision.go:84] configureAuth start

	I1028 13:11:18.736701  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:11:18.737021  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:18.739891  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.740410  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.740437  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.740694  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.743175  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.743592  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.743626  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.743788  862106 provision.go:143] copyHostCerts

	I1028 13:11:18.743835  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:11:18.743879  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem, removing ...

	I1028 13:11:18.743892  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:11:18.743974  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem (1679 bytes)

	I1028 13:11:18.744142  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:11:18.744179  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem, removing ...

	I1028 13:11:18.744189  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:11:18.744232  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem (1082 bytes)

	I1028 13:11:18.744301  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:11:18.744324  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem, removing ...

	I1028 13:11:18.744330  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:11:18.744365  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem (1123 bytes)

	I1028 13:11:18.744439  862106 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem org=jenkins.ha-798963-m03 san=[127.0.0.1 192.168.39.22 ha-798963-m03 localhost minikube]

	I1028 13:11:18.909358  862106 provision.go:177] copyRemoteCerts

	I1028 13:11:18.909440  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1028 13:11:18.909478  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.912521  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.912938  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.912962  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.913158  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.913396  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.913596  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.913794  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:18.993960  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1028 13:11:18.994055  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1028 13:11:19.018594  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1028 13:11:19.018694  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I1028 13:11:19.042856  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1028 13:11:19.042932  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1028 13:11:19.066474  862106 provision.go:87] duration metric: took 329.775862ms to configureAuth

	I1028 13:11:19.066506  862106 buildroot.go:189] setting minikube options for container-runtime

	I1028 13:11:19.066762  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:11:19.066849  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.069625  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.070069  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.070106  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.070305  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.070451  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.070568  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.070780  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.070970  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:19.071152  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:19.071164  862106 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1028 13:11:19.283468  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1028 13:11:19.283504  862106 main.go:141] libmachine: Checking connection to Docker...

	I1028 13:11:19.283516  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetURL

	I1028 13:11:19.285019  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using libvirt version 6000000

	I1028 13:11:19.287847  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.288291  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.288316  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.288536  862106 main.go:141] libmachine: Docker is up and running!

	I1028 13:11:19.288557  862106 main.go:141] libmachine: Reticulating splines...

	I1028 13:11:19.288565  862106 client.go:171] duration metric: took 27.019078458s to LocalClient.Create

	I1028 13:11:19.288592  862106 start.go:167] duration metric: took 27.019149151s to libmachine.API.Create "ha-798963"

	I1028 13:11:19.288603  862106 start.go:293] postStartSetup for "ha-798963-m03" (driver="kvm2")

	I1028 13:11:19.288620  862106 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1028 13:11:19.288645  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.288916  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1028 13:11:19.288941  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.291428  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.291857  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.291885  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.292060  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.292291  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.292494  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.292716  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:19.374186  862106 ssh_runner.go:195] Run: cat /etc/os-release

	I1028 13:11:19.378492  862106 info.go:137] Remote host: Buildroot 2023.02.9

	I1028 13:11:19.378525  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/addons for local assets ...

	I1028 13:11:19.378610  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/files for local assets ...

	I1028 13:11:19.378699  862106 filesync.go:149] local asset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> 8470622.pem in /etc/ssl/certs

	I1028 13:11:19.378712  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /etc/ssl/certs/8470622.pem

	I1028 13:11:19.378830  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1028 13:11:19.388301  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:11:19.413764  862106 start.go:296] duration metric: took 125.140976ms for postStartSetup

	I1028 13:11:19.413887  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetConfigRaw

	I1028 13:11:19.414725  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:19.418161  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.418560  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.418602  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.418881  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:11:19.419150  862106 start.go:128] duration metric: took 27.169708813s to createHost

	I1028 13:11:19.419181  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.421528  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.421965  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.421985  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.422228  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.422481  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.422676  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.422832  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.423121  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:19.423299  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:19.423313  862106 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1028 13:11:19.529229  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730121079.510567012

	I1028 13:11:19.529256  862106 fix.go:216] guest clock: 1730121079.510567012

	I1028 13:11:19.529266  862106 fix.go:229] Guest: 2024-10-28 13:11:19.510567012 +0000 UTC Remote: 2024-10-28 13:11:19.419167527 +0000 UTC m=+144.065220729 (delta=91.399485ms)

	I1028 13:11:19.529289  862106 fix.go:200] guest clock delta is within tolerance: 91.399485ms

	I1028 13:11:19.529296  862106 start.go:83] releasing machines lock for "ha-798963-m03", held for 27.279971067s

	I1028 13:11:19.529329  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.529651  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:19.532764  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.533288  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.533321  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.535838  862106 out.go:177] * Found network options:

	I1028 13:11:19.537321  862106 out.go:177]   - NO_PROXY=192.168.39.179,192.168.39.109

	W1028 13:11:19.538621  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	W1028 13:11:19.538655  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:11:19.538674  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.539474  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.539726  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.539884  862106 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	W1028 13:11:19.539911  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	W1028 13:11:19.539944  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:11:19.539945  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.540024  862106 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1028 13:11:19.540084  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.543057  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543410  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543539  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.543564  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543728  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.543925  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.543958  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543932  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.544110  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.544219  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.544280  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.544388  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:19.544472  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.544589  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:19.780751  862106 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1028 13:11:19.786410  862106 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1028 13:11:19.786480  862106 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1028 13:11:19.802824  862106 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1028 13:11:19.802861  862106 start.go:495] detecting cgroup driver to use...

	I1028 13:11:19.802953  862106 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1028 13:11:19.819572  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1028 13:11:19.836108  862106 docker.go:217] disabling cri-docker service (if available) ...

	I1028 13:11:19.836178  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1028 13:11:19.851457  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1028 13:11:19.866180  862106 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1028 13:11:19.993253  862106 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1028 13:11:20.152966  862106 docker.go:233] disabling docker service ...

	I1028 13:11:20.153060  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1028 13:11:20.169495  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1028 13:11:20.182995  862106 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1028 13:11:20.305890  862106 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1028 13:11:20.430530  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1028 13:11:20.448916  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1028 13:11:20.473323  862106 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I1028 13:11:20.473396  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.484460  862106 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1028 13:11:20.484547  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.496258  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.506903  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.517726  862106 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1028 13:11:20.529586  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.540909  862106 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.560337  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.571648  862106 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1028 13:11:20.581868  862106 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1028 13:11:20.581953  862106 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1028 13:11:20.595991  862106 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1028 13:11:20.606337  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:11:20.730480  862106 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1028 13:11:20.819859  862106 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I1028 13:11:20.819946  862106 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1028 13:11:20.824510  862106 start.go:563] Will wait 60s for crictl version

	I1028 13:11:20.824579  862106 ssh_runner.go:195] Run: which crictl

	I1028 13:11:20.828553  862106 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1028 13:11:20.871251  862106 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I1028 13:11:20.871346  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:11:20.901368  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:11:20.932662  862106 out.go:177] * Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	I1028 13:11:20.934192  862106 out.go:177]   - env NO_PROXY=192.168.39.179

	I1028 13:11:20.935534  862106 out.go:177]   - env NO_PROXY=192.168.39.179,192.168.39.109

	I1028 13:11:20.936788  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:20.939358  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:20.939712  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:20.939743  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:20.939974  862106 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I1028 13:11:20.944160  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:11:20.957935  862106 mustload.go:65] Loading cluster: ha-798963

	I1028 13:11:20.958201  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:11:20.958461  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:11:20.958503  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:11:20.975786  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42129

	I1028 13:11:20.976418  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:11:20.977043  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:11:20.977065  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:11:20.977437  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:11:20.977694  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:11:20.979673  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:11:20.980165  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:11:20.980220  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:11:20.997701  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46143

	I1028 13:11:20.998153  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:11:20.998679  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:11:20.998710  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:11:20.999089  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:11:20.999277  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:11:20.999477  862106 certs.go:68] Setting up /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963 for IP: 192.168.39.22

	I1028 13:11:20.999491  862106 certs.go:194] generating shared ca certs ...

	I1028 13:11:20.999512  862106 certs.go:226] acquiring lock for ca certs: {Name:mk72dd610cd229d2e25ba7be15f7e5f7b195435a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:11:20.999675  862106 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key

	I1028 13:11:20.999736  862106 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key

	I1028 13:11:20.999771  862106 certs.go:256] generating profile certs ...

	I1028 13:11:20.999872  862106 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key

	I1028 13:11:20.999907  862106 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53

	I1028 13:11:20.999930  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.179 192.168.39.109 192.168.39.22 192.168.39.254]

	I1028 13:11:21.169463  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53 ...

	I1028 13:11:21.169502  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53: {Name:mkfb39be0a4b7218928840044aac9fa4623d2f25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:11:21.169697  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53 ...

	I1028 13:11:21.169714  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53: {Name:mka51f3d4a17f0305a22426a8af18a5cc4ed6c4c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:11:21.169814  862106 certs.go:381] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt

	I1028 13:11:21.169983  862106 certs.go:385] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key

	I1028 13:11:21.170160  862106 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key

	I1028 13:11:21.170180  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1028 13:11:21.170199  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1028 13:11:21.170216  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1028 13:11:21.170243  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1028 13:11:21.170267  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1028 13:11:21.170286  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1028 13:11:21.170304  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1028 13:11:21.183925  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1028 13:11:21.184041  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem (1338 bytes)

	W1028 13:11:21.184085  862106 certs.go:480] ignoring /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062_empty.pem, impossibly tiny 0 bytes

	I1028 13:11:21.184097  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem (1679 bytes)

	I1028 13:11:21.184125  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem (1082 bytes)

	I1028 13:11:21.184159  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem (1123 bytes)

	I1028 13:11:21.184185  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem (1679 bytes)

	I1028 13:11:21.184228  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:11:21.184271  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.184289  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.184305  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem -> /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.184350  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:11:21.187693  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:21.188343  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:11:21.188383  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:21.188590  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:11:21.188853  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:11:21.189079  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:11:21.189273  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:11:21.268341  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I1028 13:11:21.273886  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I1028 13:11:21.289278  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I1028 13:11:21.294832  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I1028 13:11:21.306787  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I1028 13:11:21.311198  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I1028 13:11:21.323910  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I1028 13:11:21.329122  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I1028 13:11:21.341443  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I1028 13:11:21.345899  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I1028 13:11:21.357191  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I1028 13:11:21.361390  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I1028 13:11:21.372614  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1028 13:11:21.398374  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1028 13:11:21.422379  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1028 13:11:21.447790  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1028 13:11:21.472891  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I1028 13:11:21.497530  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1028 13:11:21.522231  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1028 13:11:21.546660  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1028 13:11:21.571603  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /usr/share/ca-certificates/8470622.pem (1708 bytes)

	I1028 13:11:21.596900  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1028 13:11:21.621985  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem --> /usr/share/ca-certificates/847062.pem (1338 bytes)

	I1028 13:11:21.647893  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I1028 13:11:21.665557  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I1028 13:11:21.682787  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I1028 13:11:21.699768  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I1028 13:11:21.716300  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I1028 13:11:21.733754  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I1028 13:11:21.750232  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I1028 13:11:21.767138  862106 ssh_runner.go:195] Run: openssl version

	I1028 13:11:21.772855  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/847062.pem && ln -fs /usr/share/ca-certificates/847062.pem /etc/ssl/certs/847062.pem"

	I1028 13:11:21.783895  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.788920  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 13:01 /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.789013  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.795538  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/847062.pem /etc/ssl/certs/51391683.0"

	I1028 13:11:21.806866  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8470622.pem && ln -fs /usr/share/ca-certificates/8470622.pem /etc/ssl/certs/8470622.pem"

	I1028 13:11:21.818968  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.823589  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 13:01 /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.823673  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.829690  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8470622.pem /etc/ssl/certs/3ec20f2e.0"

	I1028 13:11:21.840568  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1028 13:11:21.851939  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.857586  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:21 /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.857660  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.863890  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1028 13:11:21.875293  862106 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1028 13:11:21.879705  862106 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1028 13:11:21.879811  862106 kubeadm.go:934] updating node {m03 192.168.39.22 8443 v1.31.2 crio true true} ...

	I1028 13:11:21.879924  862106 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-798963-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.22

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1028 13:11:21.879964  862106 kube-vip.go:115] generating kube-vip config ...

	I1028 13:11:21.880015  862106 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I1028 13:11:21.899027  862106 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I1028 13:11:21.899121  862106 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.4

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I1028 13:11:21.899189  862106 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1028 13:11:21.909174  862106 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.2': No such file or directory

	Initiating transfer...

	I1028 13:11:21.909251  862106 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.2

	I1028 13:11:21.919595  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet.sha256

	I1028 13:11:21.919595  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm.sha256

	I1028 13:11:21.919661  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:11:21.919666  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm -> /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:11:21.919734  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:11:21.919596  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl.sha256

	I1028 13:11:21.919769  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl -> /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:11:21.919829  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:11:21.929846  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubectl': No such file or directory

	I1028 13:11:21.929900  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl --> /var/lib/minikube/binaries/v1.31.2/kubectl (56381592 bytes)

	I1028 13:11:21.929907  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubeadm': No such file or directory

	I1028 13:11:21.929940  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm --> /var/lib/minikube/binaries/v1.31.2/kubeadm (58290328 bytes)

	I1028 13:11:21.967513  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet -> /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:11:21.967622  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:11:22.100910  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubelet': No such file or directory

	I1028 13:11:22.100971  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet --> /var/lib/minikube/binaries/v1.31.2/kubelet (76902744 bytes)

	I1028 13:11:22.865953  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I1028 13:11:22.877219  862106 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I1028 13:11:22.895542  862106 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1028 13:11:22.913654  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I1028 13:11:22.931775  862106 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I1028 13:11:22.935865  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:11:22.948405  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:11:23.077983  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:11:23.095707  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:11:23.096270  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:11:23.096349  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:11:23.112694  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39623

	I1028 13:11:23.113318  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:11:23.113918  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:11:23.113943  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:11:23.114443  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:11:23.114718  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:11:23.114884  862106 start.go:317] joinCluster: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Cluster

Name:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.22 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-d

ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 13:11:23.115032  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I1028 13:11:23.115052  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:11:23.117980  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:23.118457  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:11:23.118489  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:23.118682  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:11:23.118883  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:11:23.119045  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:11:23.119242  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:11:23.278294  862106 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.22 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:11:23.278359  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 7bw2w9.tm44hy401jutwnn7 --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m03 --control-plane --apiserver-advertise-address=192.168.39.22 --apiserver-bind-port=8443"

	I1028 13:11:46.129202  862106 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 7bw2w9.tm44hy401jutwnn7 --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m03 --control-plane --apiserver-advertise-address=192.168.39.22 --apiserver-bind-port=8443": (22.8507898s)

	I1028 13:11:46.129241  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I1028 13:11:46.714736  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-798963-m03 minikube.k8s.io/updated_at=2024_10_28T13_11_46_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=ha-798963 minikube.k8s.io/primary=false

	I1028 13:11:46.854280  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-798963-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I1028 13:11:46.968024  862106 start.go:319] duration metric: took 23.853147601s to joinCluster

	I1028 13:11:46.968195  862106 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.22 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:11:46.968614  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:11:46.971219  862106 out.go:177] * Verifying Kubernetes components...

	I1028 13:11:46.972990  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:11:47.231231  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:11:47.310133  862106 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:11:47.310473  862106 kapi.go:59] client config for ha-798963: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt", KeyFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key", CAFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2439ec0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W1028 13:11:47.310988  862106 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.179:8443

	I1028 13:11:47.312238  862106 node_ready.go:35] waiting up to 6m0s for node "ha-798963-m03" to be "Ready" ...

	I1028 13:11:47.312381  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:47.312393  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:47.312404  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:47.312410  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:47.316954  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:47.812518  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:47.812547  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:47.812555  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:47.812559  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:47.816919  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:48.313316  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:48.313342  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:48.313351  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:48.313356  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:48.317261  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:48.813088  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:48.813119  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:48.813132  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:48.813139  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:48.816489  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:49.312690  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:49.312718  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:49.312728  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:49.312732  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:49.316198  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:49.316807  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:49.813117  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:49.813150  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:49.813164  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:49.813170  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:49.817118  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:50.313080  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:50.313119  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:50.313130  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:50.313136  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:50.318258  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:11:50.812971  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:50.812996  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:50.813004  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:50.813008  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:50.817641  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:51.312873  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:51.312900  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:51.312909  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:51.312915  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:51.317497  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:51.318095  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:51.813121  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:51.813160  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:51.813173  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:51.813178  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:51.816880  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:52.313447  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:52.313478  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:52.313493  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:52.313501  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:52.317360  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:52.813107  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:52.813143  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:52.813156  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:52.813161  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:52.817062  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:53.313338  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:53.313369  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:53.313383  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:53.313389  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:53.317314  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:53.813338  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:53.813363  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:53.813372  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:53.813375  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:53.817321  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:53.817898  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:54.313122  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:54.313145  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:54.313153  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:54.313158  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:54.317346  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:54.812531  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:54.812557  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:54.812566  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:54.812572  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:54.816528  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:55.313312  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:55.313333  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:55.313341  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:55.313344  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:55.318403  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:11:55.813095  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:55.813124  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:55.813135  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:55.813140  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:55.817082  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:56.313040  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:56.313066  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:56.313075  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:56.313078  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:56.316501  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:56.316942  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:56.813092  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:56.813118  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:56.813127  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:56.813131  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:56.817321  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:57.313363  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:57.313388  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:57.313399  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:57.313405  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:57.317277  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:57.812796  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:57.812822  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:57.812830  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:57.812834  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:57.816289  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:58.312654  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:58.312680  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:58.312691  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:58.312695  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:58.317251  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:58.317795  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:58.813076  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:58.813108  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:58.813118  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:58.813122  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:58.816604  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:59.313052  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:59.313080  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:59.313091  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:59.313118  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:59.316562  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:59.812477  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:59.812503  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:59.812511  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:59.812514  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:59.816200  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:00.313237  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:00.313282  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:00.313294  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:00.313300  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:00.316714  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:00.813335  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:00.813365  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:00.813375  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:00.813389  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:00.817154  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:00.817976  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:12:01.312651  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:01.312674  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:01.312686  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:01.312690  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:01.316888  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:01.812732  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:01.812759  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:01.812772  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:01.812778  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:01.816876  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:02.313031  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:02.313067  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:02.313080  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:02.313089  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:02.316362  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:02.813263  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:02.813287  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:02.813297  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:02.813303  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:02.817262  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:03.312875  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:03.312901  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:03.312909  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:03.312914  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:03.316584  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:03.317194  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:12:03.812576  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:03.812610  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:03.812619  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:03.812625  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:03.815796  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:04.312708  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:04.312733  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:04.312742  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:04.312746  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:04.316530  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:04.813485  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:04.813513  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:04.813521  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:04.813525  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:04.817777  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:05.313514  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:05.313540  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:05.313551  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:05.313556  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:05.317623  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:05.318128  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:12:05.813495  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:05.813522  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:05.813530  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:05.813534  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:05.817916  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:06.313490  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:06.313516  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.313525  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.313529  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.317617  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:06.318134  862106 node_ready.go:49] node "ha-798963-m03" has status "Ready":"True"

	I1028 13:12:06.318158  862106 node_ready.go:38] duration metric: took 19.005890906s for node "ha-798963-m03" to be "Ready" ...

	I1028 13:12:06.318170  862106 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:12:06.318257  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:06.318270  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.318281  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.318287  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.325329  862106 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I1028 13:12:06.332608  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.332712  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-7x97m

	I1028 13:12:06.332722  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.332730  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.332735  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.336764  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:06.337822  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:06.337850  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.337862  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.337869  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.340953  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.341417  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.341452  862106 pod_ready.go:82] duration metric: took 8.810785ms for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.341466  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.341553  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-bdv2v

	I1028 13:12:06.341563  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.341570  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.341574  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.347268  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:12:06.348205  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:06.348228  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.348239  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.348246  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.351222  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:12:06.352239  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.352264  862106 pod_ready.go:82] duration metric: took 10.789556ms for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.352278  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.352368  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963

	I1028 13:12:06.352379  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.352389  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.352396  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.355719  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.356377  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:06.356397  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.356407  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.356412  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.359573  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.360167  862106 pod_ready.go:93] pod "etcd-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.360189  862106 pod_ready.go:82] duration metric: took 7.903896ms for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.360199  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.360274  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m02

	I1028 13:12:06.360284  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.360292  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.360297  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.363570  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.364099  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:06.364114  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.364122  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.364128  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.366807  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:12:06.367300  862106 pod_ready.go:93] pod "etcd-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.367320  862106 pod_ready.go:82] duration metric: took 7.113533ms for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.367332  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.513665  862106 request.go:632] Waited for 146.244316ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m03

	I1028 13:12:06.513759  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m03

	I1028 13:12:06.513765  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.513772  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.513776  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.517625  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.713582  862106 request.go:632] Waited for 195.302177ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:06.713677  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:06.713683  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.713693  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.713697  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.717372  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.718301  862106 pod_ready.go:93] pod "etcd-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.718323  862106 pod_ready.go:82] duration metric: took 350.983163ms for pod "etcd-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.718339  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.913595  862106 request.go:632] Waited for 195.182715ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:12:06.913692  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:12:06.913701  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.913710  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.913714  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.917368  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:07.114493  862106 request.go:632] Waited for 196.400044ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:07.114623  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:07.114654  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.114669  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.114679  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.118462  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:07.118997  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:07.119020  862106 pod_ready.go:82] duration metric: took 400.673467ms for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.119031  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.314142  862106 request.go:632] Waited for 195.007097ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:12:07.314248  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:12:07.314260  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.314273  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.314282  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.322683  862106 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I1028 13:12:07.513795  862106 request.go:632] Waited for 190.442824ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:07.513881  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:07.513892  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.513905  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.513916  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.518175  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:07.518756  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:07.518784  862106 pod_ready.go:82] duration metric: took 399.744785ms for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.518799  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.713798  862106 request.go:632] Waited for 194.910105ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m03

	I1028 13:12:07.713866  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m03

	I1028 13:12:07.713872  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.713881  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.713886  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.718462  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:07.914092  862106 request.go:632] Waited for 194.338244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:07.914162  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:07.914169  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.914181  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.914192  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.917666  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:07.918344  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:07.918367  862106 pod_ready.go:82] duration metric: took 399.560719ms for pod "kube-apiserver-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.918378  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.114520  862106 request.go:632] Waited for 196.013722ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:12:08.114597  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:12:08.114602  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.114613  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.114619  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.118293  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:08.314398  862106 request.go:632] Waited for 195.403712ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:08.314476  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:08.314487  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.314497  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.314505  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.318433  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:08.318965  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:08.318987  862106 pod_ready.go:82] duration metric: took 400.600208ms for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.319000  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.514210  862106 request.go:632] Waited for 195.114115ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:12:08.514292  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:12:08.514297  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.514305  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.514310  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.518338  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:08.713518  862106 request.go:632] Waited for 194.314657ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:08.713609  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:08.713616  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.713628  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.713664  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.717711  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:08.718259  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:08.718285  862106 pod_ready.go:82] duration metric: took 399.274271ms for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.718299  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.914405  862106 request.go:632] Waited for 195.97635ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m03

	I1028 13:12:08.914485  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m03

	I1028 13:12:08.914492  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.914500  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.914504  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.918184  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.114370  862106 request.go:632] Waited for 195.412683ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.114451  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.114459  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.114470  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.114478  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.118332  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.118868  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:09.118890  862106 pod_ready.go:82] duration metric: took 400.583554ms for pod "kube-controller-manager-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.118901  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.314002  862106 request.go:632] Waited for 195.020962ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:12:09.314075  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:12:09.314082  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.314091  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.314096  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.317294  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.514483  862106 request.go:632] Waited for 196.396761ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:09.514553  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:09.514565  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.514580  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.514585  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.518434  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.519040  862106 pod_ready.go:93] pod "kube-proxy-6j2hc" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:09.519070  862106 pod_ready.go:82] duration metric: took 400.161852ms for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.519085  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-7xs2n" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.714183  862106 request.go:632] Waited for 194.999401ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7xs2n

	I1028 13:12:09.714251  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7xs2n

	I1028 13:12:09.714257  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.714265  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.714271  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.718005  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.913595  862106 request.go:632] Waited for 194.841352ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.913694  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.913703  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.913714  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.913725  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.917053  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.917714  862106 pod_ready.go:93] pod "kube-proxy-7xs2n" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:09.917734  862106 pod_ready.go:82] duration metric: took 398.638102ms for pod "kube-proxy-7xs2n" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.917747  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.114084  862106 request.go:632] Waited for 196.130523ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:12:10.114185  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:12:10.114197  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.114214  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.114226  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.118633  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:10.313732  862106 request.go:632] Waited for 194.304231ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:10.313810  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:10.313816  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.313824  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.313828  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.317722  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:10.318285  862106 pod_ready.go:93] pod "kube-proxy-ltx8s" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:10.318307  862106 pod_ready.go:82] duration metric: took 400.55347ms for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.318317  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.514568  862106 request.go:632] Waited for 196.139269ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:12:10.514648  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:12:10.514659  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.514672  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.514679  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.519045  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:10.714075  862106 request.go:632] Waited for 194.390595ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:10.714146  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:10.714158  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.714170  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.714175  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.717323  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:10.717813  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:10.717835  862106 pod_ready.go:82] duration metric: took 399.512114ms for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.717847  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.913990  862106 request.go:632] Waited for 196.038539ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:12:10.914073  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:12:10.914079  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.914087  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.914099  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.917877  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:11.113506  862106 request.go:632] Waited for 194.978362ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:11.113605  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:11.113617  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.113629  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.113638  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.117559  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:11.118136  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:11.118165  862106 pod_ready.go:82] duration metric: took 400.309713ms for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:11.118183  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:11.314391  862106 request.go:632] Waited for 196.099367ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m03

	I1028 13:12:11.314478  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m03

	I1028 13:12:11.314489  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.314501  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.314513  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.319958  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:12:11.514098  862106 request.go:632] Waited for 193.368848ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:11.514176  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:11.514251  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.514266  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.514270  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.517766  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:11.518431  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:11.518454  862106 pod_ready.go:82] duration metric: took 400.260585ms for pod "kube-scheduler-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:11.518469  862106 pod_ready.go:39] duration metric: took 5.200285512s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:12:11.518493  862106 api_server.go:52] waiting for apiserver process to appear ...

	I1028 13:12:11.518550  862106 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1028 13:12:11.533390  862106 api_server.go:72] duration metric: took 24.565133834s to wait for apiserver process to appear ...

	I1028 13:12:11.533417  862106 api_server.go:88] waiting for apiserver healthz status ...

	I1028 13:12:11.533440  862106 api_server.go:253] Checking apiserver healthz at https://192.168.39.179:8443/healthz ...

	I1028 13:12:11.539587  862106 api_server.go:279] https://192.168.39.179:8443/healthz returned 200:

	ok

	I1028 13:12:11.539676  862106 round_trippers.go:463] GET https://192.168.39.179:8443/version

	I1028 13:12:11.539684  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.539693  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.539697  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.540699  862106 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I1028 13:12:11.540763  862106 api_server.go:141] control plane version: v1.31.2

	I1028 13:12:11.540777  862106 api_server.go:131] duration metric: took 7.353485ms to wait for apiserver health ...

	I1028 13:12:11.540789  862106 system_pods.go:43] waiting for kube-system pods to appear ...

	I1028 13:12:11.714204  862106 request.go:632] Waited for 173.306405ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:11.714267  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:11.714273  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.714281  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.714286  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.720558  862106 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I1028 13:12:11.726967  862106 system_pods.go:59] 24 kube-system pods found

	I1028 13:12:11.727007  862106 system_pods.go:61] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:12:11.727013  862106 system_pods.go:61] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:12:11.727017  862106 system_pods.go:61] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:12:11.727020  862106 system_pods.go:61] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:12:11.727023  862106 system_pods.go:61] "etcd-ha-798963-m03" [1f79ef8e-3ad7-4661-b55d-9ecdfe0c6f93] Running

	I1028 13:12:11.727026  862106 system_pods.go:61] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:12:11.727030  862106 system_pods.go:61] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:12:11.727033  862106 system_pods.go:61] "kindnet-fqc7b" [c0e1b714-47e3-44fd-9e87-692df3f2620c] Running

	I1028 13:12:11.727036  862106 system_pods.go:61] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:12:11.727039  862106 system_pods.go:61] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:12:11.727042  862106 system_pods.go:61] "kube-apiserver-ha-798963-m03" [5ba03b60-173f-4796-9803-2e55f5b72770] Running

	I1028 13:12:11.727045  862106 system_pods.go:61] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:12:11.727048  862106 system_pods.go:61] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:12:11.727050  862106 system_pods.go:61] "kube-controller-manager-ha-798963-m03" [0eb11503-cae9-4981-964a-59dbe1026305] Running

	I1028 13:12:11.727053  862106 system_pods.go:61] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:12:11.727056  862106 system_pods.go:61] "kube-proxy-7xs2n" [84d19e98-573b-4105-8ab9-f10b6a92dd95] Running

	I1028 13:12:11.727058  862106 system_pods.go:61] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:12:11.727061  862106 system_pods.go:61] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:12:11.727069  862106 system_pods.go:61] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:12:11.727072  862106 system_pods.go:61] "kube-scheduler-ha-798963-m03" [62d6b3e8-973e-4bed-a412-faa22e21b9f7] Running

	I1028 13:12:11.727075  862106 system_pods.go:61] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:12:11.727078  862106 system_pods.go:61] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:12:11.727081  862106 system_pods.go:61] "kube-vip-ha-798963-m03" [9796a102-575e-4d85-acf7-817d1f50d1f3] Running

	I1028 13:12:11.727084  862106 system_pods.go:61] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:12:11.727090  862106 system_pods.go:74] duration metric: took 186.291332ms to wait for pod list to return data ...

	I1028 13:12:11.727099  862106 default_sa.go:34] waiting for default service account to be created ...

	I1028 13:12:11.914614  862106 request.go:632] Waited for 187.423359ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:12:11.914693  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:12:11.914701  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.914712  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.914720  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.919465  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:11.919622  862106 default_sa.go:45] found service account: "default"

	I1028 13:12:11.919639  862106 default_sa.go:55] duration metric: took 192.533902ms for default service account to be created ...

	I1028 13:12:11.919649  862106 system_pods.go:116] waiting for k8s-apps to be running ...

	I1028 13:12:12.114135  862106 request.go:632] Waited for 194.365447ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:12.114225  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:12.114233  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:12.114241  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:12.114246  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:12.119917  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:12:12.126683  862106 system_pods.go:86] 24 kube-system pods found

	I1028 13:12:12.126720  862106 system_pods.go:89] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:12:12.126727  862106 system_pods.go:89] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:12:12.126731  862106 system_pods.go:89] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:12:12.126735  862106 system_pods.go:89] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:12:12.126738  862106 system_pods.go:89] "etcd-ha-798963-m03" [1f79ef8e-3ad7-4661-b55d-9ecdfe0c6f93] Running

	I1028 13:12:12.126742  862106 system_pods.go:89] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:12:12.126745  862106 system_pods.go:89] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:12:12.126750  862106 system_pods.go:89] "kindnet-fqc7b" [c0e1b714-47e3-44fd-9e87-692df3f2620c] Running

	I1028 13:12:12.126755  862106 system_pods.go:89] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:12:12.126761  862106 system_pods.go:89] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:12:12.126766  862106 system_pods.go:89] "kube-apiserver-ha-798963-m03" [5ba03b60-173f-4796-9803-2e55f5b72770] Running

	I1028 13:12:12.126773  862106 system_pods.go:89] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:12:12.126779  862106 system_pods.go:89] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:12:12.126784  862106 system_pods.go:89] "kube-controller-manager-ha-798963-m03" [0eb11503-cae9-4981-964a-59dbe1026305] Running

	I1028 13:12:12.126793  862106 system_pods.go:89] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:12:12.126798  862106 system_pods.go:89] "kube-proxy-7xs2n" [84d19e98-573b-4105-8ab9-f10b6a92dd95] Running

	I1028 13:12:12.126803  862106 system_pods.go:89] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:12:12.126809  862106 system_pods.go:89] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:12:12.126814  862106 system_pods.go:89] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:12:12.126819  862106 system_pods.go:89] "kube-scheduler-ha-798963-m03" [62d6b3e8-973e-4bed-a412-faa22e21b9f7] Running

	I1028 13:12:12.126826  862106 system_pods.go:89] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:12:12.126829  862106 system_pods.go:89] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:12:12.126832  862106 system_pods.go:89] "kube-vip-ha-798963-m03" [9796a102-575e-4d85-acf7-817d1f50d1f3] Running

	I1028 13:12:12.126835  862106 system_pods.go:89] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:12:12.126843  862106 system_pods.go:126] duration metric: took 207.188515ms to wait for k8s-apps to be running ...

	I1028 13:12:12.126855  862106 system_svc.go:44] waiting for kubelet service to be running ....

	I1028 13:12:12.126916  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:12:12.143874  862106 system_svc.go:56] duration metric: took 17.004242ms WaitForService to wait for kubelet

	I1028 13:12:12.143919  862106 kubeadm.go:582] duration metric: took 25.175668488s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1028 13:12:12.143952  862106 node_conditions.go:102] verifying NodePressure condition ...

	I1028 13:12:12.314519  862106 request.go:632] Waited for 170.436984ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes

	I1028 13:12:12.314593  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes

	I1028 13:12:12.314604  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:12.314615  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:12.314624  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:12.318728  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:12.319643  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:12:12.319665  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:12:12.319677  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:12:12.319681  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:12:12.319684  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:12:12.319688  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:12:12.319692  862106 node_conditions.go:105] duration metric: took 175.73394ms to run NodePressure ...

	I1028 13:12:12.319703  862106 start.go:241] waiting for startup goroutines ...

	I1028 13:12:12.319724  862106 start.go:255] writing updated cluster config ...

	I1028 13:12:12.320061  862106 ssh_runner.go:195] Run: rm -f paused

	I1028 13:12:12.373485  862106 start.go:600] kubectl: 1.31.2, cluster: 1.31.2 (minor skew: 0)

	I1028 13:12:12.375904  862106 out.go:177] * Done! kubectl is now configured to use "ha-798963" cluster and "default" namespace by default

	==> CRI-O <==

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.234003981Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121355233977916,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=167ca3e6-e269-4794-9e84-1697b2d6ec7a name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.234986853Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=770a15e0-e992-4c8d-80b8-d52a8dc392a3 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.235062424Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=770a15e0-e992-4c8d-80b8-d52a8dc392a3 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.235418146Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=770a15e0-e992-4c8d-80b8-d52a8dc392a3 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.274346401Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=ab9f5483-acf3-42e5-bcc1-68a652ade67c name=/runtime.v1.RuntimeService/Version

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.274424123Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=ab9f5483-acf3-42e5-bcc1-68a652ade67c name=/runtime.v1.RuntimeService/Version

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.275607883Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=3acaddee-b215-4b7d-b03d-813cc0b1af7f name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.276054539Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121355276030581,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=3acaddee-b215-4b7d-b03d-813cc0b1af7f name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.276623768Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=b4d0659c-4607-4dc6-94f8-b8ee8c1f0993 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.276675741Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=b4d0659c-4607-4dc6-94f8-b8ee8c1f0993 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.276904265Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=b4d0659c-4607-4dc6-94f8-b8ee8c1f0993 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.325394958Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=0524849f-129a-4c41-a421-b7858be0c8ec name=/runtime.v1.RuntimeService/Version

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.325520935Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=0524849f-129a-4c41-a421-b7858be0c8ec name=/runtime.v1.RuntimeService/Version

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.329669875Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=9e2fc75a-3bde-4b7e-a02d-754803d4a4f6 name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.331892918Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121355331853482,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=9e2fc75a-3bde-4b7e-a02d-754803d4a4f6 name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.332824828Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=d89c281d-a5ae-4bb7-ae25-570ed3a337ed name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.332896849Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=d89c281d-a5ae-4bb7-ae25-570ed3a337ed name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.333139428Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=d89c281d-a5ae-4bb7-ae25-570ed3a337ed name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.378460032Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=266ea9f0-7c71-4537-86bf-dbeae9d70c0d name=/runtime.v1.RuntimeService/Version

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.378582376Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=266ea9f0-7c71-4537-86bf-dbeae9d70c0d name=/runtime.v1.RuntimeService/Version

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.379754292Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=a752a279-8c13-4036-9108-0daa749d1366 name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.380287239Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121355380195804,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=a752a279-8c13-4036-9108-0daa749d1366 name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.380791089Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=d2d6786b-1ec3-4f37-ac04-ea41e52ceac9 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.380856298Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=d2d6786b-1ec3-4f37-ac04-ea41e52ceac9 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:15:55 ha-798963 crio[665]: time="2024-10-28 13:15:55.381079056Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=d2d6786b-1ec3-4f37-ac04-ea41e52ceac9 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	d62f32fce43d7       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   6e6fe8abbe2d9       busybox-7dff88458-t5f9c

	48a6bf2a9741a       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      5 minutes ago       Running             coredns                   0                   e837604bf0b51       coredns-7c65d6cfc9-7x97m

	84e026d6301e8       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      5 minutes ago       Running             coredns                   0                   70433a36bd3f3       coredns-7c65d6cfc9-bdv2v

	48ce850f78343       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      5 minutes ago       Running             storage-provisioner       0                   a692c9ac64a05       storage-provisioner

	e21d34c0daca4       docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16    6 minutes ago       Running             kindnet-cni               0                   50601025470b2       kindnet-46mzj

	f9e8711e7ed65       505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38                                      6 minutes ago       Running             kube-proxy                0                   2d34c3aac8eea       kube-proxy-6j2hc

	5e7810e058b3f       ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215     6 minutes ago       Running             kube-vip                  0                   084dc7a97d4f3       kube-vip-ha-798963

	e3a123f30200b       847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856                                      6 minutes ago       Running             kube-scheduler            0                   949f6bfe75a5f       kube-scheduler-ha-798963

	bd9de91780ff9       9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173                                      6 minutes ago       Running             kube-apiserver            0                   9a475e92c2e11       kube-apiserver-ha-798963

	e06d5644fa9b5       0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503                                      6 minutes ago       Running             kube-controller-manager   0                   4270e75a12719       kube-controller-manager-ha-798963

	c9a5739fb7047       2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4                                      6 minutes ago       Running             etcd                      0                   ba99675ddb4fe       etcd-ha-798963

	==> coredns [48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803] <==

	[INFO] 10.244.1.2:56690 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000223484s

	[INFO] 10.244.1.2:47912 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004320495s

	[INFO] 10.244.1.2:58339 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004513483s

	[INFO] 10.244.1.2:51885 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000171959s

	[INFO] 10.244.1.2:45279 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000157522s

	[INFO] 10.244.2.2:33883 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000143736s

	[INFO] 10.244.0.4:39492 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00011415s

	[INFO] 10.244.0.4:51848 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000160839s

	[INFO] 10.244.0.4:48729 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001822259s

	[INFO] 10.244.0.4:53755 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000075931s

	[INFO] 10.244.0.4:35896 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000083659s

	[INFO] 10.244.1.2:49722 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000191857s

	[INFO] 10.244.1.2:58322 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00013307s

	[INFO] 10.244.2.2:40226 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000206867s

	[INFO] 10.244.2.2:32858 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00011172s

	[INFO] 10.244.0.4:50865 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000089979s

	[INFO] 10.244.0.4:35561 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00006698s

	[INFO] 10.244.1.2:49357 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000392457s

	[INFO] 10.244.1.2:41923 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000114873s

	[INFO] 10.244.2.2:55444 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000239522s

	[INFO] 10.244.2.2:40681 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000112375s

	[INFO] 10.244.2.2:41379 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000151313s

	[INFO] 10.244.0.4:38006 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000159949s

	[INFO] 10.244.0.4:37765 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000067573s

	[INFO] 10.244.0.4:36336 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000089052s

	==> coredns [84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a] <==

	[INFO] 10.244.0.4:36976 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 31 0.001704473s

	[INFO] 10.244.0.4:44372 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001893947s

	[INFO] 10.244.1.2:37811 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00029107s

	[INFO] 10.244.1.2:49904 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000177601s

	[INFO] 10.244.1.2:51519 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000140741s

	[INFO] 10.244.2.2:41916 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000187911s

	[INFO] 10.244.2.2:37867 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001984278s

	[INFO] 10.244.2.2:34700 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000124738s

	[INFO] 10.244.2.2:45453 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000096384s

	[INFO] 10.244.2.2:46559 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001825921s

	[INFO] 10.244.2.2:39372 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000147221s

	[INFO] 10.244.2.2:32893 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00014343s

	[INFO] 10.244.0.4:54361 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00195716s

	[INFO] 10.244.0.4:46218 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000082754s

	[INFO] 10.244.0.4:44534 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000091291s

	[INFO] 10.244.1.2:58259 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000132144s

	[INFO] 10.244.1.2:32828 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000095461s

	[INFO] 10.244.2.2:34997 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000134992s

	[INFO] 10.244.2.2:41428 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000106967s

	[INFO] 10.244.0.4:58880 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000108657s

	[INFO] 10.244.0.4:39030 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000096859s

	[INFO] 10.244.1.2:48049 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000161435s

	[INFO] 10.244.1.2:50102 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000135551s

	[INFO] 10.244.2.2:48432 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000222303s

	[INFO] 10.244.0.4:48688 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000155639s

	==> describe nodes <==

	Name:               ha-798963

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_10_28T13_09_37_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:09:36 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:15:55 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:36 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:36 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:36 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:56 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.179

	  Hostname:    ha-798963

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 49efb145624c49b5a9f48be508f8d65b

	  System UUID:                49efb145-624c-49b5-a9f4-8be508f8d65b

	  Boot ID:                    cf911098-fde4-48dc-84d1-5147be1eaed0

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-t5f9c              0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m42s

	  kube-system                 coredns-7c65d6cfc9-7x97m             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m14s

	  kube-system                 coredns-7c65d6cfc9-bdv2v             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m14s

	  kube-system                 etcd-ha-798963                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         6m18s

	  kube-system                 kindnet-46mzj                        100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      6m15s

	  kube-system                 kube-apiserver-ha-798963             250m (12%)    0 (0%)      0 (0%)           0 (0%)         6m18s

	  kube-system                 kube-controller-manager-ha-798963    200m (10%)    0 (0%)      0 (0%)           0 (0%)         6m18s

	  kube-system                 kube-proxy-6j2hc                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m15s

	  kube-system                 kube-scheduler-ha-798963             100m (5%)     0 (0%)      0 (0%)           0 (0%)         6m18s

	  kube-system                 kube-vip-ha-798963                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m18s

	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m13s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%)   100m (5%)

	  memory             290Mi (13%)  390Mi (18%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 6m13s  kube-proxy       

	  Normal  Starting                 6m18s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m18s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m18s  kubelet          Node ha-798963 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m18s  kubelet          Node ha-798963 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m18s  kubelet          Node ha-798963 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m15s  node-controller  Node ha-798963 event: Registered Node ha-798963 in Controller

	  Normal  NodeReady                5m59s  kubelet          Node ha-798963 status is now: NodeReady

	  Normal  RegisteredNode           5m21s  node-controller  Node ha-798963 event: Registered Node ha-798963 in Controller

	  Normal  RegisteredNode           4m3s   node-controller  Node ha-798963 event: Registered Node ha-798963 in Controller

	Name:               ha-798963-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_10_28T13_10_29_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:10:27 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:13:31 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.109

	  Hostname:    ha-798963-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 298ea6cf54e048a39e3ca5a6051cbc47

	  System UUID:                298ea6cf-54e0-48a3-9e3c-a5a6051cbc47

	  Boot ID:                    306b3ff3-b813-4776-afa8-c5bb38a7fd70

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-2qlvb                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m42s

	  kube-system                 etcd-ha-798963-m02                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         5m27s

	  kube-system                 kindnet-9m2qk                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      5m28s

	  kube-system                 kube-apiserver-ha-798963-m02             250m (12%)    0 (0%)      0 (0%)           0 (0%)         5m27s

	  kube-system                 kube-controller-manager-ha-798963-m02    200m (10%)    0 (0%)      0 (0%)           0 (0%)         5m27s

	  kube-system                 kube-proxy-ltx8s                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m28s

	  kube-system                 kube-scheduler-ha-798963-m02             100m (5%)     0 (0%)      0 (0%)           0 (0%)         5m20s

	  kube-system                 kube-vip-ha-798963-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m24s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m24s                  kube-proxy       

	  Normal  NodeAllocatableEnforced  5m29s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  5m28s (x8 over 5m29s)  kubelet          Node ha-798963-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m28s (x8 over 5m29s)  kubelet          Node ha-798963-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m28s (x7 over 5m29s)  kubelet          Node ha-798963-m02 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           5m25s                  node-controller  Node ha-798963-m02 event: Registered Node ha-798963-m02 in Controller

	  Normal  RegisteredNode           5m21s                  node-controller  Node ha-798963-m02 event: Registered Node ha-798963-m02 in Controller

	  Normal  RegisteredNode           4m3s                   node-controller  Node ha-798963-m02 event: Registered Node ha-798963-m02 in Controller

	  Normal  NodeNotReady             103s                   node-controller  Node ha-798963-m02 status is now: NodeNotReady

	Name:               ha-798963-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_10_28T13_11_46_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:11:43 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:15:49 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:11:43 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:11:43 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:11:43 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:12:05 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.22

	  Hostname:    ha-798963-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 9520468054654151a7aaac7502074668

	  System UUID:                95204680-5465-4151-a7aa-ac7502074668

	  Boot ID:                    883fec3c-b4bc-4622-ae3e-114be4ae0345

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-d2mnl                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m42s

	  kube-system                 etcd-ha-798963-m03                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         4m10s

	  kube-system                 kindnet-fqc7b                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      4m12s

	  kube-system                 kube-apiserver-ha-798963-m03             250m (12%)    0 (0%)      0 (0%)           0 (0%)         4m10s

	  kube-system                 kube-controller-manager-ha-798963-m03    200m (10%)    0 (0%)      0 (0%)           0 (0%)         4m10s

	  kube-system                 kube-proxy-7xs2n                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m12s

	  kube-system                 kube-scheduler-ha-798963-m03             100m (5%)     0 (0%)      0 (0%)           0 (0%)         4m5s

	  kube-system                 kube-vip-ha-798963-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m7s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m7s                   kube-proxy       

	  Normal  NodeHasSufficientMemory  4m12s (x8 over 4m12s)  kubelet          Node ha-798963-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m12s (x8 over 4m12s)  kubelet          Node ha-798963-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m12s (x7 over 4m12s)  kubelet          Node ha-798963-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m12s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m11s                  node-controller  Node ha-798963-m03 event: Registered Node ha-798963-m03 in Controller

	  Normal  RegisteredNode           4m10s                  node-controller  Node ha-798963-m03 event: Registered Node ha-798963-m03 in Controller

	  Normal  RegisteredNode           4m3s                   node-controller  Node ha-798963-m03 event: Registered Node ha-798963-m03 in Controller

	Name:               ha-798963-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_10_28T13_12_52_0700

	                    minikube.k8s.io/version=v1.34.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:12:52 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:15:55 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:12:52 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:12:52 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:12:52 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:13:13 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.242

	  Hostname:    ha-798963-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 ecce8c01220046a09ed45b783db17dc3

	  System UUID:                ecce8c01-2200-46a0-9ed4-5b783db17dc3

	  Boot ID:                    c67cbe63-b326-411a-852b-3c4030c64a40

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-7svj5       100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      3m3s

	  kube-system                 kube-proxy-497js    0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m3s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%)  100m (5%)

	  memory             50Mi (2%)  50Mi (2%)

	  ephemeral-storage  0 (0%)     0 (0%)

	  hugepages-2Mi      0 (0%)     0 (0%)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 2m57s                kube-proxy       

	  Normal  RegisteredNode           3m3s                 node-controller  Node ha-798963-m04 event: Registered Node ha-798963-m04 in Controller

	  Normal  NodeHasSufficientMemory  3m3s (x2 over 3m4s)  kubelet          Node ha-798963-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m3s (x2 over 3m4s)  kubelet          Node ha-798963-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m3s (x2 over 3m4s)  kubelet          Node ha-798963-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m3s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m1s                 node-controller  Node ha-798963-m04 event: Registered Node ha-798963-m04 in Controller

	  Normal  RegisteredNode           3m                   node-controller  Node ha-798963-m04 event: Registered Node ha-798963-m04 in Controller

	  Normal  NodeReady                2m42s                kubelet          Node ha-798963-m04 status is now: NodeReady

	==> dmesg <==

	[Oct28 13:08] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.051002] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.038028] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[Oct28 13:09] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.908676] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.542211] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[ +10.009744] systemd-fstab-generator[587]: Ignoring "noauto" option for root device

	[  +0.063468] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.060133] systemd-fstab-generator[599]: Ignoring "noauto" option for root device

	[  +0.166730] systemd-fstab-generator[613]: Ignoring "noauto" option for root device

	[  +0.141134] systemd-fstab-generator[625]: Ignoring "noauto" option for root device

	[  +0.283777] systemd-fstab-generator[655]: Ignoring "noauto" option for root device

	[  +3.959689] systemd-fstab-generator[750]: Ignoring "noauto" option for root device

	[  +3.755625] systemd-fstab-generator[880]: Ignoring "noauto" option for root device

	[  +0.059298] kauditd_printk_skb: 158 callbacks suppressed

	[  +7.363407] systemd-fstab-generator[1300]: Ignoring "noauto" option for root device

	[  +0.075053] kauditd_printk_skb: 79 callbacks suppressed

	[  +5.328623] kauditd_printk_skb: 36 callbacks suppressed

	[ +14.589935] kauditd_printk_skb: 23 callbacks suppressed

	[Oct28 13:10] kauditd_printk_skb: 28 callbacks suppressed

	==> etcd [c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de] <==

	{"level":"warn","ts":"2024-10-28T13:15:55.715156Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.717543Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.718668Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.727072Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.736102Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.740042Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.744181Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.750160Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.758654Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.766239Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.770739Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.775284Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.785080Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.793590Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.802169Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.808634Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.813354Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.817962Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.819070Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.865644Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.884870Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.888265Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.889151Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.918191Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:15:55.928962Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 13:15:55 up 6 min,  0 users,  load average: 0.33, 0.23, 0.11

	Linux ha-798963 5.10.207 #1 SMP Tue Oct 15 19:19:35 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf] <==

	I1028 13:15:16.224501       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	I1028 13:15:26.228517       1 main.go:297] Handling node with IPs: map[192.168.39.22:{}]

	I1028 13:15:26.228597       1 main.go:324] Node ha-798963-m03 has CIDR [10.244.2.0/24] 

	I1028 13:15:26.228961       1 main.go:297] Handling node with IPs: map[192.168.39.242:{}]

	I1028 13:15:26.228981       1 main.go:324] Node ha-798963-m04 has CIDR [10.244.3.0/24] 

	I1028 13:15:26.229162       1 main.go:297] Handling node with IPs: map[192.168.39.179:{}]

	I1028 13:15:26.229183       1 main.go:301] handling current node

	I1028 13:15:26.229198       1 main.go:297] Handling node with IPs: map[192.168.39.109:{}]

	I1028 13:15:26.229203       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	I1028 13:15:36.224990       1 main.go:297] Handling node with IPs: map[192.168.39.179:{}]

	I1028 13:15:36.225299       1 main.go:301] handling current node

	I1028 13:15:36.225525       1 main.go:297] Handling node with IPs: map[192.168.39.109:{}]

	I1028 13:15:36.225574       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	I1028 13:15:36.226089       1 main.go:297] Handling node with IPs: map[192.168.39.22:{}]

	I1028 13:15:36.226144       1 main.go:324] Node ha-798963-m03 has CIDR [10.244.2.0/24] 

	I1028 13:15:36.226487       1 main.go:297] Handling node with IPs: map[192.168.39.242:{}]

	I1028 13:15:36.226555       1 main.go:324] Node ha-798963-m04 has CIDR [10.244.3.0/24] 

	I1028 13:15:46.224388       1 main.go:297] Handling node with IPs: map[192.168.39.22:{}]

	I1028 13:15:46.224529       1 main.go:324] Node ha-798963-m03 has CIDR [10.244.2.0/24] 

	I1028 13:15:46.224948       1 main.go:297] Handling node with IPs: map[192.168.39.242:{}]

	I1028 13:15:46.225005       1 main.go:324] Node ha-798963-m04 has CIDR [10.244.3.0/24] 

	I1028 13:15:46.225291       1 main.go:297] Handling node with IPs: map[192.168.39.179:{}]

	I1028 13:15:46.225407       1 main.go:301] handling current node

	I1028 13:15:46.225442       1 main.go:297] Handling node with IPs: map[192.168.39.109:{}]

	I1028 13:15:46.225467       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	==> kube-apiserver [bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f] <==

	I1028 13:09:37.161352       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I1028 13:09:40.959590       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I1028 13:09:41.110761       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E1028 13:10:27.853740       1 writers.go:122] "Unhandled Error" err="apiserver was unable to write a JSON response: http: Handler timeout" logger="UnhandledError"

	E1028 13:10:27.854868       1 finisher.go:175] "Unhandled Error" err="FinishRequest: post-timeout activity - time-elapsed: 908.321µs, panicked: false, err: context canceled, panic-reason: <nil>" logger="UnhandledError"

	E1028 13:10:27.855010       1 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"http: Handler timeout\"}: http: Handler timeout" logger="UnhandledError"

	E1028 13:10:27.856242       1 writers.go:135] "Unhandled Error" err="apiserver was unable to write a fallback JSON response: http: Handler timeout" logger="UnhandledError"

	E1028 13:10:27.857591       1 timeout.go:140] "Post-timeout activity" logger="UnhandledError" timeElapsed="4.111957ms" method="POST" path="/api/v1/namespaces/kube-system/events" result=null

	E1028 13:11:44.716219       1 finisher.go:175] "Unhandled Error" err="FinishRequest: post-timeout activity - time-elapsed: 6.388µs, panicked: false, err: context canceled, panic-reason: <nil>" logger="UnhandledError"

	E1028 13:11:44.716271       1 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="POST" URI="/api/v1/namespaces/kube-system/events" auditID="1270982c-88af-4eba-a9fd-c0cb7dc8d117"

	E1028 13:11:44.716439       1 timeout.go:140] "Post-timeout activity" logger="UnhandledError" timeElapsed="2.892µs" method="POST" path="/api/v1/namespaces/kube-system/events" result=null

	E1028 13:12:18.560996       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59344: use of closed network connection

	E1028 13:12:18.751076       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59362: use of closed network connection

	E1028 13:12:18.949498       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59384: use of closed network connection

	E1028 13:12:19.148562       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59392: use of closed network connection

	E1028 13:12:19.344290       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59406: use of closed network connection

	E1028 13:12:19.547565       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59418: use of closed network connection

	E1028 13:12:19.731759       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59434: use of closed network connection

	E1028 13:12:19.917937       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59462: use of closed network connection

	E1028 13:12:20.100646       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59482: use of closed network connection

	E1028 13:12:20.423551       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59526: use of closed network connection

	E1028 13:12:20.612666       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59546: use of closed network connection

	E1028 13:12:20.980438       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:41212: use of closed network connection

	E1028 13:12:21.172635       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:41234: use of closed network connection

	E1028 13:12:21.359029       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:41258: use of closed network connection

	==> kube-controller-manager [e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc] <==

	I1028 13:12:52.142803       1 range_allocator.go:422] "Set node PodCIDR" logger="node-ipam-controller" node="ha-798963-m04" podCIDRs=["10.244.3.0/24"]

	I1028 13:12:52.142851       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.143062       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.166788       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.213127       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.319500       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.637873       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:54.742175       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:54.796500       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:55.524212       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:55.525971       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-798963-m04"

	I1028 13:12:55.609249       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:02.569475       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:13.493496       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:13.494498       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-798963-m04"

	I1028 13:13:13.513512       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:14.755883       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:22.843583       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:14:12.250546       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-798963-m04"

	I1028 13:14:12.250795       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	I1028 13:14:12.275269       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	I1028 13:14:12.338511       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="15.100805ms"

	I1028 13:14:12.339034       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="103.795µs"

	I1028 13:14:15.638707       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	I1028 13:14:17.576466       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	==> kube-proxy [f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E1028 13:09:42.137583       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I1028 13:09:42.164503       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.39.179"]

	E1028 13:09:42.164841       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I1028 13:09:42.201122       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I1028 13:09:42.201244       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1028 13:09:42.201287       1 server_linux.go:169] "Using iptables Proxier"

	I1028 13:09:42.207249       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I1028 13:09:42.208140       1 server.go:483] "Version info" version="v1.31.2"

	I1028 13:09:42.208190       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1028 13:09:42.213020       1 config.go:199] "Starting service config controller"

	I1028 13:09:42.214093       1 shared_informer.go:313] Waiting for caches to sync for service config

	I1028 13:09:42.214167       1 config.go:105] "Starting endpoint slice config controller"

	I1028 13:09:42.214185       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I1028 13:09:42.214880       1 config.go:328] "Starting node config controller"

	I1028 13:09:42.214928       1 shared_informer.go:313] Waiting for caches to sync for node config

	I1028 13:09:42.315117       1 shared_informer.go:320] Caches are synced for node config

	I1028 13:09:42.315149       1 shared_informer.go:320] Caches are synced for service config

	I1028 13:09:42.315172       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a] <==

	W1028 13:09:34.868574       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1028 13:09:34.868633       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W1028 13:09:34.872157       1 reflector.go:561] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1028 13:09:34.872875       1 reflector.go:158] "Unhandled Error" err="runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"

	W1028 13:09:34.899618       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1028 13:09:34.899665       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	I1028 13:09:36.607872       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E1028 13:12:13.405664       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-d2mnl\": pod busybox-7dff88458-d2mnl is already assigned to node \"ha-798963-m03\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-d2mnl" node="ha-798963-m03"

	E1028 13:12:13.409088       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod fdf9a1c8-2afb-40ae-9322-38a216ef73e3(default/busybox-7dff88458-d2mnl) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-d2mnl"

	E1028 13:12:13.409201       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-d2mnl\": pod busybox-7dff88458-d2mnl is already assigned to node \"ha-798963-m03\"" pod="default/busybox-7dff88458-d2mnl"

	I1028 13:12:13.409298       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-d2mnl" node="ha-798963-m03"

	E1028 13:12:52.211697       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-7svj5\": pod kindnet-7svj5 is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-7svj5" node="ha-798963-m04"

	E1028 13:12:52.212004       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-7svj5\": pod kindnet-7svj5 is already assigned to node \"ha-798963-m04\"" pod="kube-system/kindnet-7svj5"

	E1028 13:12:52.258545       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-xgxl8\": pod kube-proxy-xgxl8 is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-xgxl8" node="ha-798963-m04"

	E1028 13:12:52.258637       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod a54a30d8-7a02-416c-93c0-5c38f51f5fd5(kube-system/kube-proxy-xgxl8) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-xgxl8"

	E1028 13:12:52.258659       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-xgxl8\": pod kube-proxy-xgxl8 is already assigned to node \"ha-798963-m04\"" pod="kube-system/kube-proxy-xgxl8"

	I1028 13:12:52.258679       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-xgxl8" node="ha-798963-m04"

	E1028 13:12:52.310730       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-6qqx2\": pod kindnet-6qqx2 is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-6qqx2" node="ha-798963-m04"

	E1028 13:12:52.311083       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 6afd7781-540b-49bc-848a-58be4edbceef(kube-system/kindnet-6qqx2) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-6qqx2"

	E1028 13:12:52.311236       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-6qqx2\": pod kindnet-6qqx2 is already assigned to node \"ha-798963-m04\"" pod="kube-system/kindnet-6qqx2"

	I1028 13:12:52.311413       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-6qqx2" node="ha-798963-m04"

	E1028 13:12:52.344533       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-pbw9k\": pod kube-proxy-pbw9k is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-pbw9k" node="ha-798963-m04"

	E1028 13:12:52.344601       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 63648c50-4487-4d6c-89a0-318172691bf5(kube-system/kube-proxy-pbw9k) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-pbw9k"

	E1028 13:12:52.344630       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-pbw9k\": pod kube-proxy-pbw9k is already assigned to node \"ha-798963-m04\"" pod="kube-system/kube-proxy-pbw9k"

	I1028 13:12:52.344650       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-pbw9k" node="ha-798963-m04"

	==> kubelet <==

	Oct 28 13:14:37 ha-798963 kubelet[1307]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Oct 28 13:14:37 ha-798963 kubelet[1307]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 28 13:14:37 ha-798963 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 28 13:14:37 ha-798963 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 28 13:14:37 ha-798963 kubelet[1307]: E1028 13:14:37.267723    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121277267381342,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:37 ha-798963 kubelet[1307]: E1028 13:14:37.267759    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121277267381342,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:47 ha-798963 kubelet[1307]: E1028 13:14:47.269530    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121287269119624,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:47 ha-798963 kubelet[1307]: E1028 13:14:47.269816    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121287269119624,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:57 ha-798963 kubelet[1307]: E1028 13:14:57.271476    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121297271006652,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:57 ha-798963 kubelet[1307]: E1028 13:14:57.271533    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121297271006652,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:07 ha-798963 kubelet[1307]: E1028 13:15:07.273643    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121307273189567,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:07 ha-798963 kubelet[1307]: E1028 13:15:07.273701    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121307273189567,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:17 ha-798963 kubelet[1307]: E1028 13:15:17.275885    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121317275419786,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:17 ha-798963 kubelet[1307]: E1028 13:15:17.276167    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121317275419786,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:27 ha-798963 kubelet[1307]: E1028 13:15:27.278169    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121327277752589,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:27 ha-798963 kubelet[1307]: E1028 13:15:27.278218    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121327277752589,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:37 ha-798963 kubelet[1307]: E1028 13:15:37.193137    1307 iptables.go:577] "Could not set up iptables canary" err=<

	Oct 28 13:15:37 ha-798963 kubelet[1307]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Oct 28 13:15:37 ha-798963 kubelet[1307]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 28 13:15:37 ha-798963 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 28 13:15:37 ha-798963 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 28 13:15:37 ha-798963 kubelet[1307]: E1028 13:15:37.280395    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121337280079403,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:37 ha-798963 kubelet[1307]: E1028 13:15:37.280419    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121337280079403,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:47 ha-798963 kubelet[1307]: E1028 13:15:47.282359    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121347281914833,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:47 ha-798963 kubelet[1307]: E1028 13:15:47.282762    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121347281914833,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-798963 -n ha-798963

helpers_test.go:261: (dbg) Run:  kubectl --context ha-798963 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (141.89s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop

ha_test.go:392: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

ha_test.go:392: (dbg) Done: out/minikube-linux-amd64 profile list --output json: (3.445125198s)

ha_test.go:415: expected profile "ha-798963" in json of 'profile list' to have "Degraded" status but have "Unknown" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-798963\",\"Status\":\"Unknown\",\"Config\":{\"Name\":\"ha-798963\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"kvm2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":

1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.31.2\",\"ClusterName\":\"ha-798963\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.39.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"crio\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.39.179\",\"Port\":8443,\"Kube

rnetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.39.109\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.39.22\",\"Port\":8443,\"KubernetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"crio\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.39.242\",\"Port\":0,\"KubernetesVersion\":\"v1.31.2\",\"ContainerRuntime\":\"\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"amd-gpu-device-plugin\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubevi

rt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/home/jenkins:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\

",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-linux-amd64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-798963 -n ha-798963

helpers_test.go:244: <<< TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-798963 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-798963 logs -n 25: (1.420112379s)

helpers_test.go:252: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1851781028/001/cp-test_ha-798963-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963:/home/docker/cp-test_ha-798963-m03_ha-798963.txt                       |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963 sudo cat                                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m03_ha-798963.txt                                 |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m02:/home/docker/cp-test_ha-798963-m03_ha-798963-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m02 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m03_ha-798963-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m03:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04:/home/docker/cp-test_ha-798963-m03_ha-798963-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m04 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m03_ha-798963-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-798963 cp testdata/cp-test.txt                                                | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1851781028/001/cp-test_ha-798963-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963:/home/docker/cp-test_ha-798963-m04_ha-798963.txt                       |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963 sudo cat                                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m04_ha-798963.txt                                 |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m02:/home/docker/cp-test_ha-798963-m04_ha-798963-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m02 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m04_ha-798963-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-798963 cp ha-798963-m04:/home/docker/cp-test.txt                              | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m03:/home/docker/cp-test_ha-798963-m04_ha-798963-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n                                                                 | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | ha-798963-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-798963 ssh -n ha-798963-m03 sudo cat                                          | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC | 28 Oct 24 13:13 UTC |

	|         | /home/docker/cp-test_ha-798963-m04_ha-798963-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-798963 node stop m02 -v=7                                                     | ha-798963 | jenkins | v1.34.0 | 28 Oct 24 13:13 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/10/28 13:08:55

	Running on machine: ubuntu-20-agent-9

	Binary: Built with gc go1.23.2 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I1028 13:08:55.396734  862106 out.go:345] Setting OutFile to fd 1 ...

	I1028 13:08:55.396862  862106 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 13:08:55.396874  862106 out.go:358] Setting ErrFile to fd 2...

	I1028 13:08:55.396880  862106 out.go:392] TERM=,COLORTERM=, which probably does not support color

	I1028 13:08:55.397096  862106 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19865-839778/.minikube/bin

	I1028 13:08:55.397865  862106 out.go:352] Setting JSON to false

	I1028 13:08:55.399109  862106 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-9","uptime":10276,"bootTime":1730110659,"procs":172,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1070-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I1028 13:08:55.399259  862106 start.go:139] virtualization: kvm guest

	I1028 13:08:55.401661  862106 out.go:177] * [ha-798963] minikube v1.34.0 on Ubuntu 20.04 (kvm/amd64)

	I1028 13:08:55.403130  862106 notify.go:220] Checking for updates...

	I1028 13:08:55.403153  862106 out.go:177]   - MINIKUBE_LOCATION=19865

	I1028 13:08:55.404738  862106 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I1028 13:08:55.406304  862106 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:08:55.407792  862106 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:08:55.409272  862106 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I1028 13:08:55.410669  862106 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I1028 13:08:55.412138  862106 driver.go:394] Setting default libvirt URI to qemu:///system

	I1028 13:08:55.449966  862106 out.go:177] * Using the kvm2 driver based on user configuration

	I1028 13:08:55.451668  862106 start.go:297] selected driver: kvm2

	I1028 13:08:55.451694  862106 start.go:901] validating driver "kvm2" against <nil>

	I1028 13:08:55.451711  862106 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I1028 13:08:55.452545  862106 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1028 13:08:55.452630  862106 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19865-839778/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I1028 13:08:55.469294  862106 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.34.0

	I1028 13:08:55.469371  862106 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I1028 13:08:55.469691  862106 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1028 13:08:55.469735  862106 cni.go:84] Creating CNI manager for ""

	I1028 13:08:55.469797  862106 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I1028 13:08:55.469807  862106 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I1028 13:08:55.469869  862106 start.go:340] cluster config:

	{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I1028 13:08:55.469974  862106 iso.go:125] acquiring lock: {Name:mk3969ab3dff5daa2fa05bc5981fbcf53106ccb3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I1028 13:08:55.472934  862106 out.go:177] * Starting "ha-798963" primary control-plane node in "ha-798963" cluster

	I1028 13:08:55.475043  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:08:55.475104  862106 preload.go:146] Found local preload: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4

	I1028 13:08:55.475117  862106 cache.go:56] Caching tarball of preloaded images

	I1028 13:08:55.475209  862106 preload.go:172] Found /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I1028 13:08:55.475221  862106 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on crio

	I1028 13:08:55.475546  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:08:55.475571  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json: {Name:mk88d37d80cc1effe317fe2f2b3e4f503f332549 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:08:55.475717  862106 start.go:360] acquireMachinesLock for ha-798963: {Name:mk3d8412df30fd3411bfb6262eb0fa70b21bf365 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1028 13:08:55.475747  862106 start.go:364] duration metric: took 17.194µs to acquireMachinesLock for "ha-798963"

	I1028 13:08:55.475787  862106 start.go:93] Provisioning new machine with config: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:08:55.475890  862106 start.go:125] createHost starting for "" (driver="kvm2")

	I1028 13:08:55.477815  862106 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1028 13:08:55.477964  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:08:55.478002  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:08:55.493524  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43493

	I1028 13:08:55.494183  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:08:55.494740  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:08:55.494766  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:08:55.495290  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:08:55.495576  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:08:55.495795  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:08:55.495993  862106 start.go:159] libmachine.API.Create for "ha-798963" (driver="kvm2")

	I1028 13:08:55.496028  862106 client.go:168] LocalClient.Create starting

	I1028 13:08:55.496066  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem

	I1028 13:08:55.496101  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:08:55.496124  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:08:55.496187  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem

	I1028 13:08:55.496217  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:08:55.496235  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:08:55.496258  862106 main.go:141] libmachine: Running pre-create checks...

	I1028 13:08:55.496270  862106 main.go:141] libmachine: (ha-798963) Calling .PreCreateCheck

	I1028 13:08:55.496705  862106 main.go:141] libmachine: (ha-798963) Calling .GetConfigRaw

	I1028 13:08:55.497203  862106 main.go:141] libmachine: Creating machine...

	I1028 13:08:55.497223  862106 main.go:141] libmachine: (ha-798963) Calling .Create

	I1028 13:08:55.497452  862106 main.go:141] libmachine: (ha-798963) Creating KVM machine...

	I1028 13:08:55.498924  862106 main.go:141] libmachine: (ha-798963) DBG | found existing default KVM network

	I1028 13:08:55.499788  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:55.499621  862129 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000121ba0}

	I1028 13:08:55.499889  862106 main.go:141] libmachine: (ha-798963) DBG | created network xml: 

	I1028 13:08:55.499918  862106 main.go:141] libmachine: (ha-798963) DBG | <network>

	I1028 13:08:55.499933  862106 main.go:141] libmachine: (ha-798963) DBG |   <name>mk-ha-798963</name>

	I1028 13:08:55.499940  862106 main.go:141] libmachine: (ha-798963) DBG |   <dns enable='no'/>

	I1028 13:08:55.499947  862106 main.go:141] libmachine: (ha-798963) DBG |   

	I1028 13:08:55.499960  862106 main.go:141] libmachine: (ha-798963) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I1028 13:08:55.499972  862106 main.go:141] libmachine: (ha-798963) DBG |     <dhcp>

	I1028 13:08:55.499992  862106 main.go:141] libmachine: (ha-798963) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I1028 13:08:55.500004  862106 main.go:141] libmachine: (ha-798963) DBG |     </dhcp>

	I1028 13:08:55.500014  862106 main.go:141] libmachine: (ha-798963) DBG |   </ip>

	I1028 13:08:55.500023  862106 main.go:141] libmachine: (ha-798963) DBG |   

	I1028 13:08:55.500037  862106 main.go:141] libmachine: (ha-798963) DBG | </network>

	I1028 13:08:55.500046  862106 main.go:141] libmachine: (ha-798963) DBG | 

	I1028 13:08:55.505348  862106 main.go:141] libmachine: (ha-798963) DBG | trying to create private KVM network mk-ha-798963 192.168.39.0/24...

	I1028 13:08:55.578263  862106 main.go:141] libmachine: (ha-798963) Setting up store path in /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963 ...

	I1028 13:08:55.578316  862106 main.go:141] libmachine: (ha-798963) Building disk image from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso

	I1028 13:08:55.578336  862106 main.go:141] libmachine: (ha-798963) DBG | private KVM network mk-ha-798963 192.168.39.0/24 created

	I1028 13:08:55.578402  862106 main.go:141] libmachine: (ha-798963) Downloading /home/jenkins/minikube-integration/19865-839778/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...

	I1028 13:08:55.578445  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:55.578108  862129 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:08:55.855435  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:55.855281  862129 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa...

	I1028 13:08:56.195891  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:56.195666  862129 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/ha-798963.rawdisk...

	I1028 13:08:56.195933  862106 main.go:141] libmachine: (ha-798963) DBG | Writing magic tar header

	I1028 13:08:56.195946  862106 main.go:141] libmachine: (ha-798963) DBG | Writing SSH key tar header

	I1028 13:08:56.195957  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:56.195841  862129 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963 ...

	I1028 13:08:56.195975  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963

	I1028 13:08:56.196033  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963 (perms=drwx------)

	I1028 13:08:56.196067  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines (perms=drwxr-xr-x)

	I1028 13:08:56.196078  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines

	I1028 13:08:56.196096  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:08:56.196110  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778

	I1028 13:08:56.196120  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube (perms=drwxr-xr-x)

	I1028 13:08:56.196133  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778 (perms=drwxrwxr-x)

	I1028 13:08:56.196143  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I1028 13:08:56.196154  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I1028 13:08:56.196172  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home/jenkins

	I1028 13:08:56.196182  862106 main.go:141] libmachine: (ha-798963) DBG | Checking permissions on dir: /home

	I1028 13:08:56.196192  862106 main.go:141] libmachine: (ha-798963) DBG | Skipping /home - not owner

	I1028 13:08:56.196205  862106 main.go:141] libmachine: (ha-798963) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I1028 13:08:56.196214  862106 main.go:141] libmachine: (ha-798963) Creating domain...

	I1028 13:08:56.197516  862106 main.go:141] libmachine: (ha-798963) define libvirt domain using xml: 

	I1028 13:08:56.197547  862106 main.go:141] libmachine: (ha-798963) <domain type='kvm'>

	I1028 13:08:56.197557  862106 main.go:141] libmachine: (ha-798963)   <name>ha-798963</name>

	I1028 13:08:56.197564  862106 main.go:141] libmachine: (ha-798963)   <memory unit='MiB'>2200</memory>

	I1028 13:08:56.197573  862106 main.go:141] libmachine: (ha-798963)   <vcpu>2</vcpu>

	I1028 13:08:56.197579  862106 main.go:141] libmachine: (ha-798963)   <features>

	I1028 13:08:56.197586  862106 main.go:141] libmachine: (ha-798963)     <acpi/>

	I1028 13:08:56.197591  862106 main.go:141] libmachine: (ha-798963)     <apic/>

	I1028 13:08:56.197596  862106 main.go:141] libmachine: (ha-798963)     <pae/>

	I1028 13:08:56.197602  862106 main.go:141] libmachine: (ha-798963)     

	I1028 13:08:56.197607  862106 main.go:141] libmachine: (ha-798963)   </features>

	I1028 13:08:56.197611  862106 main.go:141] libmachine: (ha-798963)   <cpu mode='host-passthrough'>

	I1028 13:08:56.197616  862106 main.go:141] libmachine: (ha-798963)   

	I1028 13:08:56.197625  862106 main.go:141] libmachine: (ha-798963)   </cpu>

	I1028 13:08:56.197632  862106 main.go:141] libmachine: (ha-798963)   <os>

	I1028 13:08:56.197639  862106 main.go:141] libmachine: (ha-798963)     <type>hvm</type>

	I1028 13:08:56.197674  862106 main.go:141] libmachine: (ha-798963)     <boot dev='cdrom'/>

	I1028 13:08:56.197696  862106 main.go:141] libmachine: (ha-798963)     <boot dev='hd'/>

	I1028 13:08:56.197701  862106 main.go:141] libmachine: (ha-798963)     <bootmenu enable='no'/>

	I1028 13:08:56.197706  862106 main.go:141] libmachine: (ha-798963)   </os>

	I1028 13:08:56.197711  862106 main.go:141] libmachine: (ha-798963)   <devices>

	I1028 13:08:56.197716  862106 main.go:141] libmachine: (ha-798963)     <disk type='file' device='cdrom'>

	I1028 13:08:56.197723  862106 main.go:141] libmachine: (ha-798963)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/boot2docker.iso'/>

	I1028 13:08:56.197730  862106 main.go:141] libmachine: (ha-798963)       <target dev='hdc' bus='scsi'/>

	I1028 13:08:56.197735  862106 main.go:141] libmachine: (ha-798963)       <readonly/>

	I1028 13:08:56.197738  862106 main.go:141] libmachine: (ha-798963)     </disk>

	I1028 13:08:56.197744  862106 main.go:141] libmachine: (ha-798963)     <disk type='file' device='disk'>

	I1028 13:08:56.197752  862106 main.go:141] libmachine: (ha-798963)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I1028 13:08:56.197763  862106 main.go:141] libmachine: (ha-798963)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/ha-798963.rawdisk'/>

	I1028 13:08:56.197767  862106 main.go:141] libmachine: (ha-798963)       <target dev='hda' bus='virtio'/>

	I1028 13:08:56.197804  862106 main.go:141] libmachine: (ha-798963)     </disk>

	I1028 13:08:56.197832  862106 main.go:141] libmachine: (ha-798963)     <interface type='network'>

	I1028 13:08:56.197845  862106 main.go:141] libmachine: (ha-798963)       <source network='mk-ha-798963'/>

	I1028 13:08:56.197863  862106 main.go:141] libmachine: (ha-798963)       <model type='virtio'/>

	I1028 13:08:56.197876  862106 main.go:141] libmachine: (ha-798963)     </interface>

	I1028 13:08:56.197886  862106 main.go:141] libmachine: (ha-798963)     <interface type='network'>

	I1028 13:08:56.197897  862106 main.go:141] libmachine: (ha-798963)       <source network='default'/>

	I1028 13:08:56.197906  862106 main.go:141] libmachine: (ha-798963)       <model type='virtio'/>

	I1028 13:08:56.197919  862106 main.go:141] libmachine: (ha-798963)     </interface>

	I1028 13:08:56.197931  862106 main.go:141] libmachine: (ha-798963)     <serial type='pty'>

	I1028 13:08:56.197942  862106 main.go:141] libmachine: (ha-798963)       <target port='0'/>

	I1028 13:08:56.197958  862106 main.go:141] libmachine: (ha-798963)     </serial>

	I1028 13:08:56.197974  862106 main.go:141] libmachine: (ha-798963)     <console type='pty'>

	I1028 13:08:56.197986  862106 main.go:141] libmachine: (ha-798963)       <target type='serial' port='0'/>

	I1028 13:08:56.198007  862106 main.go:141] libmachine: (ha-798963)     </console>

	I1028 13:08:56.198027  862106 main.go:141] libmachine: (ha-798963)     <rng model='virtio'>

	I1028 13:08:56.198042  862106 main.go:141] libmachine: (ha-798963)       <backend model='random'>/dev/random</backend>

	I1028 13:08:56.198051  862106 main.go:141] libmachine: (ha-798963)     </rng>

	I1028 13:08:56.198056  862106 main.go:141] libmachine: (ha-798963)     

	I1028 13:08:56.198063  862106 main.go:141] libmachine: (ha-798963)     

	I1028 13:08:56.198069  862106 main.go:141] libmachine: (ha-798963)   </devices>

	I1028 13:08:56.198076  862106 main.go:141] libmachine: (ha-798963) </domain>

	I1028 13:08:56.198082  862106 main.go:141] libmachine: (ha-798963) 

	I1028 13:08:56.202525  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:4f:cc:0e in network default

	I1028 13:08:56.203296  862106 main.go:141] libmachine: (ha-798963) Ensuring networks are active...

	I1028 13:08:56.203318  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:56.204420  862106 main.go:141] libmachine: (ha-798963) Ensuring network default is active

	I1028 13:08:56.204735  862106 main.go:141] libmachine: (ha-798963) Ensuring network mk-ha-798963 is active

	I1028 13:08:56.205186  862106 main.go:141] libmachine: (ha-798963) Getting domain xml...

	I1028 13:08:56.205974  862106 main.go:141] libmachine: (ha-798963) Creating domain...

	I1028 13:08:57.450815  862106 main.go:141] libmachine: (ha-798963) Waiting to get IP...

	I1028 13:08:57.451824  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:57.452254  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:57.452279  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:57.452215  862129 retry.go:31] will retry after 268.624303ms: waiting for machine to come up

	I1028 13:08:57.722823  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:57.723433  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:57.723462  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:57.723362  862129 retry.go:31] will retry after 349.830937ms: waiting for machine to come up

	I1028 13:08:58.075208  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:58.075792  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:58.075819  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:58.075721  862129 retry.go:31] will retry after 472.134429ms: waiting for machine to come up

	I1028 13:08:58.549371  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:58.549849  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:58.549880  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:58.549790  862129 retry.go:31] will retry after 405.301216ms: waiting for machine to come up

	I1028 13:08:58.956374  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:58.956791  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:58.956814  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:58.956738  862129 retry.go:31] will retry after 571.611338ms: waiting for machine to come up

	I1028 13:08:59.529663  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:08:59.530055  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:08:59.530081  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:08:59.529988  862129 retry.go:31] will retry after 594.15345ms: waiting for machine to come up

	I1028 13:09:00.126014  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:00.126568  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:00.126602  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:00.126497  862129 retry.go:31] will retry after 931.486225ms: waiting for machine to come up

	I1028 13:09:01.059347  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:01.059884  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:01.059912  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:01.059826  862129 retry.go:31] will retry after 1.289585172s: waiting for machine to come up

	I1028 13:09:02.351400  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:02.351788  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:02.351818  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:02.351708  862129 retry.go:31] will retry after 1.134418163s: waiting for machine to come up

	I1028 13:09:03.488383  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:03.488885  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:03.488917  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:03.488824  862129 retry.go:31] will retry after 1.513685236s: waiting for machine to come up

	I1028 13:09:05.004006  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:05.004447  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:05.004470  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:05.004406  862129 retry.go:31] will retry after 2.686675992s: waiting for machine to come up

	I1028 13:09:07.693670  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:07.694165  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:07.694192  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:07.694104  862129 retry.go:31] will retry after 2.606904929s: waiting for machine to come up

	I1028 13:09:10.303922  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:10.304313  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:10.304346  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:10.304269  862129 retry.go:31] will retry after 4.103114671s: waiting for machine to come up

	I1028 13:09:14.412327  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:14.412781  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find current IP address of domain ha-798963 in network mk-ha-798963

	I1028 13:09:14.412806  862106 main.go:141] libmachine: (ha-798963) DBG | I1028 13:09:14.412733  862129 retry.go:31] will retry after 4.75577582s: waiting for machine to come up

	I1028 13:09:19.172536  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.172987  862106 main.go:141] libmachine: (ha-798963) Found IP for machine: 192.168.39.179

	I1028 13:09:19.173030  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has current primary IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.173041  862106 main.go:141] libmachine: (ha-798963) Reserving static IP address...

	I1028 13:09:19.173375  862106 main.go:141] libmachine: (ha-798963) DBG | unable to find host DHCP lease matching {name: "ha-798963", mac: "52:54:00:aa:02:0b", ip: "192.168.39.179"} in network mk-ha-798963

	I1028 13:09:19.257414  862106 main.go:141] libmachine: (ha-798963) DBG | Getting to WaitForSSH function...

	I1028 13:09:19.257461  862106 main.go:141] libmachine: (ha-798963) Reserved static IP address: 192.168.39.179

	I1028 13:09:19.257508  862106 main.go:141] libmachine: (ha-798963) Waiting for SSH to be available...

	I1028 13:09:19.260202  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.260679  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:minikube Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.260709  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.260838  862106 main.go:141] libmachine: (ha-798963) DBG | Using SSH client type: external

	I1028 13:09:19.260863  862106 main.go:141] libmachine: (ha-798963) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa (-rw-------)

	I1028 13:09:19.260893  862106 main.go:141] libmachine: (ha-798963) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.179 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:09:19.260910  862106 main.go:141] libmachine: (ha-798963) DBG | About to run SSH command:

	I1028 13:09:19.260920  862106 main.go:141] libmachine: (ha-798963) DBG | exit 0

	I1028 13:09:19.384105  862106 main.go:141] libmachine: (ha-798963) DBG | SSH cmd err, output: <nil>: 

	I1028 13:09:19.384339  862106 main.go:141] libmachine: (ha-798963) KVM machine creation complete!

	I1028 13:09:19.384705  862106 main.go:141] libmachine: (ha-798963) Calling .GetConfigRaw

	I1028 13:09:19.385308  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:19.385505  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:19.385674  862106 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I1028 13:09:19.385689  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:19.386906  862106 main.go:141] libmachine: Detecting operating system of created instance...

	I1028 13:09:19.386920  862106 main.go:141] libmachine: Waiting for SSH to be available...

	I1028 13:09:19.386925  862106 main.go:141] libmachine: Getting to WaitForSSH function...

	I1028 13:09:19.386935  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.389223  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.389616  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.389642  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.389816  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.390063  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.390241  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.390430  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.390602  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.390908  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.390922  862106 main.go:141] libmachine: About to run SSH command:

	exit 0

	I1028 13:09:19.494932  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:09:19.494958  862106 main.go:141] libmachine: Detecting the provisioner...

	I1028 13:09:19.494966  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.498030  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.498432  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.498460  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.498630  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.498802  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.498956  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.499166  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.499331  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.499503  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.499513  862106 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I1028 13:09:19.604279  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I1028 13:09:19.604383  862106 main.go:141] libmachine: found compatible host: buildroot

	I1028 13:09:19.604397  862106 main.go:141] libmachine: Provisioning with buildroot...

	I1028 13:09:19.604409  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:09:19.604692  862106 buildroot.go:166] provisioning hostname "ha-798963"

	I1028 13:09:19.604726  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:09:19.604925  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.607444  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.607818  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.607848  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.608040  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.608228  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.608368  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.608474  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.608668  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.608871  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.608887  862106 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-798963 && echo "ha-798963" | sudo tee /etc/hostname

	I1028 13:09:19.727542  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-798963

	I1028 13:09:19.727570  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.730940  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.731280  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.731308  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.731555  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.731799  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.731992  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.732166  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.732356  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:19.732521  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:19.732541  862106 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-798963' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-798963/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-798963' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1028 13:09:19.844253  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:09:19.844294  862106 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19865-839778/.minikube CaCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19865-839778/.minikube}

	I1028 13:09:19.844365  862106 buildroot.go:174] setting up certificates

	I1028 13:09:19.844386  862106 provision.go:84] configureAuth start

	I1028 13:09:19.844414  862106 main.go:141] libmachine: (ha-798963) Calling .GetMachineName

	I1028 13:09:19.844728  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:19.847340  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.847685  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.847721  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.847839  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.850024  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.850338  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.850367  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.850513  862106 provision.go:143] copyHostCerts

	I1028 13:09:19.850546  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:09:19.850604  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem, removing ...

	I1028 13:09:19.850623  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:09:19.850713  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem (1082 bytes)

	I1028 13:09:19.850830  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:09:19.850862  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem, removing ...

	I1028 13:09:19.850870  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:09:19.850911  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem (1123 bytes)

	I1028 13:09:19.850976  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:09:19.851001  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem, removing ...

	I1028 13:09:19.851010  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:09:19.851044  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem (1679 bytes)

	I1028 13:09:19.851110  862106 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem org=jenkins.ha-798963 san=[127.0.0.1 192.168.39.179 ha-798963 localhost minikube]

	I1028 13:09:19.944962  862106 provision.go:177] copyRemoteCerts

	I1028 13:09:19.945027  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1028 13:09:19.945057  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:19.947923  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.948268  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:19.948298  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:19.948469  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:19.948656  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:19.948851  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:19.948981  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.029506  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1028 13:09:20.029619  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1028 13:09:20.053591  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1028 13:09:20.053689  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I1028 13:09:20.077096  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1028 13:09:20.077186  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1028 13:09:20.102201  862106 provision.go:87] duration metric: took 257.791422ms to configureAuth

	I1028 13:09:20.102242  862106 buildroot.go:189] setting minikube options for container-runtime

	I1028 13:09:20.102472  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:09:20.102561  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.106247  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.106588  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.106618  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.106797  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.106995  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.107163  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.107303  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.107440  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:20.107613  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:20.107632  862106 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1028 13:09:20.330306  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1028 13:09:20.330338  862106 main.go:141] libmachine: Checking connection to Docker...

	I1028 13:09:20.330359  862106 main.go:141] libmachine: (ha-798963) Calling .GetURL

	I1028 13:09:20.331808  862106 main.go:141] libmachine: (ha-798963) DBG | Using libvirt version 6000000

	I1028 13:09:20.334358  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.334708  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.334738  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.334885  862106 main.go:141] libmachine: Docker is up and running!

	I1028 13:09:20.334902  862106 main.go:141] libmachine: Reticulating splines...

	I1028 13:09:20.334910  862106 client.go:171] duration metric: took 24.838873329s to LocalClient.Create

	I1028 13:09:20.334939  862106 start.go:167] duration metric: took 24.838947558s to libmachine.API.Create "ha-798963"

	I1028 13:09:20.334953  862106 start.go:293] postStartSetup for "ha-798963" (driver="kvm2")

	I1028 13:09:20.334965  862106 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1028 13:09:20.334985  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.335336  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1028 13:09:20.335366  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.337911  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.338253  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.338276  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.338457  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.338716  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.338919  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.339098  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.422233  862106 ssh_runner.go:195] Run: cat /etc/os-release

	I1028 13:09:20.426489  862106 info.go:137] Remote host: Buildroot 2023.02.9

	I1028 13:09:20.426523  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/addons for local assets ...

	I1028 13:09:20.426601  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/files for local assets ...

	I1028 13:09:20.426728  862106 filesync.go:149] local asset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> 8470622.pem in /etc/ssl/certs

	I1028 13:09:20.426747  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /etc/ssl/certs/8470622.pem

	I1028 13:09:20.426887  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1028 13:09:20.436333  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:09:20.462007  862106 start.go:296] duration metric: took 127.035486ms for postStartSetup

	I1028 13:09:20.462077  862106 main.go:141] libmachine: (ha-798963) Calling .GetConfigRaw

	I1028 13:09:20.462723  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:20.465600  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.465974  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.466013  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.466234  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:09:20.466443  862106 start.go:128] duration metric: took 24.990541312s to createHost

	I1028 13:09:20.466470  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.468887  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.469391  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.469420  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.469677  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.469912  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.470079  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.470250  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.470488  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:09:20.470723  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.179 22 <nil> <nil>}

	I1028 13:09:20.470765  862106 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1028 13:09:20.576433  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730120960.555377796

	I1028 13:09:20.576471  862106 fix.go:216] guest clock: 1730120960.555377796

	I1028 13:09:20.576484  862106 fix.go:229] Guest: 2024-10-28 13:09:20.555377796 +0000 UTC Remote: 2024-10-28 13:09:20.466457798 +0000 UTC m=+25.112511060 (delta=88.919998ms)

	I1028 13:09:20.576517  862106 fix.go:200] guest clock delta is within tolerance: 88.919998ms

	I1028 13:09:20.576525  862106 start.go:83] releasing machines lock for "ha-798963", held for 25.100750756s

	I1028 13:09:20.576549  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.576859  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:20.579943  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.580302  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.580333  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.580518  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.580966  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.581142  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:20.581247  862106 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1028 13:09:20.581328  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.581399  862106 ssh_runner.go:195] Run: cat /version.json

	I1028 13:09:20.581428  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:20.584211  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584263  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584590  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.584635  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584678  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:20.584700  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:20.584799  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.584973  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.585103  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:20.585242  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:20.585249  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.585473  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:20.585483  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.585582  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:20.660496  862106 ssh_runner.go:195] Run: systemctl --version

	I1028 13:09:20.694123  862106 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1028 13:09:20.855514  862106 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1028 13:09:20.861807  862106 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1028 13:09:20.861875  862106 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1028 13:09:20.877941  862106 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1028 13:09:20.877968  862106 start.go:495] detecting cgroup driver to use...

	I1028 13:09:20.878035  862106 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1028 13:09:20.893964  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1028 13:09:20.909067  862106 docker.go:217] disabling cri-docker service (if available) ...

	I1028 13:09:20.909138  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1028 13:09:20.922578  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1028 13:09:20.936106  862106 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1028 13:09:21.050986  862106 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1028 13:09:21.194453  862106 docker.go:233] disabling docker service ...

	I1028 13:09:21.194538  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1028 13:09:21.208683  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1028 13:09:21.221205  862106 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1028 13:09:21.354881  862106 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1028 13:09:21.489372  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1028 13:09:21.502821  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1028 13:09:21.520866  862106 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I1028 13:09:21.520931  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.531395  862106 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1028 13:09:21.531480  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.541782  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.551820  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.561848  862106 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1028 13:09:21.572350  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.582219  862106 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.598641  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:09:21.608821  862106 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1028 13:09:21.618174  862106 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1028 13:09:21.618247  862106 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1028 13:09:21.630845  862106 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1028 13:09:21.640219  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:09:21.757889  862106 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1028 13:09:21.845787  862106 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I1028 13:09:21.845872  862106 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1028 13:09:21.850845  862106 start.go:563] Will wait 60s for crictl version

	I1028 13:09:21.850902  862106 ssh_runner.go:195] Run: which crictl

	I1028 13:09:21.854415  862106 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1028 13:09:21.893000  862106 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I1028 13:09:21.893081  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:09:21.920604  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:09:21.950947  862106 out.go:177] * Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	I1028 13:09:21.952359  862106 main.go:141] libmachine: (ha-798963) Calling .GetIP

	I1028 13:09:21.955372  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:21.955825  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:21.955844  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:21.956168  862106 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I1028 13:09:21.960053  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:09:21.972723  862106 kubeadm.go:883] updating cluster {Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Cl

usterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I1028 13:09:21.972844  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:09:21.972886  862106 ssh_runner.go:195] Run: sudo crictl images --output json

	I1028 13:09:22.004515  862106 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.31.2". assuming images are not preloaded.

	I1028 13:09:22.004587  862106 ssh_runner.go:195] Run: which lz4

	I1028 13:09:22.008152  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I1028 13:09:22.008271  862106 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I1028 13:09:22.012016  862106 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I1028 13:09:22.012053  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (392059347 bytes)

	I1028 13:09:23.241520  862106 crio.go:462] duration metric: took 1.233279918s to copy over tarball

	I1028 13:09:23.241597  862106 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I1028 13:09:25.333757  862106 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.092116025s)

	I1028 13:09:25.333855  862106 crio.go:469] duration metric: took 2.092292987s to extract the tarball

	I1028 13:09:25.333890  862106 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I1028 13:09:25.370210  862106 ssh_runner.go:195] Run: sudo crictl images --output json

	I1028 13:09:25.426062  862106 crio.go:514] all images are preloaded for cri-o runtime.

	I1028 13:09:25.426086  862106 cache_images.go:84] Images are preloaded, skipping loading

	I1028 13:09:25.426095  862106 kubeadm.go:934] updating node { 192.168.39.179 8443 v1.31.2 crio true true} ...

	I1028 13:09:25.426197  862106 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-798963 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.179

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1028 13:09:25.426265  862106 ssh_runner.go:195] Run: crio config

	I1028 13:09:25.479768  862106 cni.go:84] Creating CNI manager for ""

	I1028 13:09:25.479795  862106 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I1028 13:09:25.479808  862106 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I1028 13:09:25.479839  862106 kubeadm.go:189] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.179 APIServerPort:8443 KubernetesVersion:v1.31.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-798963 NodeName:ha-798963 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.179"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.179 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I1028 13:09:25.480019  862106 kubeadm.go:195] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.179

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-798963"

	  kubeletExtraArgs:

	    - name: "node-ip"

	      value: "192.168.39.179"

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta4

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.179"]

	  extraArgs:

	    - name: "enable-admission-plugins"

	      value: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    - name: "allocate-node-cidrs"

	      value: "true"

	    - name: "leader-elect"

	      value: "false"

	scheduler:

	  extraArgs:

	    - name: "leader-elect"

	      value: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      - name: "proxy-refresh-interval"

	        value: "70000"

	kubernetesVersion: v1.31.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I1028 13:09:25.480044  862106 kube-vip.go:115] generating kube-vip config ...

	I1028 13:09:25.480089  862106 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I1028 13:09:25.497899  862106 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I1028 13:09:25.498047  862106 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.4

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I1028 13:09:25.498116  862106 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1028 13:09:25.508120  862106 binaries.go:44] Found k8s binaries, skipping transfer

	I1028 13:09:25.508192  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I1028 13:09:25.517434  862106 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I1028 13:09:25.533166  862106 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1028 13:09:25.550308  862106 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2289 bytes)

	I1028 13:09:25.566379  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I1028 13:09:25.582510  862106 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I1028 13:09:25.586249  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:09:25.598206  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:09:25.723625  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:09:25.741116  862106 certs.go:68] Setting up /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963 for IP: 192.168.39.179

	I1028 13:09:25.741148  862106 certs.go:194] generating shared ca certs ...

	I1028 13:09:25.741175  862106 certs.go:226] acquiring lock for ca certs: {Name:mk72dd610cd229d2e25ba7be15f7e5f7b195435a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:25.741384  862106 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key

	I1028 13:09:25.741443  862106 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key

	I1028 13:09:25.741456  862106 certs.go:256] generating profile certs ...

	I1028 13:09:25.741552  862106 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key

	I1028 13:09:25.741573  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt with IP's: []

	I1028 13:09:26.090079  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt ...

	I1028 13:09:26.090117  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt: {Name:mk3fe8f323d83f4ebd84a8d786303da577fe6766 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.090331  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key ...

	I1028 13:09:26.090348  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key: {Name:mk594d3d79345e53ffa841fb25dd9e698fdb4fdf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.090459  862106 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762

	I1028 13:09:26.090478  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.179 192.168.39.254]

	I1028 13:09:26.298909  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762 ...

	I1028 13:09:26.298948  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762: {Name:mka9a8156a429a9cb509b5b1fc05a7fdfb56c428 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.299159  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762 ...

	I1028 13:09:26.299178  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762: {Name:mke17162bd0b6171ceec8286f5ff7299dd69297a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.299286  862106 certs.go:381] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.0e4e1762 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt

	I1028 13:09:26.299386  862106 certs.go:385] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.0e4e1762 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key

	I1028 13:09:26.299438  862106 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key

	I1028 13:09:26.299456  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt with IP's: []

	I1028 13:09:26.376199  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt ...

	I1028 13:09:26.376234  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt: {Name:mk48e71bedfedfcf6c26ee161c72f8db6a8d385d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.376440  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key ...

	I1028 13:09:26.376460  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key: {Name:mkf9647dc083a6381ed0c40db86a25190abd9cfc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:26.376564  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1028 13:09:26.376586  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1028 13:09:26.376598  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1028 13:09:26.376608  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1028 13:09:26.376621  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1028 13:09:26.376632  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1028 13:09:26.376643  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1028 13:09:26.376658  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1028 13:09:26.376716  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem (1338 bytes)

	W1028 13:09:26.376755  862106 certs.go:480] ignoring /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062_empty.pem, impossibly tiny 0 bytes

	I1028 13:09:26.376767  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem (1679 bytes)

	I1028 13:09:26.376788  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem (1082 bytes)

	I1028 13:09:26.376810  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem (1123 bytes)

	I1028 13:09:26.376834  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem (1679 bytes)

	I1028 13:09:26.376869  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:09:26.376896  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.376912  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.376923  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem -> /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.377540  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1028 13:09:26.404102  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1028 13:09:26.429065  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1028 13:09:26.452305  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1028 13:09:26.475399  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I1028 13:09:26.502257  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I1028 13:09:26.524571  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1028 13:09:26.547735  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1028 13:09:26.570342  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /usr/share/ca-certificates/8470622.pem (1708 bytes)

	I1028 13:09:26.592362  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1028 13:09:26.614638  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem --> /usr/share/ca-certificates/847062.pem (1338 bytes)

	I1028 13:09:26.638083  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I1028 13:09:26.655519  862106 ssh_runner.go:195] Run: openssl version

	I1028 13:09:26.661194  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8470622.pem && ln -fs /usr/share/ca-certificates/8470622.pem /etc/ssl/certs/8470622.pem"

	I1028 13:09:26.672564  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.677254  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 13:01 /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.677324  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8470622.pem

	I1028 13:09:26.683486  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8470622.pem /etc/ssl/certs/3ec20f2e.0"

	I1028 13:09:26.694953  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1028 13:09:26.706214  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.710632  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:21 /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.710703  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:09:26.716613  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1028 13:09:26.729112  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/847062.pem && ln -fs /usr/share/ca-certificates/847062.pem /etc/ssl/certs/847062.pem"

	I1028 13:09:26.739953  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.744420  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 13:01 /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.744500  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/847062.pem

	I1028 13:09:26.750083  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/847062.pem /etc/ssl/certs/51391683.0"

	I1028 13:09:26.760868  862106 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1028 13:09:26.764911  862106 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1028 13:09:26.764981  862106 kubeadm.go:392] StartCluster: {Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Clust

erName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 13:09:26.765061  862106 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I1028 13:09:26.765135  862106 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I1028 13:09:26.806599  862106 cri.go:89] found id: ""

	I1028 13:09:26.806689  862106 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I1028 13:09:26.816715  862106 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I1028 13:09:26.828480  862106 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I1028 13:09:26.839134  862106 kubeadm.go:155] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I1028 13:09:26.839173  862106 kubeadm.go:157] found existing configuration files:

	I1028 13:09:26.839222  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I1028 13:09:26.853826  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I1028 13:09:26.853915  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I1028 13:09:26.865744  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I1028 13:09:26.875021  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I1028 13:09:26.875114  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I1028 13:09:26.884628  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I1028 13:09:26.894266  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I1028 13:09:26.894337  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I1028 13:09:26.904159  862106 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I1028 13:09:26.913908  862106 kubeadm.go:163] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I1028 13:09:26.913976  862106 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I1028 13:09:26.923694  862106 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I1028 13:09:27.043881  862106 kubeadm.go:310] [init] Using Kubernetes version: v1.31.2

	I1028 13:09:27.044005  862106 kubeadm.go:310] [preflight] Running pre-flight checks

	I1028 13:09:27.141924  862106 kubeadm.go:310] [preflight] Pulling images required for setting up a Kubernetes cluster

	I1028 13:09:27.142065  862106 kubeadm.go:310] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I1028 13:09:27.142222  862106 kubeadm.go:310] [preflight] You can also perform this action beforehand using 'kubeadm config images pull'

	I1028 13:09:27.150765  862106 kubeadm.go:310] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I1028 13:09:27.244897  862106 out.go:235]   - Generating certificates and keys ...

	I1028 13:09:27.245109  862106 kubeadm.go:310] [certs] Using existing ca certificate authority

	I1028 13:09:27.245229  862106 kubeadm.go:310] [certs] Using existing apiserver certificate and key on disk

	I1028 13:09:27.499100  862106 kubeadm.go:310] [certs] Generating "apiserver-kubelet-client" certificate and key

	I1028 13:09:27.698770  862106 kubeadm.go:310] [certs] Generating "front-proxy-ca" certificate and key

	I1028 13:09:27.943509  862106 kubeadm.go:310] [certs] Generating "front-proxy-client" certificate and key

	I1028 13:09:28.169621  862106 kubeadm.go:310] [certs] Generating "etcd/ca" certificate and key

	I1028 13:09:28.268655  862106 kubeadm.go:310] [certs] Generating "etcd/server" certificate and key

	I1028 13:09:28.268883  862106 kubeadm.go:310] [certs] etcd/server serving cert is signed for DNS names [ha-798963 localhost] and IPs [192.168.39.179 127.0.0.1 ::1]

	I1028 13:09:28.417767  862106 kubeadm.go:310] [certs] Generating "etcd/peer" certificate and key

	I1028 13:09:28.417980  862106 kubeadm.go:310] [certs] etcd/peer serving cert is signed for DNS names [ha-798963 localhost] and IPs [192.168.39.179 127.0.0.1 ::1]

	I1028 13:09:28.562634  862106 kubeadm.go:310] [certs] Generating "etcd/healthcheck-client" certificate and key

	I1028 13:09:28.610851  862106 kubeadm.go:310] [certs] Generating "apiserver-etcd-client" certificate and key

	I1028 13:09:28.789581  862106 kubeadm.go:310] [certs] Generating "sa" key and public key

	I1028 13:09:28.789681  862106 kubeadm.go:310] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I1028 13:09:28.942051  862106 kubeadm.go:310] [kubeconfig] Writing "admin.conf" kubeconfig file

	I1028 13:09:28.989198  862106 kubeadm.go:310] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I1028 13:09:29.060675  862106 kubeadm.go:310] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I1028 13:09:29.244777  862106 kubeadm.go:310] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I1028 13:09:29.323710  862106 kubeadm.go:310] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I1028 13:09:29.324392  862106 kubeadm.go:310] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I1028 13:09:29.328114  862106 kubeadm.go:310] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I1028 13:09:29.398030  862106 out.go:235]   - Booting up control plane ...

	I1028 13:09:29.398228  862106 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I1028 13:09:29.398317  862106 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I1028 13:09:29.398410  862106 kubeadm.go:310] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I1028 13:09:29.398547  862106 kubeadm.go:310] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I1028 13:09:29.398661  862106 kubeadm.go:310] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I1028 13:09:29.398724  862106 kubeadm.go:310] [kubelet-start] Starting the kubelet

	I1028 13:09:29.492878  862106 kubeadm.go:310] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I1028 13:09:29.493016  862106 kubeadm.go:310] [kubelet-check] Waiting for a healthy kubelet at http://127.0.0.1:10248/healthz. This can take up to 4m0s

	I1028 13:09:30.496631  862106 kubeadm.go:310] [kubelet-check] The kubelet is healthy after 1.003906465s

	I1028 13:09:30.496785  862106 kubeadm.go:310] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I1028 13:09:36.131691  862106 kubeadm.go:310] [api-check] The API server is healthy after 5.638328993s

	I1028 13:09:36.143587  862106 kubeadm.go:310] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I1028 13:09:36.167327  862106 kubeadm.go:310] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I1028 13:09:36.705076  862106 kubeadm.go:310] [upload-certs] Skipping phase. Please see --upload-certs

	I1028 13:09:36.705277  862106 kubeadm.go:310] [mark-control-plane] Marking the node ha-798963 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I1028 13:09:36.719563  862106 kubeadm.go:310] [bootstrap-token] Using token: kgbmv9.ae55kcr18658q9sr

	I1028 13:09:36.721301  862106 out.go:235]   - Configuring RBAC rules ...

	I1028 13:09:36.721464  862106 kubeadm.go:310] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I1028 13:09:36.732132  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I1028 13:09:36.740506  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I1028 13:09:36.748255  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I1028 13:09:36.752567  862106 kubeadm.go:310] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I1028 13:09:36.756467  862106 kubeadm.go:310] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I1028 13:09:36.773978  862106 kubeadm.go:310] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I1028 13:09:37.042262  862106 kubeadm.go:310] [addons] Applied essential addon: CoreDNS

	I1028 13:09:37.540410  862106 kubeadm.go:310] [addons] Applied essential addon: kube-proxy

	I1028 13:09:37.540992  862106 kubeadm.go:310] 

	I1028 13:09:37.541101  862106 kubeadm.go:310] Your Kubernetes control-plane has initialized successfully!

	I1028 13:09:37.541114  862106 kubeadm.go:310] 

	I1028 13:09:37.541220  862106 kubeadm.go:310] To start using your cluster, you need to run the following as a regular user:

	I1028 13:09:37.541251  862106 kubeadm.go:310] 

	I1028 13:09:37.541299  862106 kubeadm.go:310]   mkdir -p $HOME/.kube

	I1028 13:09:37.541388  862106 kubeadm.go:310]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I1028 13:09:37.541482  862106 kubeadm.go:310]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I1028 13:09:37.541504  862106 kubeadm.go:310] 

	I1028 13:09:37.541582  862106 kubeadm.go:310] Alternatively, if you are the root user, you can run:

	I1028 13:09:37.541592  862106 kubeadm.go:310] 

	I1028 13:09:37.541666  862106 kubeadm.go:310]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I1028 13:09:37.541674  862106 kubeadm.go:310] 

	I1028 13:09:37.541745  862106 kubeadm.go:310] You should now deploy a pod network to the cluster.

	I1028 13:09:37.541863  862106 kubeadm.go:310] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I1028 13:09:37.541958  862106 kubeadm.go:310]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I1028 13:09:37.541968  862106 kubeadm.go:310] 

	I1028 13:09:37.542123  862106 kubeadm.go:310] You can now join any number of control-plane nodes by copying certificate authorities

	I1028 13:09:37.542224  862106 kubeadm.go:310] and service account keys on each node and then running the following as root:

	I1028 13:09:37.542238  862106 kubeadm.go:310] 

	I1028 13:09:37.542402  862106 kubeadm.go:310]   kubeadm join control-plane.minikube.internal:8443 --token kgbmv9.ae55kcr18658q9sr \

	I1028 13:09:37.542555  862106 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d \

	I1028 13:09:37.542587  862106 kubeadm.go:310] 	--control-plane 

	I1028 13:09:37.542597  862106 kubeadm.go:310] 

	I1028 13:09:37.542725  862106 kubeadm.go:310] Then you can join any number of worker nodes by running the following on each as root:

	I1028 13:09:37.542740  862106 kubeadm.go:310] 

	I1028 13:09:37.542842  862106 kubeadm.go:310] kubeadm join control-plane.minikube.internal:8443 --token kgbmv9.ae55kcr18658q9sr \

	I1028 13:09:37.542970  862106 kubeadm.go:310] 	--discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d 

	I1028 13:09:37.543223  862106 kubeadm.go:310] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I1028 13:09:37.543397  862106 cni.go:84] Creating CNI manager for ""

	I1028 13:09:37.543415  862106 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I1028 13:09:37.544963  862106 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I1028 13:09:37.546271  862106 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I1028 13:09:37.551746  862106 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.31.2/kubectl ...

	I1028 13:09:37.551777  862106 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2601 bytes)

	I1028 13:09:37.570362  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I1028 13:09:37.946277  862106 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I1028 13:09:37.946412  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:37.946428  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-798963 minikube.k8s.io/updated_at=2024_10_28T13_09_37_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=ha-798963 minikube.k8s.io/primary=true

	I1028 13:09:37.968277  862106 ops.go:34] apiserver oom_adj: -16

	I1028 13:09:38.075833  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:38.576438  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:39.076418  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:39.575915  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:40.076165  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:40.576271  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:41.076897  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I1028 13:09:41.218170  862106 kubeadm.go:1113] duration metric: took 3.271834134s to wait for elevateKubeSystemPrivileges

	I1028 13:09:41.218217  862106 kubeadm.go:394] duration metric: took 14.453243119s to StartCluster

	I1028 13:09:41.218245  862106 settings.go:142] acquiring lock: {Name:mk5bff38fc6565138d7b896c5c59f693f2cf271a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:41.218339  862106 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:09:41.219153  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/kubeconfig: {Name:mk593b26e38c75daf24e9303475967cc0bb4e68e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:09:41.219425  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I1028 13:09:41.219424  862106 start.go:233] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:09:41.219455  862106 addons.go:507] enable addons start: toEnable=map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I1028 13:09:41.219528  862106 start.go:241] waiting for startup goroutines ...

	I1028 13:09:41.219543  862106 addons.go:69] Setting storage-provisioner=true in profile "ha-798963"

	I1028 13:09:41.219550  862106 addons.go:69] Setting default-storageclass=true in profile "ha-798963"

	I1028 13:09:41.219560  862106 addons.go:234] Setting addon storage-provisioner=true in "ha-798963"

	I1028 13:09:41.219567  862106 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-798963"

	I1028 13:09:41.219628  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:09:41.219692  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:09:41.220097  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.220112  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.220137  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.220157  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.236056  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39907

	I1028 13:09:41.236463  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38395

	I1028 13:09:41.236704  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.237039  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.237367  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.237401  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.237626  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.237656  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.237798  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.238003  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:41.238051  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.238694  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.238740  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.240433  862106 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:09:41.240801  862106 kapi.go:59] client config for ha-798963: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt", KeyFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key", CAFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2439ec0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I1028 13:09:41.241435  862106 cert_rotation.go:140] Starting client certificate rotation controller

	I1028 13:09:41.241785  862106 addons.go:234] Setting addon default-storageclass=true in "ha-798963"

	I1028 13:09:41.241838  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:09:41.242237  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.242292  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.254961  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34867

	I1028 13:09:41.255498  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.256018  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.256045  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.256430  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.256630  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:41.258371  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:41.258588  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38285

	I1028 13:09:41.259011  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.259612  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.259632  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.259998  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.260479  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:41.260516  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:41.260639  862106 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I1028 13:09:41.262432  862106 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I1028 13:09:41.262456  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I1028 13:09:41.262479  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:41.266164  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.266666  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:41.266696  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.266845  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:41.267068  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:41.267293  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:41.267456  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:41.276996  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34343

	I1028 13:09:41.277475  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:41.278089  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:41.278117  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:41.278572  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:41.278776  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:09:41.280502  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:09:41.280724  862106 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I1028 13:09:41.280740  862106 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I1028 13:09:41.280756  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:09:41.283816  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.284254  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:09:41.284286  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:09:41.284617  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:09:41.284805  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:09:41.285005  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:09:41.285162  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:09:41.396479  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I1028 13:09:41.465351  862106 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I1028 13:09:41.548766  862106 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.31.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I1028 13:09:41.969520  862106 start.go:971] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I1028 13:09:42.113999  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114028  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114061  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114079  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114389  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114405  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114405  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114422  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114431  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114439  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114413  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.114490  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.114678  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114691  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114769  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.114784  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.114802  862106 main.go:141] libmachine: (ha-798963) DBG | Closing plugin on server side

	I1028 13:09:42.114859  862106 envvar.go:172] "Feature gate default state" feature="WatchListClient" enabled=false

	I1028 13:09:42.114879  862106 envvar.go:172] "Feature gate default state" feature="InformerResourceVersion" enabled=false

	I1028 13:09:42.114995  862106 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I1028 13:09:42.115007  862106 round_trippers.go:469] Request Headers:

	I1028 13:09:42.115018  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:09:42.115023  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:09:42.128731  862106 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I1028 13:09:42.129399  862106 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I1028 13:09:42.129419  862106 round_trippers.go:469] Request Headers:

	I1028 13:09:42.129430  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:09:42.129435  862106 round_trippers.go:473]     Content-Type: application/json

	I1028 13:09:42.129438  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:09:42.134236  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:09:42.134438  862106 main.go:141] libmachine: Making call to close driver server

	I1028 13:09:42.134455  862106 main.go:141] libmachine: (ha-798963) Calling .Close

	I1028 13:09:42.134740  862106 main.go:141] libmachine: Successfully made call to close driver server

	I1028 13:09:42.134761  862106 main.go:141] libmachine: Making call to close connection to plugin binary

	I1028 13:09:42.137374  862106 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I1028 13:09:42.138538  862106 addons.go:510] duration metric: took 919.086468ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I1028 13:09:42.138580  862106 start.go:246] waiting for cluster config update ...

	I1028 13:09:42.138591  862106 start.go:255] writing updated cluster config ...

	I1028 13:09:42.140177  862106 out.go:201] 

	I1028 13:09:42.141615  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:09:42.141708  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:09:42.143352  862106 out.go:177] * Starting "ha-798963-m02" control-plane node in "ha-798963" cluster

	I1028 13:09:42.144914  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:09:42.144949  862106 cache.go:56] Caching tarball of preloaded images

	I1028 13:09:42.145078  862106 preload.go:172] Found /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I1028 13:09:42.145094  862106 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on crio

	I1028 13:09:42.145207  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:09:42.145441  862106 start.go:360] acquireMachinesLock for ha-798963-m02: {Name:mk3d8412df30fd3411bfb6262eb0fa70b21bf365 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1028 13:09:42.145510  862106 start.go:364] duration metric: took 40.785µs to acquireMachinesLock for "ha-798963-m02"

	I1028 13:09:42.145535  862106 start.go:93] Provisioning new machine with config: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:09:42.145645  862106 start.go:125] createHost starting for "m02" (driver="kvm2")

	I1028 13:09:42.147354  862106 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1028 13:09:42.147462  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:09:42.147504  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:09:42.164067  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33725

	I1028 13:09:42.164521  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:09:42.165132  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:09:42.165155  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:09:42.165511  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:09:42.165741  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:09:42.165883  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:09:42.166026  862106 start.go:159] libmachine.API.Create for "ha-798963" (driver="kvm2")

	I1028 13:09:42.166059  862106 client.go:168] LocalClient.Create starting

	I1028 13:09:42.166097  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem

	I1028 13:09:42.166139  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:09:42.166160  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:09:42.166238  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem

	I1028 13:09:42.166264  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:09:42.166282  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:09:42.166308  862106 main.go:141] libmachine: Running pre-create checks...

	I1028 13:09:42.166318  862106 main.go:141] libmachine: (ha-798963-m02) Calling .PreCreateCheck

	I1028 13:09:42.166546  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetConfigRaw

	I1028 13:09:42.166906  862106 main.go:141] libmachine: Creating machine...

	I1028 13:09:42.166917  862106 main.go:141] libmachine: (ha-798963-m02) Calling .Create

	I1028 13:09:42.167085  862106 main.go:141] libmachine: (ha-798963-m02) Creating KVM machine...

	I1028 13:09:42.168461  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found existing default KVM network

	I1028 13:09:42.168637  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found existing private KVM network mk-ha-798963

	I1028 13:09:42.168780  862106 main.go:141] libmachine: (ha-798963-m02) Setting up store path in /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02 ...

	I1028 13:09:42.168806  862106 main.go:141] libmachine: (ha-798963-m02) Building disk image from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso

	I1028 13:09:42.168902  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.168755  862476 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:09:42.168994  862106 main.go:141] libmachine: (ha-798963-m02) Downloading /home/jenkins/minikube-integration/19865-839778/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...

	I1028 13:09:42.452358  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.452201  862476 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa...

	I1028 13:09:42.765216  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.765047  862476 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/ha-798963-m02.rawdisk...

	I1028 13:09:42.765250  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Writing magic tar header

	I1028 13:09:42.765265  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Writing SSH key tar header

	I1028 13:09:42.765276  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:42.765165  862476 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02 ...

	I1028 13:09:42.765289  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02 (perms=drwx------)

	I1028 13:09:42.765302  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02

	I1028 13:09:42.765319  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines

	I1028 13:09:42.765337  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:09:42.765349  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines (perms=drwxr-xr-x)

	I1028 13:09:42.765360  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube (perms=drwxr-xr-x)

	I1028 13:09:42.765380  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778

	I1028 13:09:42.765390  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I1028 13:09:42.765402  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home/jenkins

	I1028 13:09:42.765412  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Checking permissions on dir: /home

	I1028 13:09:42.765420  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Skipping /home - not owner

	I1028 13:09:42.765434  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778 (perms=drwxrwxr-x)

	I1028 13:09:42.765475  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I1028 13:09:42.765508  862106 main.go:141] libmachine: (ha-798963-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I1028 13:09:42.765528  862106 main.go:141] libmachine: (ha-798963-m02) Creating domain...

	I1028 13:09:42.766384  862106 main.go:141] libmachine: (ha-798963-m02) define libvirt domain using xml: 

	I1028 13:09:42.766405  862106 main.go:141] libmachine: (ha-798963-m02) <domain type='kvm'>

	I1028 13:09:42.766414  862106 main.go:141] libmachine: (ha-798963-m02)   <name>ha-798963-m02</name>

	I1028 13:09:42.766422  862106 main.go:141] libmachine: (ha-798963-m02)   <memory unit='MiB'>2200</memory>

	I1028 13:09:42.766437  862106 main.go:141] libmachine: (ha-798963-m02)   <vcpu>2</vcpu>

	I1028 13:09:42.766446  862106 main.go:141] libmachine: (ha-798963-m02)   <features>

	I1028 13:09:42.766451  862106 main.go:141] libmachine: (ha-798963-m02)     <acpi/>

	I1028 13:09:42.766455  862106 main.go:141] libmachine: (ha-798963-m02)     <apic/>

	I1028 13:09:42.766460  862106 main.go:141] libmachine: (ha-798963-m02)     <pae/>

	I1028 13:09:42.766466  862106 main.go:141] libmachine: (ha-798963-m02)     

	I1028 13:09:42.766471  862106 main.go:141] libmachine: (ha-798963-m02)   </features>

	I1028 13:09:42.766481  862106 main.go:141] libmachine: (ha-798963-m02)   <cpu mode='host-passthrough'>

	I1028 13:09:42.766491  862106 main.go:141] libmachine: (ha-798963-m02)   

	I1028 13:09:42.766506  862106 main.go:141] libmachine: (ha-798963-m02)   </cpu>

	I1028 13:09:42.766518  862106 main.go:141] libmachine: (ha-798963-m02)   <os>

	I1028 13:09:42.766527  862106 main.go:141] libmachine: (ha-798963-m02)     <type>hvm</type>

	I1028 13:09:42.766533  862106 main.go:141] libmachine: (ha-798963-m02)     <boot dev='cdrom'/>

	I1028 13:09:42.766540  862106 main.go:141] libmachine: (ha-798963-m02)     <boot dev='hd'/>

	I1028 13:09:42.766545  862106 main.go:141] libmachine: (ha-798963-m02)     <bootmenu enable='no'/>

	I1028 13:09:42.766552  862106 main.go:141] libmachine: (ha-798963-m02)   </os>

	I1028 13:09:42.766556  862106 main.go:141] libmachine: (ha-798963-m02)   <devices>

	I1028 13:09:42.766566  862106 main.go:141] libmachine: (ha-798963-m02)     <disk type='file' device='cdrom'>

	I1028 13:09:42.766586  862106 main.go:141] libmachine: (ha-798963-m02)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/boot2docker.iso'/>

	I1028 13:09:42.766601  862106 main.go:141] libmachine: (ha-798963-m02)       <target dev='hdc' bus='scsi'/>

	I1028 13:09:42.766609  862106 main.go:141] libmachine: (ha-798963-m02)       <readonly/>

	I1028 13:09:42.766616  862106 main.go:141] libmachine: (ha-798963-m02)     </disk>

	I1028 13:09:42.766628  862106 main.go:141] libmachine: (ha-798963-m02)     <disk type='file' device='disk'>

	I1028 13:09:42.766638  862106 main.go:141] libmachine: (ha-798963-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I1028 13:09:42.766646  862106 main.go:141] libmachine: (ha-798963-m02)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/ha-798963-m02.rawdisk'/>

	I1028 13:09:42.766653  862106 main.go:141] libmachine: (ha-798963-m02)       <target dev='hda' bus='virtio'/>

	I1028 13:09:42.766661  862106 main.go:141] libmachine: (ha-798963-m02)     </disk>

	I1028 13:09:42.766672  862106 main.go:141] libmachine: (ha-798963-m02)     <interface type='network'>

	I1028 13:09:42.766690  862106 main.go:141] libmachine: (ha-798963-m02)       <source network='mk-ha-798963'/>

	I1028 13:09:42.766706  862106 main.go:141] libmachine: (ha-798963-m02)       <model type='virtio'/>

	I1028 13:09:42.766714  862106 main.go:141] libmachine: (ha-798963-m02)     </interface>

	I1028 13:09:42.766721  862106 main.go:141] libmachine: (ha-798963-m02)     <interface type='network'>

	I1028 13:09:42.766727  862106 main.go:141] libmachine: (ha-798963-m02)       <source network='default'/>

	I1028 13:09:42.766734  862106 main.go:141] libmachine: (ha-798963-m02)       <model type='virtio'/>

	I1028 13:09:42.766741  862106 main.go:141] libmachine: (ha-798963-m02)     </interface>

	I1028 13:09:42.766751  862106 main.go:141] libmachine: (ha-798963-m02)     <serial type='pty'>

	I1028 13:09:42.766768  862106 main.go:141] libmachine: (ha-798963-m02)       <target port='0'/>

	I1028 13:09:42.766779  862106 main.go:141] libmachine: (ha-798963-m02)     </serial>

	I1028 13:09:42.766787  862106 main.go:141] libmachine: (ha-798963-m02)     <console type='pty'>

	I1028 13:09:42.766801  862106 main.go:141] libmachine: (ha-798963-m02)       <target type='serial' port='0'/>

	I1028 13:09:42.766837  862106 main.go:141] libmachine: (ha-798963-m02)     </console>

	I1028 13:09:42.766863  862106 main.go:141] libmachine: (ha-798963-m02)     <rng model='virtio'>

	I1028 13:09:42.766874  862106 main.go:141] libmachine: (ha-798963-m02)       <backend model='random'>/dev/random</backend>

	I1028 13:09:42.766885  862106 main.go:141] libmachine: (ha-798963-m02)     </rng>

	I1028 13:09:42.766896  862106 main.go:141] libmachine: (ha-798963-m02)     

	I1028 13:09:42.766903  862106 main.go:141] libmachine: (ha-798963-m02)     

	I1028 13:09:42.766914  862106 main.go:141] libmachine: (ha-798963-m02)   </devices>

	I1028 13:09:42.766920  862106 main.go:141] libmachine: (ha-798963-m02) </domain>

	I1028 13:09:42.766933  862106 main.go:141] libmachine: (ha-798963-m02) 

	I1028 13:09:42.773696  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:40:c9:62 in network default

	I1028 13:09:42.774241  862106 main.go:141] libmachine: (ha-798963-m02) Ensuring networks are active...

	I1028 13:09:42.774266  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:42.774978  862106 main.go:141] libmachine: (ha-798963-m02) Ensuring network default is active

	I1028 13:09:42.775278  862106 main.go:141] libmachine: (ha-798963-m02) Ensuring network mk-ha-798963 is active

	I1028 13:09:42.775572  862106 main.go:141] libmachine: (ha-798963-m02) Getting domain xml...

	I1028 13:09:42.776198  862106 main.go:141] libmachine: (ha-798963-m02) Creating domain...

	I1028 13:09:44.020748  862106 main.go:141] libmachine: (ha-798963-m02) Waiting to get IP...

	I1028 13:09:44.021632  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.022163  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.022194  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.022132  862476 retry.go:31] will retry after 254.828705ms: waiting for machine to come up

	I1028 13:09:44.278676  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.279192  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.279219  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.279139  862476 retry.go:31] will retry after 293.737826ms: waiting for machine to come up

	I1028 13:09:44.574780  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.575391  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.575422  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.575359  862476 retry.go:31] will retry after 359.509756ms: waiting for machine to come up

	I1028 13:09:44.936955  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:44.937409  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:44.937440  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:44.937340  862476 retry.go:31] will retry after 582.704584ms: waiting for machine to come up

	I1028 13:09:45.522130  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:45.522569  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:45.522599  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:45.522514  862476 retry.go:31] will retry after 727.740816ms: waiting for machine to come up

	I1028 13:09:46.252326  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:46.252817  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:46.252871  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:46.252779  862476 retry.go:31] will retry after 576.116476ms: waiting for machine to come up

	I1028 13:09:46.830599  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:46.831064  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:46.831091  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:46.831004  862476 retry.go:31] will retry after 959.377706ms: waiting for machine to come up

	I1028 13:09:47.791720  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:47.792294  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:47.792339  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:47.792234  862476 retry.go:31] will retry after 1.298463264s: waiting for machine to come up

	I1028 13:09:49.092707  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:49.093238  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:49.093259  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:49.093213  862476 retry.go:31] will retry after 1.838050456s: waiting for machine to come up

	I1028 13:09:50.934515  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:50.935015  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:50.935049  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:50.934937  862476 retry.go:31] will retry after 2.181424922s: waiting for machine to come up

	I1028 13:09:53.118307  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:53.118775  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:53.118794  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:53.118738  862476 retry.go:31] will retry after 2.226552366s: waiting for machine to come up

	I1028 13:09:55.346560  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:55.346919  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:55.346944  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:55.346874  862476 retry.go:31] will retry after 2.451757382s: waiting for machine to come up

	I1028 13:09:57.799825  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:09:57.800240  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find current IP address of domain ha-798963-m02 in network mk-ha-798963

	I1028 13:09:57.800264  862106 main.go:141] libmachine: (ha-798963-m02) DBG | I1028 13:09:57.800199  862476 retry.go:31] will retry after 4.138330848s: waiting for machine to come up

	I1028 13:10:01.943643  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:01.944310  862106 main.go:141] libmachine: (ha-798963-m02) Found IP for machine: 192.168.39.109

	I1028 13:10:01.944336  862106 main.go:141] libmachine: (ha-798963-m02) Reserving static IP address...

	I1028 13:10:01.944350  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has current primary IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:01.944812  862106 main.go:141] libmachine: (ha-798963-m02) DBG | unable to find host DHCP lease matching {name: "ha-798963-m02", mac: "52:54:00:f9:81:b1", ip: "192.168.39.109"} in network mk-ha-798963

	I1028 13:10:02.029987  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Getting to WaitForSSH function...

	I1028 13:10:02.030107  862106 main.go:141] libmachine: (ha-798963-m02) Reserved static IP address: 192.168.39.109

	I1028 13:10:02.030121  862106 main.go:141] libmachine: (ha-798963-m02) Waiting for SSH to be available...

	I1028 13:10:02.032593  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.033191  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:minikube Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.033225  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.033386  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Using SSH client type: external

	I1028 13:10:02.033412  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa (-rw-------)

	I1028 13:10:02.033473  862106 main.go:141] libmachine: (ha-798963-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.109 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:10:02.033505  862106 main.go:141] libmachine: (ha-798963-m02) DBG | About to run SSH command:

	I1028 13:10:02.033524  862106 main.go:141] libmachine: (ha-798963-m02) DBG | exit 0

	I1028 13:10:02.159978  862106 main.go:141] libmachine: (ha-798963-m02) DBG | SSH cmd err, output: <nil>: 

	I1028 13:10:02.160343  862106 main.go:141] libmachine: (ha-798963-m02) KVM machine creation complete!

	I1028 13:10:02.160622  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetConfigRaw

	I1028 13:10:02.161298  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:02.161540  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:02.161789  862106 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I1028 13:10:02.161807  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetState

	I1028 13:10:02.163343  862106 main.go:141] libmachine: Detecting operating system of created instance...

	I1028 13:10:02.163363  862106 main.go:141] libmachine: Waiting for SSH to be available...

	I1028 13:10:02.163371  862106 main.go:141] libmachine: Getting to WaitForSSH function...

	I1028 13:10:02.163379  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.165920  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.166393  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.166422  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.166641  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.166927  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.167157  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.167302  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.167565  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.167800  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.167813  862106 main.go:141] libmachine: About to run SSH command:

	exit 0

	I1028 13:10:02.279175  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:10:02.279209  862106 main.go:141] libmachine: Detecting the provisioner...

	I1028 13:10:02.279217  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.282405  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.282977  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.283011  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.283246  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.283527  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.283687  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.283846  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.284052  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.284278  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.284292  862106 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I1028 13:10:02.396543  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I1028 13:10:02.396635  862106 main.go:141] libmachine: found compatible host: buildroot

	I1028 13:10:02.396649  862106 main.go:141] libmachine: Provisioning with buildroot...

	I1028 13:10:02.396661  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:10:02.396929  862106 buildroot.go:166] provisioning hostname "ha-798963-m02"

	I1028 13:10:02.396961  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:10:02.397209  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.400037  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.400536  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.400564  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.400805  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.401051  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.401235  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.401358  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.401503  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.401697  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.401713  862106 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-798963-m02 && echo "ha-798963-m02" | sudo tee /etc/hostname

	I1028 13:10:02.526196  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-798963-m02

	I1028 13:10:02.526232  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.529297  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.529789  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.529825  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.530002  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.530231  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.530384  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.530540  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.530717  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.530936  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.530959  862106 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-798963-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-798963-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-798963-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1028 13:10:02.648659  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:10:02.648692  862106 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19865-839778/.minikube CaCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19865-839778/.minikube}

	I1028 13:10:02.648716  862106 buildroot.go:174] setting up certificates

	I1028 13:10:02.648738  862106 provision.go:84] configureAuth start

	I1028 13:10:02.648755  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetMachineName

	I1028 13:10:02.649077  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:02.652321  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.652726  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.652747  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.652918  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.655478  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.655902  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.655927  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.656134  862106 provision.go:143] copyHostCerts

	I1028 13:10:02.656175  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:10:02.656221  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem, removing ...

	I1028 13:10:02.656233  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:10:02.656322  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem (1082 bytes)

	I1028 13:10:02.656424  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:10:02.656447  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem, removing ...

	I1028 13:10:02.656456  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:10:02.656498  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem (1123 bytes)

	I1028 13:10:02.656571  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:10:02.656595  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem, removing ...

	I1028 13:10:02.656605  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:10:02.656630  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem (1679 bytes)

	I1028 13:10:02.656688  862106 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem org=jenkins.ha-798963-m02 san=[127.0.0.1 192.168.39.109 ha-798963-m02 localhost minikube]

	I1028 13:10:02.745309  862106 provision.go:177] copyRemoteCerts

	I1028 13:10:02.745388  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1028 13:10:02.745424  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.748382  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.748733  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.748758  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.749008  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.749206  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.749363  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.749509  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:02.834192  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1028 13:10:02.834275  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1028 13:10:02.857189  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1028 13:10:02.857279  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I1028 13:10:02.880207  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1028 13:10:02.880285  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1028 13:10:02.904157  862106 provision.go:87] duration metric: took 255.399126ms to configureAuth

	I1028 13:10:02.904193  862106 buildroot.go:189] setting minikube options for container-runtime

	I1028 13:10:02.904392  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:02.904473  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:02.907293  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.907679  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:02.907716  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:02.907951  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:02.908497  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.908677  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:02.908898  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:02.909092  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:02.909285  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:02.909307  862106 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1028 13:10:03.150577  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1028 13:10:03.150611  862106 main.go:141] libmachine: Checking connection to Docker...

	I1028 13:10:03.150623  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetURL

	I1028 13:10:03.152282  862106 main.go:141] libmachine: (ha-798963-m02) DBG | Using libvirt version 6000000

	I1028 13:10:03.155208  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.155561  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.155584  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.155858  862106 main.go:141] libmachine: Docker is up and running!

	I1028 13:10:03.155878  862106 main.go:141] libmachine: Reticulating splines...

	I1028 13:10:03.155887  862106 client.go:171] duration metric: took 20.989819122s to LocalClient.Create

	I1028 13:10:03.155918  862106 start.go:167] duration metric: took 20.989892737s to libmachine.API.Create "ha-798963"

	I1028 13:10:03.155930  862106 start.go:293] postStartSetup for "ha-798963-m02" (driver="kvm2")

	I1028 13:10:03.155946  862106 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1028 13:10:03.155971  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.156307  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1028 13:10:03.156334  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:03.159123  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.159559  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.159587  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.159775  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.160057  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.160246  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.160491  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:03.247281  862106 ssh_runner.go:195] Run: cat /etc/os-release

	I1028 13:10:03.251671  862106 info.go:137] Remote host: Buildroot 2023.02.9

	I1028 13:10:03.251700  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/addons for local assets ...

	I1028 13:10:03.251809  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/files for local assets ...

	I1028 13:10:03.251900  862106 filesync.go:149] local asset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> 8470622.pem in /etc/ssl/certs

	I1028 13:10:03.251913  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /etc/ssl/certs/8470622.pem

	I1028 13:10:03.252022  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1028 13:10:03.262254  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:10:03.286390  862106 start.go:296] duration metric: took 130.439166ms for postStartSetup

	I1028 13:10:03.286462  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetConfigRaw

	I1028 13:10:03.287177  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:03.290506  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.290937  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.290965  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.291271  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:10:03.291515  862106 start.go:128] duration metric: took 21.145856579s to createHost

	I1028 13:10:03.291548  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:03.294268  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.294691  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.294729  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.294983  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.295212  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.295448  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.295659  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.295897  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:10:03.296093  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I1028 13:10:03.296108  862106 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1028 13:10:03.412489  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730121003.383137059

	I1028 13:10:03.412521  862106 fix.go:216] guest clock: 1730121003.383137059

	I1028 13:10:03.412532  862106 fix.go:229] Guest: 2024-10-28 13:10:03.383137059 +0000 UTC Remote: 2024-10-28 13:10:03.291536289 +0000 UTC m=+67.937589543 (delta=91.60077ms)

	I1028 13:10:03.412558  862106 fix.go:200] guest clock delta is within tolerance: 91.60077ms

	I1028 13:10:03.412566  862106 start.go:83] releasing machines lock for "ha-798963-m02", held for 21.267041853s

	I1028 13:10:03.412617  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.412957  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:03.415783  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.416155  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.416187  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.418635  862106 out.go:177] * Found network options:

	I1028 13:10:03.420199  862106 out.go:177]   - NO_PROXY=192.168.39.179

	W1028 13:10:03.421452  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:10:03.421492  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.422162  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.422439  862106 main.go:141] libmachine: (ha-798963-m02) Calling .DriverName

	I1028 13:10:03.422563  862106 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I1028 13:10:03.422611  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	W1028 13:10:03.422634  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:10:03.422717  862106 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1028 13:10:03.422740  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHHostname

	I1028 13:10:03.425856  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.425952  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.426170  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.426198  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.426335  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.426401  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:03.426426  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:03.426560  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.426575  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHPort

	I1028 13:10:03.426709  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHKeyPath

	I1028 13:10:03.426770  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.426841  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetSSHUsername

	I1028 13:10:03.426923  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:03.426957  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m02/id_rsa Username:docker}

	I1028 13:10:03.664551  862106 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1028 13:10:03.671238  862106 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1028 13:10:03.671329  862106 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1028 13:10:03.688743  862106 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1028 13:10:03.688773  862106 start.go:495] detecting cgroup driver to use...

	I1028 13:10:03.688856  862106 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1028 13:10:03.706114  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1028 13:10:03.720558  862106 docker.go:217] disabling cri-docker service (if available) ...

	I1028 13:10:03.720634  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1028 13:10:03.736752  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1028 13:10:03.752420  862106 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1028 13:10:03.869419  862106 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1028 13:10:04.021825  862106 docker.go:233] disabling docker service ...

	I1028 13:10:04.021896  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1028 13:10:04.036467  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1028 13:10:04.050574  862106 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1028 13:10:04.161207  862106 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1028 13:10:04.275507  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1028 13:10:04.289594  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1028 13:10:04.308868  862106 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I1028 13:10:04.308947  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.319993  862106 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1028 13:10:04.320070  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.331199  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.342149  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.353484  862106 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1028 13:10:04.364548  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.375783  862106 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.393532  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:10:04.404230  862106 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1028 13:10:04.414432  862106 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1028 13:10:04.414522  862106 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1028 13:10:04.428507  862106 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1028 13:10:04.439205  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:10:04.555728  862106 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1028 13:10:04.650458  862106 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I1028 13:10:04.650533  862106 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1028 13:10:04.655509  862106 start.go:563] Will wait 60s for crictl version

	I1028 13:10:04.655596  862106 ssh_runner.go:195] Run: which crictl

	I1028 13:10:04.659379  862106 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1028 13:10:04.699051  862106 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I1028 13:10:04.699153  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:10:04.732192  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:10:04.763204  862106 out.go:177] * Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	I1028 13:10:04.764801  862106 out.go:177]   - env NO_PROXY=192.168.39.179

	I1028 13:10:04.766295  862106 main.go:141] libmachine: (ha-798963-m02) Calling .GetIP

	I1028 13:10:04.769786  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:04.770065  862106 main.go:141] libmachine: (ha-798963-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:f9:81:b1", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:56 +0000 UTC Type:0 Mac:52:54:00:f9:81:b1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-798963-m02 Clientid:01:52:54:00:f9:81:b1}

	I1028 13:10:04.770091  862106 main.go:141] libmachine: (ha-798963-m02) DBG | domain ha-798963-m02 has defined IP address 192.168.39.109 and MAC address 52:54:00:f9:81:b1 in network mk-ha-798963

	I1028 13:10:04.770315  862106 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I1028 13:10:04.774265  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:10:04.787248  862106 mustload.go:65] Loading cluster: ha-798963

	I1028 13:10:04.787510  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:04.787910  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:04.787969  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:04.803374  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39961

	I1028 13:10:04.803933  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:04.804511  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:04.804543  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:04.804886  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:04.805256  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:10:04.807075  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:10:04.807379  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:04.807423  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:04.822680  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44657

	I1028 13:10:04.823219  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:04.823720  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:04.823747  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:04.824148  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:04.824334  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:10:04.824515  862106 certs.go:68] Setting up /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963 for IP: 192.168.39.109

	I1028 13:10:04.824530  862106 certs.go:194] generating shared ca certs ...

	I1028 13:10:04.824545  862106 certs.go:226] acquiring lock for ca certs: {Name:mk72dd610cd229d2e25ba7be15f7e5f7b195435a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:10:04.824680  862106 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key

	I1028 13:10:04.824717  862106 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key

	I1028 13:10:04.824727  862106 certs.go:256] generating profile certs ...

	I1028 13:10:04.824794  862106 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key

	I1028 13:10:04.824818  862106 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e

	I1028 13:10:04.824831  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.179 192.168.39.109 192.168.39.254]

	I1028 13:10:04.903924  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e ...

	I1028 13:10:04.903956  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e: {Name:mk3302003bd6f00a81bb48c8f525df3fa05a76e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:10:04.904156  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e ...

	I1028 13:10:04.904175  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e: {Name:mk38bc830309cc676ed8c95f6027dd71113302a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:10:04.904278  862106 certs.go:381] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.90e5343e -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt

	I1028 13:10:04.904422  862106 certs.go:385] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.90e5343e -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key

	I1028 13:10:04.904555  862106 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key

	I1028 13:10:04.904572  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1028 13:10:04.904585  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1028 13:10:04.904597  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1028 13:10:04.904609  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1028 13:10:04.904620  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1028 13:10:04.904630  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1028 13:10:04.904643  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1028 13:10:04.904655  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1028 13:10:04.904703  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem (1338 bytes)

	W1028 13:10:04.904727  862106 certs.go:480] ignoring /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062_empty.pem, impossibly tiny 0 bytes

	I1028 13:10:04.904737  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem (1679 bytes)

	I1028 13:10:04.904762  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem (1082 bytes)

	I1028 13:10:04.904785  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem (1123 bytes)

	I1028 13:10:04.904808  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem (1679 bytes)

	I1028 13:10:04.904848  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:10:04.904876  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:04.904890  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem -> /usr/share/ca-certificates/847062.pem

	I1028 13:10:04.904902  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /usr/share/ca-certificates/8470622.pem

	I1028 13:10:04.904935  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:10:04.908179  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:04.908587  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:10:04.908618  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:04.908846  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:10:04.909042  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:10:04.909218  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:10:04.909331  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:10:04.984250  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I1028 13:10:04.989850  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I1028 13:10:05.002396  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I1028 13:10:05.007262  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I1028 13:10:05.018834  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I1028 13:10:05.023378  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I1028 13:10:05.033476  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I1028 13:10:05.037515  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I1028 13:10:05.048068  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I1028 13:10:05.052307  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I1028 13:10:05.063097  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I1028 13:10:05.067455  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I1028 13:10:05.078689  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1028 13:10:05.103613  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1028 13:10:05.128647  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1028 13:10:05.152937  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1028 13:10:05.177303  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I1028 13:10:05.202285  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1028 13:10:05.226964  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1028 13:10:05.249927  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1028 13:10:05.272827  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1028 13:10:05.296188  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem --> /usr/share/ca-certificates/847062.pem (1338 bytes)

	I1028 13:10:05.319995  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /usr/share/ca-certificates/8470622.pem (1708 bytes)

	I1028 13:10:05.342239  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I1028 13:10:05.357550  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I1028 13:10:05.373358  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I1028 13:10:05.388854  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I1028 13:10:05.405266  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I1028 13:10:05.421621  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I1028 13:10:05.438496  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I1028 13:10:05.454647  862106 ssh_runner.go:195] Run: openssl version

	I1028 13:10:05.460185  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8470622.pem && ln -fs /usr/share/ca-certificates/8470622.pem /etc/ssl/certs/8470622.pem"

	I1028 13:10:05.470613  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8470622.pem

	I1028 13:10:05.474920  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 13:01 /usr/share/ca-certificates/8470622.pem

	I1028 13:10:05.474993  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8470622.pem

	I1028 13:10:05.480517  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8470622.pem /etc/ssl/certs/3ec20f2e.0"

	I1028 13:10:05.491256  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1028 13:10:05.501356  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:05.505593  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:21 /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:05.505653  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:10:05.511243  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1028 13:10:05.521727  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/847062.pem && ln -fs /usr/share/ca-certificates/847062.pem /etc/ssl/certs/847062.pem"

	I1028 13:10:05.533039  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/847062.pem

	I1028 13:10:05.537410  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 13:01 /usr/share/ca-certificates/847062.pem

	I1028 13:10:05.537476  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/847062.pem

	I1028 13:10:05.543201  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/847062.pem /etc/ssl/certs/51391683.0"

	I1028 13:10:05.554012  862106 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1028 13:10:05.557883  862106 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1028 13:10:05.557936  862106 kubeadm.go:934] updating node {m02 192.168.39.109 8443 v1.31.2 crio true true} ...

	I1028 13:10:05.558018  862106 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-798963-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.109

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1028 13:10:05.558042  862106 kube-vip.go:115] generating kube-vip config ...

	I1028 13:10:05.558077  862106 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I1028 13:10:05.576360  862106 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I1028 13:10:05.576436  862106 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.4

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I1028 13:10:05.576501  862106 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1028 13:10:05.587348  862106 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.2': No such file or directory

	Initiating transfer...

	I1028 13:10:05.587417  862106 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.2

	I1028 13:10:05.597912  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl.sha256

	I1028 13:10:05.597942  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl -> /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:10:05.598008  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:10:05.598030  862106 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm

	I1028 13:10:05.598009  862106 download.go:107] Downloading: https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet

	I1028 13:10:05.602384  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubectl': No such file or directory

	I1028 13:10:05.602413  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl --> /var/lib/minikube/binaries/v1.31.2/kubectl (56381592 bytes)

	I1028 13:10:06.558570  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm -> /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:10:06.558662  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:10:06.563325  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubeadm': No such file or directory

	I1028 13:10:06.563376  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm --> /var/lib/minikube/binaries/v1.31.2/kubeadm (58290328 bytes)

	I1028 13:10:06.691278  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:10:06.723373  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet -> /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:10:06.723504  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:10:06.733701  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubelet': No such file or directory

	I1028 13:10:06.733742  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet --> /var/lib/minikube/binaries/v1.31.2/kubelet (76902744 bytes)

	I1028 13:10:07.155554  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I1028 13:10:07.166555  862106 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I1028 13:10:07.183481  862106 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1028 13:10:07.202693  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I1028 13:10:07.220015  862106 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I1028 13:10:07.223991  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:10:07.237496  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:10:07.368677  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:10:07.388529  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:10:07.388876  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:07.388931  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:07.404449  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38669

	I1028 13:10:07.404901  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:07.405418  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:07.405441  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:07.405809  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:07.406000  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:10:07.406147  862106 start.go:317] joinCluster: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Cluster

Name:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiratio

n:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 13:10:07.406255  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I1028 13:10:07.406274  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:10:07.409554  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:07.409952  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:10:07.409982  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:10:07.410151  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:10:07.410364  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:10:07.410527  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:10:07.410658  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:10:07.561195  862106 start.go:343] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:10:07.561256  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 4x4oti.tzu8e9f2qalhbyyp --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m02 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443"

	I1028 13:10:29.194434  862106 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 4x4oti.tzu8e9f2qalhbyyp --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m02 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443": (21.633149132s)

	I1028 13:10:29.194477  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I1028 13:10:29.689152  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-798963-m02 minikube.k8s.io/updated_at=2024_10_28T13_10_29_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=ha-798963 minikube.k8s.io/primary=false

	I1028 13:10:29.794584  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-798963-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I1028 13:10:29.928171  862106 start.go:319] duration metric: took 22.522018271s to joinCluster

	I1028 13:10:29.928270  862106 start.go:235] Will wait 6m0s for node &{Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:10:29.928558  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:29.929878  862106 out.go:177] * Verifying Kubernetes components...

	I1028 13:10:29.931207  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:10:30.203706  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:10:30.234915  862106 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:10:30.235167  862106 kapi.go:59] client config for ha-798963: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt", KeyFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key", CAFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2439ec0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W1028 13:10:30.235233  862106 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.179:8443

	I1028 13:10:30.235442  862106 node_ready.go:35] waiting up to 6m0s for node "ha-798963-m02" to be "Ready" ...

	I1028 13:10:30.235565  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:30.235573  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:30.235581  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:30.235588  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:30.246224  862106 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I1028 13:10:30.735796  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:30.735820  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:30.735839  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:30.735845  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:30.743525  862106 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I1028 13:10:31.236356  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:31.236386  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:31.236396  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:31.236402  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:31.249202  862106 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I1028 13:10:31.735940  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:31.735962  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:31.735972  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:31.735975  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:31.739382  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:32.235849  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:32.235875  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:32.235884  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:32.235889  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:32.239431  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:32.239956  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:32.735863  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:32.735888  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:32.735896  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:32.735901  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:32.739892  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:33.235816  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:33.235852  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:33.235866  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:33.235873  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:33.239810  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:33.735931  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:33.735961  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:33.735973  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:33.735981  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:33.740986  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:34.236708  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:34.236735  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:34.236743  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:34.236747  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:34.240346  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:34.240874  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:34.736425  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:34.736457  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:34.736470  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:34.736478  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:34.740520  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:35.235691  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:35.235716  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:35.235725  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:35.235729  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:35.238909  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:35.736004  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:35.736034  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:35.736045  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:35.736051  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:35.739407  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:36.236607  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:36.236633  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:36.236642  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:36.236647  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:36.240587  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:36.241055  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:36.736513  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:36.736544  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:36.736555  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:36.736559  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:36.740131  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:37.236581  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:37.236605  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:37.236614  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:37.236619  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:37.240692  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:37.736413  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:37.736438  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:37.736447  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:37.736452  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:37.739597  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:38.236683  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:38.236714  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:38.236726  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:38.236731  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:38.240034  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:38.735831  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:38.735866  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:38.735878  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:38.735885  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:38.739044  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:38.739662  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:39.235830  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:39.235855  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:39.235864  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:39.235868  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:39.239608  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:39.736356  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:39.736383  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:39.736391  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:39.736397  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:39.739437  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:40.236423  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:40.236452  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:40.236462  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:40.236468  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:40.239827  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:40.736434  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:40.736459  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:40.736471  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:40.736480  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:40.740532  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:40.741072  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:41.236588  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:41.236613  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:41.236622  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:41.236627  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:41.240001  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:41.735862  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:41.735888  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:41.735896  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:41.735899  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:41.739493  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:42.235918  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:42.235947  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:42.235956  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:42.235959  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:42.240599  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:42.736378  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:42.736403  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:42.736413  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:42.736417  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:42.739919  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:43.235983  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:43.236012  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:43.236023  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:43.236028  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:43.240153  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:43.240759  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:43.735967  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:43.735991  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:43.736002  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:43.736007  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:43.740480  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:44.236351  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:44.236379  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:44.236388  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:44.236393  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:44.240702  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:44.735812  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:44.735841  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:44.735850  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:44.735857  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:44.739449  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:45.236500  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:45.236526  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:45.236534  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:45.236538  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:45.240237  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:45.735925  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:45.735976  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:45.735987  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:45.735994  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:45.739531  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:45.740129  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:46.236583  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:46.236609  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:46.236622  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:46.236628  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:46.240100  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:46.735943  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:46.735970  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:46.735978  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:46.735982  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:46.739043  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:47.236106  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:47.236141  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:47.236150  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:47.236154  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:47.239495  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:47.735791  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:47.735819  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:47.735827  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:47.735831  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:47.740271  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:47.740832  862106 node_ready.go:53] node "ha-798963-m02" has status "Ready":"False"

	I1028 13:10:48.235954  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:48.235979  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.235987  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.235992  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.239602  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.240154  862106 node_ready.go:49] node "ha-798963-m02" has status "Ready":"True"

	I1028 13:10:48.240180  862106 node_ready.go:38] duration metric: took 18.004697309s for node "ha-798963-m02" to be "Ready" ...

	I1028 13:10:48.240191  862106 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:10:48.240308  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:48.240318  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.240330  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.240417  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.244764  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:48.253021  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.253146  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-7x97m

	I1028 13:10:48.253159  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.253170  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.253176  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.256204  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.256955  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.256974  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.256986  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.256991  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.259721  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.260335  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.260359  862106 pod_ready.go:82] duration metric: took 7.299723ms for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.260373  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.260456  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-bdv2v

	I1028 13:10:48.260466  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.260477  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.260487  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.262936  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.263701  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.263720  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.263731  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.263737  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.266331  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.266852  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.266875  862106 pod_ready.go:82] duration metric: took 6.490043ms for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.266886  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.266956  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963

	I1028 13:10:48.266966  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.266973  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.266979  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.269578  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.270283  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.270303  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.270312  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.270325  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.273059  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.273649  862106 pod_ready.go:93] pod "etcd-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.273670  862106 pod_ready.go:82] duration metric: took 6.776749ms for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.273679  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.273742  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m02

	I1028 13:10:48.273751  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.273758  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.273762  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.276403  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.276971  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:48.276986  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.276993  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.277005  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.279356  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:48.279816  862106 pod_ready.go:93] pod "etcd-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.279836  862106 pod_ready.go:82] duration metric: took 6.150003ms for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.279851  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.436280  862106 request.go:632] Waited for 156.345589ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:10:48.436387  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:10:48.436399  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.436411  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.436421  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.439791  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.636997  862106 request.go:632] Waited for 196.349982ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.637081  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:48.637089  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.637100  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.637108  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.640522  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:48.641056  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:48.641079  862106 pod_ready.go:82] duration metric: took 361.221986ms for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.641090  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:48.836017  862106 request.go:632] Waited for 194.83275ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:10:48.836108  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:10:48.836123  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:48.836131  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:48.836138  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:48.839410  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.036616  862106 request.go:632] Waited for 196.380427ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.036702  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.036707  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.036715  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.036722  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.039908  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.040476  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:49.040498  862106 pod_ready.go:82] duration metric: took 399.402073ms for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.040509  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.236494  862106 request.go:632] Waited for 195.898227ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:10:49.236563  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:10:49.236569  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.236576  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.236582  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.240432  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.436461  862106 request.go:632] Waited for 195.41836ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:49.436542  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:49.436548  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.436559  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.436569  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.439763  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.440330  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:49.440355  862106 pod_ready.go:82] duration metric: took 399.83902ms for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.440366  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.636358  862106 request.go:632] Waited for 195.885273ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:10:49.636427  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:10:49.636432  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.636439  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.636445  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.640151  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:49.836836  862106 request.go:632] Waited for 195.784481ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.836912  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:49.836919  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:49.836930  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:49.836937  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:49.839886  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:10:49.840468  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:49.840497  862106 pod_ready.go:82] duration metric: took 400.120509ms for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:49.840513  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.036441  862106 request.go:632] Waited for 195.825099ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:10:50.036536  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:10:50.036543  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.036550  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.036554  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.039699  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:50.236798  862106 request.go:632] Waited for 196.427488ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:50.236874  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:50.236879  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.236886  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.236890  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.240524  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:50.241106  862106 pod_ready.go:93] pod "kube-proxy-6j2hc" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:50.241131  862106 pod_ready.go:82] duration metric: took 400.610867ms for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.241143  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.436406  862106 request.go:632] Waited for 195.161489ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:10:50.436475  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:10:50.436480  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.436488  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.436494  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.440062  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:50.636278  862106 request.go:632] Waited for 195.438862ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:50.636347  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:50.636359  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.636368  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.636372  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.640599  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:10:50.641201  862106 pod_ready.go:93] pod "kube-proxy-ltx8s" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:50.641279  862106 pod_ready.go:82] duration metric: took 400.120305ms for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.641309  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:50.836230  862106 request.go:632] Waited for 194.82279ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:10:50.836332  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:10:50.836342  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:50.836351  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:50.836361  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:50.840049  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.036964  862106 request.go:632] Waited for 196.236456ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:51.037110  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:10:51.037125  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.037136  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.037143  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.040383  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.040876  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:51.040898  862106 pod_ready.go:82] duration metric: took 399.581027ms for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:51.040909  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:51.236961  862106 request.go:632] Waited for 195.96375ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:10:51.237040  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:10:51.237045  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.237053  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.237057  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.240573  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.436373  862106 request.go:632] Waited for 195.113921ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:51.436450  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:10:51.436457  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.436465  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.436470  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.440059  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.440606  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:10:51.440629  862106 pod_ready.go:82] duration metric: took 399.712643ms for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:10:51.440645  862106 pod_ready.go:39] duration metric: took 3.200417219s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:10:51.440674  862106 api_server.go:52] waiting for apiserver process to appear ...

	I1028 13:10:51.440749  862106 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1028 13:10:51.458656  862106 api_server.go:72] duration metric: took 21.530345331s to wait for apiserver process to appear ...

	I1028 13:10:51.458688  862106 api_server.go:88] waiting for apiserver healthz status ...

	I1028 13:10:51.458767  862106 api_server.go:253] Checking apiserver healthz at https://192.168.39.179:8443/healthz ...

	I1028 13:10:51.465080  862106 api_server.go:279] https://192.168.39.179:8443/healthz returned 200:

	ok

	I1028 13:10:51.465199  862106 round_trippers.go:463] GET https://192.168.39.179:8443/version

	I1028 13:10:51.465212  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.465224  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.465232  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.466123  862106 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I1028 13:10:51.466239  862106 api_server.go:141] control plane version: v1.31.2

	I1028 13:10:51.466260  862106 api_server.go:131] duration metric: took 7.563996ms to wait for apiserver health ...

	I1028 13:10:51.466271  862106 system_pods.go:43] waiting for kube-system pods to appear ...

	I1028 13:10:51.636522  862106 request.go:632] Waited for 170.157104ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:51.636600  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:51.636608  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.636616  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.636624  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.641692  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:10:51.647540  862106 system_pods.go:59] 17 kube-system pods found

	I1028 13:10:51.647580  862106 system_pods.go:61] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:10:51.647585  862106 system_pods.go:61] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:10:51.647589  862106 system_pods.go:61] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:10:51.647593  862106 system_pods.go:61] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:10:51.647597  862106 system_pods.go:61] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:10:51.647602  862106 system_pods.go:61] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:10:51.647606  862106 system_pods.go:61] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:10:51.647609  862106 system_pods.go:61] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:10:51.647613  862106 system_pods.go:61] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:10:51.647617  862106 system_pods.go:61] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:10:51.647622  862106 system_pods.go:61] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:10:51.647627  862106 system_pods.go:61] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:10:51.647639  862106 system_pods.go:61] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:10:51.647645  862106 system_pods.go:61] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:10:51.647651  862106 system_pods.go:61] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:10:51.647655  862106 system_pods.go:61] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:10:51.647659  862106 system_pods.go:61] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:10:51.647671  862106 system_pods.go:74] duration metric: took 181.3897ms to wait for pod list to return data ...

	I1028 13:10:51.647684  862106 default_sa.go:34] waiting for default service account to be created ...

	I1028 13:10:51.836107  862106 request.go:632] Waited for 188.333802ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:10:51.836172  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:10:51.836180  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:51.836187  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:51.836193  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:51.840155  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:51.840433  862106 default_sa.go:45] found service account: "default"

	I1028 13:10:51.840458  862106 default_sa.go:55] duration metric: took 192.767866ms for default service account to be created ...

	I1028 13:10:51.840469  862106 system_pods.go:116] waiting for k8s-apps to be running ...

	I1028 13:10:52.036752  862106 request.go:632] Waited for 196.172497ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:52.036827  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:10:52.036838  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:52.036850  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:52.036924  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:52.042014  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:10:52.046598  862106 system_pods.go:86] 17 kube-system pods found

	I1028 13:10:52.046630  862106 system_pods.go:89] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:10:52.046636  862106 system_pods.go:89] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:10:52.046642  862106 system_pods.go:89] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:10:52.046646  862106 system_pods.go:89] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:10:52.046650  862106 system_pods.go:89] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:10:52.046654  862106 system_pods.go:89] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:10:52.046657  862106 system_pods.go:89] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:10:52.046660  862106 system_pods.go:89] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:10:52.046664  862106 system_pods.go:89] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:10:52.046667  862106 system_pods.go:89] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:10:52.046671  862106 system_pods.go:89] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:10:52.046674  862106 system_pods.go:89] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:10:52.046677  862106 system_pods.go:89] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:10:52.046681  862106 system_pods.go:89] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:10:52.046685  862106 system_pods.go:89] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:10:52.046688  862106 system_pods.go:89] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:10:52.046692  862106 system_pods.go:89] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:10:52.046701  862106 system_pods.go:126] duration metric: took 206.226504ms to wait for k8s-apps to be running ...

	I1028 13:10:52.046709  862106 system_svc.go:44] waiting for kubelet service to be running ....

	I1028 13:10:52.046756  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:10:52.071897  862106 system_svc.go:56] duration metric: took 25.171756ms WaitForService to wait for kubelet

	I1028 13:10:52.071945  862106 kubeadm.go:582] duration metric: took 22.143638967s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1028 13:10:52.071968  862106 node_conditions.go:102] verifying NodePressure condition ...

	I1028 13:10:52.236746  862106 request.go:632] Waited for 164.663134ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes

	I1028 13:10:52.236818  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes

	I1028 13:10:52.236826  862106 round_trippers.go:469] Request Headers:

	I1028 13:10:52.236837  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:10:52.236847  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:10:52.240724  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:10:52.241486  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:10:52.241519  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:10:52.241533  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:10:52.241537  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:10:52.241541  862106 node_conditions.go:105] duration metric: took 169.568698ms to run NodePressure ...

	I1028 13:10:52.241553  862106 start.go:241] waiting for startup goroutines ...

	I1028 13:10:52.241578  862106 start.go:255] writing updated cluster config ...

	I1028 13:10:52.243670  862106 out.go:201] 

	I1028 13:10:52.245543  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:10:52.245644  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:10:52.247513  862106 out.go:177] * Starting "ha-798963-m03" control-plane node in "ha-798963" cluster

	I1028 13:10:52.248800  862106 preload.go:131] Checking if preload exists for k8s version v1.31.2 and runtime crio

	I1028 13:10:52.248835  862106 cache.go:56] Caching tarball of preloaded images

	I1028 13:10:52.248948  862106 preload.go:172] Found /home/jenkins/minikube-integration/19865-839778/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.31.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I1028 13:10:52.248960  862106 cache.go:59] Finished verifying existence of preloaded tar for v1.31.2 on crio

	I1028 13:10:52.249078  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:10:52.249266  862106 start.go:360] acquireMachinesLock for ha-798963-m03: {Name:mk3d8412df30fd3411bfb6262eb0fa70b21bf365 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I1028 13:10:52.249316  862106 start.go:364] duration metric: took 29.288µs to acquireMachinesLock for "ha-798963-m03"

	I1028 13:10:52.249334  862106 start.go:93] Provisioning new machine with config: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:fals

e ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Bi

naryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:10:52.249429  862106 start.go:125] createHost starting for "m03" (driver="kvm2")

	I1028 13:10:52.251158  862106 out.go:235] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I1028 13:10:52.251272  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:10:52.251314  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:10:52.267194  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40931

	I1028 13:10:52.267798  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:10:52.268419  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:10:52.268437  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:10:52.268806  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:10:52.269040  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:10:52.269224  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:10:52.269441  862106 start.go:159] libmachine.API.Create for "ha-798963" (driver="kvm2")

	I1028 13:10:52.269479  862106 client.go:168] LocalClient.Create starting

	I1028 13:10:52.269510  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem

	I1028 13:10:52.269546  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:10:52.269562  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:10:52.269625  862106 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem

	I1028 13:10:52.269647  862106 main.go:141] libmachine: Decoding PEM data...

	I1028 13:10:52.269658  862106 main.go:141] libmachine: Parsing certificate...

	I1028 13:10:52.269675  862106 main.go:141] libmachine: Running pre-create checks...

	I1028 13:10:52.269687  862106 main.go:141] libmachine: (ha-798963-m03) Calling .PreCreateCheck

	I1028 13:10:52.269862  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetConfigRaw

	I1028 13:10:52.270441  862106 main.go:141] libmachine: Creating machine...

	I1028 13:10:52.270460  862106 main.go:141] libmachine: (ha-798963-m03) Calling .Create

	I1028 13:10:52.270616  862106 main.go:141] libmachine: (ha-798963-m03) Creating KVM machine...

	I1028 13:10:52.272033  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found existing default KVM network

	I1028 13:10:52.272242  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found existing private KVM network mk-ha-798963

	I1028 13:10:52.272372  862106 main.go:141] libmachine: (ha-798963-m03) Setting up store path in /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03 ...

	I1028 13:10:52.272420  862106 main.go:141] libmachine: (ha-798963-m03) Building disk image from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso

	I1028 13:10:52.272474  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.272358  862861 common.go:144] Making disk image using store path: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:10:52.272557  862106 main.go:141] libmachine: (ha-798963-m03) Downloading /home/jenkins/minikube-integration/19865-839778/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19865-839778/.minikube/cache/iso/amd64/minikube-v1.34.0-1729002252-19806-amd64.iso...

	I1028 13:10:52.562450  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.562285  862861 common.go:151] Creating ssh key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa...

	I1028 13:10:52.747848  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.747684  862861 common.go:157] Creating raw disk image: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/ha-798963-m03.rawdisk...

	I1028 13:10:52.747877  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Writing magic tar header

	I1028 13:10:52.747899  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Writing SSH key tar header

	I1028 13:10:52.747907  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:52.747857  862861 common.go:171] Fixing permissions on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03 ...

	I1028 13:10:52.748057  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03

	I1028 13:10:52.748094  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube/machines

	I1028 13:10:52.748103  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03 (perms=drwx------)

	I1028 13:10:52.748114  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube/machines (perms=drwxr-xr-x)

	I1028 13:10:52.748122  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778/.minikube (perms=drwxr-xr-x)

	I1028 13:10:52.748129  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration/19865-839778 (perms=drwxrwxr-x)

	I1028 13:10:52.748140  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I1028 13:10:52.748151  862106 main.go:141] libmachine: (ha-798963-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I1028 13:10:52.748159  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778/.minikube

	I1028 13:10:52.748164  862106 main.go:141] libmachine: (ha-798963-m03) Creating domain...

	I1028 13:10:52.748206  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19865-839778

	I1028 13:10:52.748229  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I1028 13:10:52.748241  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home/jenkins

	I1028 13:10:52.748258  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Checking permissions on dir: /home

	I1028 13:10:52.748274  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Skipping /home - not owner

	I1028 13:10:52.749407  862106 main.go:141] libmachine: (ha-798963-m03) define libvirt domain using xml: 

	I1028 13:10:52.749440  862106 main.go:141] libmachine: (ha-798963-m03) <domain type='kvm'>

	I1028 13:10:52.749452  862106 main.go:141] libmachine: (ha-798963-m03)   <name>ha-798963-m03</name>

	I1028 13:10:52.749464  862106 main.go:141] libmachine: (ha-798963-m03)   <memory unit='MiB'>2200</memory>

	I1028 13:10:52.749472  862106 main.go:141] libmachine: (ha-798963-m03)   <vcpu>2</vcpu>

	I1028 13:10:52.749476  862106 main.go:141] libmachine: (ha-798963-m03)   <features>

	I1028 13:10:52.749481  862106 main.go:141] libmachine: (ha-798963-m03)     <acpi/>

	I1028 13:10:52.749486  862106 main.go:141] libmachine: (ha-798963-m03)     <apic/>

	I1028 13:10:52.749490  862106 main.go:141] libmachine: (ha-798963-m03)     <pae/>

	I1028 13:10:52.749494  862106 main.go:141] libmachine: (ha-798963-m03)     

	I1028 13:10:52.749499  862106 main.go:141] libmachine: (ha-798963-m03)   </features>

	I1028 13:10:52.749506  862106 main.go:141] libmachine: (ha-798963-m03)   <cpu mode='host-passthrough'>

	I1028 13:10:52.749510  862106 main.go:141] libmachine: (ha-798963-m03)   

	I1028 13:10:52.749517  862106 main.go:141] libmachine: (ha-798963-m03)   </cpu>

	I1028 13:10:52.749521  862106 main.go:141] libmachine: (ha-798963-m03)   <os>

	I1028 13:10:52.749527  862106 main.go:141] libmachine: (ha-798963-m03)     <type>hvm</type>

	I1028 13:10:52.749558  862106 main.go:141] libmachine: (ha-798963-m03)     <boot dev='cdrom'/>

	I1028 13:10:52.749590  862106 main.go:141] libmachine: (ha-798963-m03)     <boot dev='hd'/>

	I1028 13:10:52.749602  862106 main.go:141] libmachine: (ha-798963-m03)     <bootmenu enable='no'/>

	I1028 13:10:52.749613  862106 main.go:141] libmachine: (ha-798963-m03)   </os>

	I1028 13:10:52.749620  862106 main.go:141] libmachine: (ha-798963-m03)   <devices>

	I1028 13:10:52.749630  862106 main.go:141] libmachine: (ha-798963-m03)     <disk type='file' device='cdrom'>

	I1028 13:10:52.749647  862106 main.go:141] libmachine: (ha-798963-m03)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/boot2docker.iso'/>

	I1028 13:10:52.749656  862106 main.go:141] libmachine: (ha-798963-m03)       <target dev='hdc' bus='scsi'/>

	I1028 13:10:52.749687  862106 main.go:141] libmachine: (ha-798963-m03)       <readonly/>

	I1028 13:10:52.749712  862106 main.go:141] libmachine: (ha-798963-m03)     </disk>

	I1028 13:10:52.749728  862106 main.go:141] libmachine: (ha-798963-m03)     <disk type='file' device='disk'>

	I1028 13:10:52.749742  862106 main.go:141] libmachine: (ha-798963-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I1028 13:10:52.749760  862106 main.go:141] libmachine: (ha-798963-m03)       <source file='/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/ha-798963-m03.rawdisk'/>

	I1028 13:10:52.749770  862106 main.go:141] libmachine: (ha-798963-m03)       <target dev='hda' bus='virtio'/>

	I1028 13:10:52.749781  862106 main.go:141] libmachine: (ha-798963-m03)     </disk>

	I1028 13:10:52.749796  862106 main.go:141] libmachine: (ha-798963-m03)     <interface type='network'>

	I1028 13:10:52.749809  862106 main.go:141] libmachine: (ha-798963-m03)       <source network='mk-ha-798963'/>

	I1028 13:10:52.749817  862106 main.go:141] libmachine: (ha-798963-m03)       <model type='virtio'/>

	I1028 13:10:52.749829  862106 main.go:141] libmachine: (ha-798963-m03)     </interface>

	I1028 13:10:52.749840  862106 main.go:141] libmachine: (ha-798963-m03)     <interface type='network'>

	I1028 13:10:52.749851  862106 main.go:141] libmachine: (ha-798963-m03)       <source network='default'/>

	I1028 13:10:52.749861  862106 main.go:141] libmachine: (ha-798963-m03)       <model type='virtio'/>

	I1028 13:10:52.749872  862106 main.go:141] libmachine: (ha-798963-m03)     </interface>

	I1028 13:10:52.749882  862106 main.go:141] libmachine: (ha-798963-m03)     <serial type='pty'>

	I1028 13:10:52.749894  862106 main.go:141] libmachine: (ha-798963-m03)       <target port='0'/>

	I1028 13:10:52.749899  862106 main.go:141] libmachine: (ha-798963-m03)     </serial>

	I1028 13:10:52.749909  862106 main.go:141] libmachine: (ha-798963-m03)     <console type='pty'>

	I1028 13:10:52.749919  862106 main.go:141] libmachine: (ha-798963-m03)       <target type='serial' port='0'/>

	I1028 13:10:52.749931  862106 main.go:141] libmachine: (ha-798963-m03)     </console>

	I1028 13:10:52.749955  862106 main.go:141] libmachine: (ha-798963-m03)     <rng model='virtio'>

	I1028 13:10:52.749978  862106 main.go:141] libmachine: (ha-798963-m03)       <backend model='random'>/dev/random</backend>

	I1028 13:10:52.749987  862106 main.go:141] libmachine: (ha-798963-m03)     </rng>

	I1028 13:10:52.750004  862106 main.go:141] libmachine: (ha-798963-m03)     

	I1028 13:10:52.750019  862106 main.go:141] libmachine: (ha-798963-m03)     

	I1028 13:10:52.750031  862106 main.go:141] libmachine: (ha-798963-m03)   </devices>

	I1028 13:10:52.750040  862106 main.go:141] libmachine: (ha-798963-m03) </domain>

	I1028 13:10:52.750052  862106 main.go:141] libmachine: (ha-798963-m03) 

	I1028 13:10:52.757851  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:34:c0:77 in network default

	I1028 13:10:52.758497  862106 main.go:141] libmachine: (ha-798963-m03) Ensuring networks are active...

	I1028 13:10:52.758521  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:52.759215  862106 main.go:141] libmachine: (ha-798963-m03) Ensuring network default is active

	I1028 13:10:52.759526  862106 main.go:141] libmachine: (ha-798963-m03) Ensuring network mk-ha-798963 is active

	I1028 13:10:52.759835  862106 main.go:141] libmachine: (ha-798963-m03) Getting domain xml...

	I1028 13:10:52.760484  862106 main.go:141] libmachine: (ha-798963-m03) Creating domain...

	I1028 13:10:54.026756  862106 main.go:141] libmachine: (ha-798963-m03) Waiting to get IP...

	I1028 13:10:54.027506  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.027879  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.027923  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.027860  862861 retry.go:31] will retry after 251.74389ms: waiting for machine to come up

	I1028 13:10:54.281317  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.281757  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.281782  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.281727  862861 retry.go:31] will retry after 286.730458ms: waiting for machine to come up

	I1028 13:10:54.570404  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.570919  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.570950  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.570874  862861 retry.go:31] will retry after 393.328815ms: waiting for machine to come up

	I1028 13:10:54.965448  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:54.965919  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:54.965945  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:54.965874  862861 retry.go:31] will retry after 444.271511ms: waiting for machine to come up

	I1028 13:10:55.411623  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:55.412130  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:55.412161  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:55.412083  862861 retry.go:31] will retry after 699.973986ms: waiting for machine to come up

	I1028 13:10:56.114153  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:56.114727  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:56.114764  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:56.114672  862861 retry.go:31] will retry after 910.164635ms: waiting for machine to come up

	I1028 13:10:57.026041  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:57.026518  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:57.026548  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:57.026451  862861 retry.go:31] will retry after 1.075861946s: waiting for machine to come up

	I1028 13:10:58.103813  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:58.104358  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:58.104390  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:58.104296  862861 retry.go:31] will retry after 905.931409ms: waiting for machine to come up

	I1028 13:10:59.011395  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:10:59.011899  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:10:59.011923  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:10:59.011847  862861 retry.go:31] will retry after 1.277966088s: waiting for machine to come up

	I1028 13:11:00.291648  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:00.292106  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:00.292137  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:00.292061  862861 retry.go:31] will retry after 2.301762361s: waiting for machine to come up

	I1028 13:11:02.595250  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:02.595761  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:02.595793  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:02.595696  862861 retry.go:31] will retry after 2.324303503s: waiting for machine to come up

	I1028 13:11:04.922086  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:04.922525  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:04.922556  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:04.922471  862861 retry.go:31] will retry after 2.258709482s: waiting for machine to come up

	I1028 13:11:07.184047  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:07.184668  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:07.184700  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:07.184613  862861 retry.go:31] will retry after 3.777938273s: waiting for machine to come up

	I1028 13:11:10.964926  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:10.965437  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find current IP address of domain ha-798963-m03 in network mk-ha-798963

	I1028 13:11:10.965466  862106 main.go:141] libmachine: (ha-798963-m03) DBG | I1028 13:11:10.965385  862861 retry.go:31] will retry after 4.082429463s: waiting for machine to come up

	I1028 13:11:15.051490  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:15.052093  862106 main.go:141] libmachine: (ha-798963-m03) Found IP for machine: 192.168.39.22

	I1028 13:11:15.052129  862106 main.go:141] libmachine: (ha-798963-m03) Reserving static IP address...

	I1028 13:11:15.052144  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has current primary IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:15.052521  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find host DHCP lease matching {name: "ha-798963-m03", mac: "52:54:00:52:4f:47", ip: "192.168.39.22"} in network mk-ha-798963

	I1028 13:11:15.138332  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Getting to WaitForSSH function...

	I1028 13:11:15.138380  862106 main.go:141] libmachine: (ha-798963-m03) Reserved static IP address: 192.168.39.22

	I1028 13:11:15.138398  862106 main.go:141] libmachine: (ha-798963-m03) Waiting for SSH to be available...

	I1028 13:11:15.140946  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:15.141322  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963

	I1028 13:11:15.141356  862106 main.go:141] libmachine: (ha-798963-m03) DBG | unable to find defined IP address of network mk-ha-798963 interface with MAC address 52:54:00:52:4f:47

	I1028 13:11:15.141531  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH client type: external

	I1028 13:11:15.141564  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa (-rw-------)

	I1028 13:11:15.141623  862106 main.go:141] libmachine: (ha-798963-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:11:15.141659  862106 main.go:141] libmachine: (ha-798963-m03) DBG | About to run SSH command:

	I1028 13:11:15.141677  862106 main.go:141] libmachine: (ha-798963-m03) DBG | exit 0

	I1028 13:11:15.146235  862106 main.go:141] libmachine: (ha-798963-m03) DBG | SSH cmd err, output: exit status 255: 

	I1028 13:11:15.146272  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I1028 13:11:15.146283  862106 main.go:141] libmachine: (ha-798963-m03) DBG | command : exit 0

	I1028 13:11:15.146290  862106 main.go:141] libmachine: (ha-798963-m03) DBG | err     : exit status 255

	I1028 13:11:15.146302  862106 main.go:141] libmachine: (ha-798963-m03) DBG | output  : 

	I1028 13:11:18.146941  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Getting to WaitForSSH function...

	I1028 13:11:18.149944  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.150561  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.150599  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.150760  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH client type: external

	I1028 13:11:18.150785  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa (-rw-------)

	I1028 13:11:18.150804  862106 main.go:141] libmachine: (ha-798963-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.22 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I1028 13:11:18.150821  862106 main.go:141] libmachine: (ha-798963-m03) DBG | About to run SSH command:

	I1028 13:11:18.150834  862106 main.go:141] libmachine: (ha-798963-m03) DBG | exit 0

	I1028 13:11:18.279852  862106 main.go:141] libmachine: (ha-798963-m03) DBG | SSH cmd err, output: <nil>: 

	I1028 13:11:18.280117  862106 main.go:141] libmachine: (ha-798963-m03) KVM machine creation complete!

	I1028 13:11:18.280471  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetConfigRaw

	I1028 13:11:18.281057  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:18.281286  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:18.281511  862106 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I1028 13:11:18.281528  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetState

	I1028 13:11:18.282967  862106 main.go:141] libmachine: Detecting operating system of created instance...

	I1028 13:11:18.282981  862106 main.go:141] libmachine: Waiting for SSH to be available...

	I1028 13:11:18.282987  862106 main.go:141] libmachine: Getting to WaitForSSH function...

	I1028 13:11:18.282993  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.285444  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.285855  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.285886  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.286065  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.286265  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.286456  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.286646  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.286860  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.287156  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.287177  862106 main.go:141] libmachine: About to run SSH command:

	exit 0

	I1028 13:11:18.391371  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:11:18.391403  862106 main.go:141] libmachine: Detecting the provisioner...

	I1028 13:11:18.391414  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.394495  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.394905  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.394928  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.395120  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.395350  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.395533  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.395690  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.395859  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.396080  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.396095  862106 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I1028 13:11:18.496700  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I1028 13:11:18.496787  862106 main.go:141] libmachine: found compatible host: buildroot

	I1028 13:11:18.496806  862106 main.go:141] libmachine: Provisioning with buildroot...

	I1028 13:11:18.496822  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:11:18.497107  862106 buildroot.go:166] provisioning hostname "ha-798963-m03"

	I1028 13:11:18.497145  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:11:18.497347  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.500364  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.500925  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.500975  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.501046  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.501354  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.501545  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.501739  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.501915  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.502138  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.502157  862106 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-798963-m03 && echo "ha-798963-m03" | sudo tee /etc/hostname

	I1028 13:11:18.618604  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-798963-m03

	I1028 13:11:18.618639  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.622283  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.622616  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.622651  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.622826  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.623108  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.623364  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.623516  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.623720  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:18.623962  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:18.623980  862106 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-798963-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-798963-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-798963-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I1028 13:11:18.736595  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I1028 13:11:18.736636  862106 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19865-839778/.minikube CaCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19865-839778/.minikube}

	I1028 13:11:18.736665  862106 buildroot.go:174] setting up certificates

	I1028 13:11:18.736682  862106 provision.go:84] configureAuth start

	I1028 13:11:18.736701  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetMachineName

	I1028 13:11:18.737021  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:18.739891  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.740410  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.740437  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.740694  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.743175  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.743592  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.743626  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.743788  862106 provision.go:143] copyHostCerts

	I1028 13:11:18.743835  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:11:18.743879  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem, removing ...

	I1028 13:11:18.743892  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem

	I1028 13:11:18.743974  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/key.pem (1679 bytes)

	I1028 13:11:18.744142  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:11:18.744179  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem, removing ...

	I1028 13:11:18.744189  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem

	I1028 13:11:18.744232  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/ca.pem (1082 bytes)

	I1028 13:11:18.744301  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:11:18.744324  862106 exec_runner.go:144] found /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem, removing ...

	I1028 13:11:18.744330  862106 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem

	I1028 13:11:18.744365  862106 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19865-839778/.minikube/cert.pem (1123 bytes)

	I1028 13:11:18.744439  862106 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem org=jenkins.ha-798963-m03 san=[127.0.0.1 192.168.39.22 ha-798963-m03 localhost minikube]

	I1028 13:11:18.909358  862106 provision.go:177] copyRemoteCerts

	I1028 13:11:18.909440  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I1028 13:11:18.909478  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:18.912521  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.912938  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:18.912962  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:18.913158  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:18.913396  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:18.913596  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:18.913794  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:18.993960  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I1028 13:11:18.994055  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I1028 13:11:19.018594  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem -> /etc/docker/server.pem

	I1028 13:11:19.018694  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I1028 13:11:19.042856  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I1028 13:11:19.042932  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I1028 13:11:19.066474  862106 provision.go:87] duration metric: took 329.775862ms to configureAuth

	I1028 13:11:19.066506  862106 buildroot.go:189] setting minikube options for container-runtime

	I1028 13:11:19.066762  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:11:19.066849  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.069625  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.070069  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.070106  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.070305  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.070451  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.070568  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.070780  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.070970  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:19.071152  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:19.071164  862106 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I1028 13:11:19.283468  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I1028 13:11:19.283504  862106 main.go:141] libmachine: Checking connection to Docker...

	I1028 13:11:19.283516  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetURL

	I1028 13:11:19.285019  862106 main.go:141] libmachine: (ha-798963-m03) DBG | Using libvirt version 6000000

	I1028 13:11:19.287847  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.288291  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.288316  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.288536  862106 main.go:141] libmachine: Docker is up and running!

	I1028 13:11:19.288557  862106 main.go:141] libmachine: Reticulating splines...

	I1028 13:11:19.288565  862106 client.go:171] duration metric: took 27.019078458s to LocalClient.Create

	I1028 13:11:19.288592  862106 start.go:167] duration metric: took 27.019149151s to libmachine.API.Create "ha-798963"

	I1028 13:11:19.288603  862106 start.go:293] postStartSetup for "ha-798963-m03" (driver="kvm2")

	I1028 13:11:19.288620  862106 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I1028 13:11:19.288645  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.288916  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I1028 13:11:19.288941  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.291428  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.291857  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.291885  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.292060  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.292291  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.292494  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.292716  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:19.374186  862106 ssh_runner.go:195] Run: cat /etc/os-release

	I1028 13:11:19.378492  862106 info.go:137] Remote host: Buildroot 2023.02.9

	I1028 13:11:19.378525  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/addons for local assets ...

	I1028 13:11:19.378610  862106 filesync.go:126] Scanning /home/jenkins/minikube-integration/19865-839778/.minikube/files for local assets ...

	I1028 13:11:19.378699  862106 filesync.go:149] local asset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> 8470622.pem in /etc/ssl/certs

	I1028 13:11:19.378712  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /etc/ssl/certs/8470622.pem

	I1028 13:11:19.378830  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I1028 13:11:19.388301  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:11:19.413764  862106 start.go:296] duration metric: took 125.140976ms for postStartSetup

	I1028 13:11:19.413887  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetConfigRaw

	I1028 13:11:19.414725  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:19.418161  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.418560  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.418602  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.418881  862106 profile.go:143] Saving config to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/config.json ...

	I1028 13:11:19.419150  862106 start.go:128] duration metric: took 27.169708813s to createHost

	I1028 13:11:19.419181  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.421528  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.421965  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.421985  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.422228  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.422481  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.422676  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.422832  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.423121  862106 main.go:141] libmachine: Using SSH client type: native

	I1028 13:11:19.423299  862106 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x866160] 0x868e40 <nil>  [] 0s} 192.168.39.22 22 <nil> <nil>}

	I1028 13:11:19.423313  862106 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I1028 13:11:19.529229  862106 main.go:141] libmachine: SSH cmd err, output: <nil>: 1730121079.510567012

	I1028 13:11:19.529256  862106 fix.go:216] guest clock: 1730121079.510567012

	I1028 13:11:19.529266  862106 fix.go:229] Guest: 2024-10-28 13:11:19.510567012 +0000 UTC Remote: 2024-10-28 13:11:19.419167527 +0000 UTC m=+144.065220729 (delta=91.399485ms)

	I1028 13:11:19.529289  862106 fix.go:200] guest clock delta is within tolerance: 91.399485ms

	I1028 13:11:19.529296  862106 start.go:83] releasing machines lock for "ha-798963-m03", held for 27.279971067s

	I1028 13:11:19.529329  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.529651  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:19.532764  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.533288  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.533321  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.535838  862106 out.go:177] * Found network options:

	I1028 13:11:19.537321  862106 out.go:177]   - NO_PROXY=192.168.39.179,192.168.39.109

	W1028 13:11:19.538621  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	W1028 13:11:19.538655  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:11:19.538674  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.539474  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.539726  862106 main.go:141] libmachine: (ha-798963-m03) Calling .DriverName

	I1028 13:11:19.539884  862106 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	W1028 13:11:19.539911  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	W1028 13:11:19.539944  862106 proxy.go:119] fail to check proxy env: Error ip not in block

	I1028 13:11:19.539945  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.540024  862106 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I1028 13:11:19.540084  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHHostname

	I1028 13:11:19.543057  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543410  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543539  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.543564  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543728  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.543925  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:19.543958  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:19.543932  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.544110  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHPort

	I1028 13:11:19.544219  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.544280  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHKeyPath

	I1028 13:11:19.544388  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:19.544472  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetSSHUsername

	I1028 13:11:19.544589  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.22 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963-m03/id_rsa Username:docker}

	I1028 13:11:19.780751  862106 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W1028 13:11:19.786410  862106 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I1028 13:11:19.786480  862106 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I1028 13:11:19.802824  862106 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I1028 13:11:19.802861  862106 start.go:495] detecting cgroup driver to use...

	I1028 13:11:19.802953  862106 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I1028 13:11:19.819572  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I1028 13:11:19.836108  862106 docker.go:217] disabling cri-docker service (if available) ...

	I1028 13:11:19.836178  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I1028 13:11:19.851457  862106 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I1028 13:11:19.866180  862106 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I1028 13:11:19.993253  862106 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I1028 13:11:20.152966  862106 docker.go:233] disabling docker service ...

	I1028 13:11:20.153060  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I1028 13:11:20.169495  862106 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I1028 13:11:20.182995  862106 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I1028 13:11:20.305890  862106 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I1028 13:11:20.430530  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I1028 13:11:20.448916  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I1028 13:11:20.473323  862106 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.10" pause image...

	I1028 13:11:20.473396  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.10"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.484460  862106 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I1028 13:11:20.484547  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.496258  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.506903  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.517726  862106 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I1028 13:11:20.529586  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.540909  862106 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.560337  862106 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I1028 13:11:20.571648  862106 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I1028 13:11:20.581868  862106 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I1028 13:11:20.581953  862106 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I1028 13:11:20.595991  862106 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I1028 13:11:20.606337  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:11:20.730480  862106 ssh_runner.go:195] Run: sudo systemctl restart crio

	I1028 13:11:20.819859  862106 start.go:542] Will wait 60s for socket path /var/run/crio/crio.sock

	I1028 13:11:20.819946  862106 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I1028 13:11:20.824510  862106 start.go:563] Will wait 60s for crictl version

	I1028 13:11:20.824579  862106 ssh_runner.go:195] Run: which crictl

	I1028 13:11:20.828553  862106 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I1028 13:11:20.871251  862106 start.go:579] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I1028 13:11:20.871346  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:11:20.901368  862106 ssh_runner.go:195] Run: crio --version

	I1028 13:11:20.932662  862106 out.go:177] * Preparing Kubernetes v1.31.2 on CRI-O 1.29.1 ...

	I1028 13:11:20.934192  862106 out.go:177]   - env NO_PROXY=192.168.39.179

	I1028 13:11:20.935534  862106 out.go:177]   - env NO_PROXY=192.168.39.179,192.168.39.109

	I1028 13:11:20.936788  862106 main.go:141] libmachine: (ha-798963-m03) Calling .GetIP

	I1028 13:11:20.939358  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:20.939712  862106 main.go:141] libmachine: (ha-798963-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:52:4f:47", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:11:06 +0000 UTC Type:0 Mac:52:54:00:52:4f:47 Iaid: IPaddr:192.168.39.22 Prefix:24 Hostname:ha-798963-m03 Clientid:01:52:54:00:52:4f:47}

	I1028 13:11:20.939743  862106 main.go:141] libmachine: (ha-798963-m03) DBG | domain ha-798963-m03 has defined IP address 192.168.39.22 and MAC address 52:54:00:52:4f:47 in network mk-ha-798963

	I1028 13:11:20.939974  862106 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I1028 13:11:20.944160  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:11:20.957935  862106 mustload.go:65] Loading cluster: ha-798963

	I1028 13:11:20.958201  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:11:20.958461  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:11:20.958503  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:11:20.975786  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42129

	I1028 13:11:20.976418  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:11:20.977043  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:11:20.977065  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:11:20.977437  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:11:20.977694  862106 main.go:141] libmachine: (ha-798963) Calling .GetState

	I1028 13:11:20.979673  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:11:20.980165  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:11:20.980220  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:11:20.997701  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46143

	I1028 13:11:20.998153  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:11:20.998679  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:11:20.998710  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:11:20.999089  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:11:20.999277  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:11:20.999477  862106 certs.go:68] Setting up /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963 for IP: 192.168.39.22

	I1028 13:11:20.999491  862106 certs.go:194] generating shared ca certs ...

	I1028 13:11:20.999512  862106 certs.go:226] acquiring lock for ca certs: {Name:mk72dd610cd229d2e25ba7be15f7e5f7b195435a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:11:20.999675  862106 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key

	I1028 13:11:20.999736  862106 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key

	I1028 13:11:20.999771  862106 certs.go:256] generating profile certs ...

	I1028 13:11:20.999872  862106 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key

	I1028 13:11:20.999907  862106 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53

	I1028 13:11:20.999930  862106 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.179 192.168.39.109 192.168.39.22 192.168.39.254]

	I1028 13:11:21.169463  862106 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53 ...

	I1028 13:11:21.169502  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53: {Name:mkfb39be0a4b7218928840044aac9fa4623d2f25 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:11:21.169697  862106 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53 ...

	I1028 13:11:21.169714  862106 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53: {Name:mka51f3d4a17f0305a22426a8af18a5cc4ed6c4c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I1028 13:11:21.169814  862106 certs.go:381] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt.1cc94d53 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt

	I1028 13:11:21.169983  862106 certs.go:385] copying /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key.1cc94d53 -> /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key

	I1028 13:11:21.170160  862106 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key

	I1028 13:11:21.170180  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I1028 13:11:21.170199  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I1028 13:11:21.170216  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I1028 13:11:21.170243  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I1028 13:11:21.170267  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I1028 13:11:21.170286  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I1028 13:11:21.170304  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I1028 13:11:21.183925  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I1028 13:11:21.184041  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem (1338 bytes)

	W1028 13:11:21.184085  862106 certs.go:480] ignoring /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062_empty.pem, impossibly tiny 0 bytes

	I1028 13:11:21.184097  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca-key.pem (1679 bytes)

	I1028 13:11:21.184125  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/ca.pem (1082 bytes)

	I1028 13:11:21.184159  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/cert.pem (1123 bytes)

	I1028 13:11:21.184185  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/key.pem (1679 bytes)

	I1028 13:11:21.184228  862106 certs.go:484] found cert: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem (1708 bytes)

	I1028 13:11:21.184271  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem -> /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.184289  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.184305  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem -> /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.184350  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:11:21.187693  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:21.188343  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:11:21.188383  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:21.188590  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:11:21.188853  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:11:21.189079  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:11:21.189273  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:11:21.268341  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I1028 13:11:21.273886  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I1028 13:11:21.289278  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I1028 13:11:21.294832  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I1028 13:11:21.306787  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I1028 13:11:21.311198  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I1028 13:11:21.323910  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I1028 13:11:21.329122  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1675 bytes)

	I1028 13:11:21.341443  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I1028 13:11:21.345899  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I1028 13:11:21.357191  862106 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I1028 13:11:21.361390  862106 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I1028 13:11:21.372614  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I1028 13:11:21.398374  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1675 bytes)

	I1028 13:11:21.422379  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I1028 13:11:21.447790  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I1028 13:11:21.472891  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I1028 13:11:21.497530  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I1028 13:11:21.522231  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I1028 13:11:21.546660  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I1028 13:11:21.571603  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/files/etc/ssl/certs/8470622.pem --> /usr/share/ca-certificates/8470622.pem (1708 bytes)

	I1028 13:11:21.596900  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I1028 13:11:21.621985  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/certs/847062.pem --> /usr/share/ca-certificates/847062.pem (1338 bytes)

	I1028 13:11:21.647893  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I1028 13:11:21.665557  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I1028 13:11:21.682787  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I1028 13:11:21.699768  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1675 bytes)

	I1028 13:11:21.716300  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I1028 13:11:21.733754  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I1028 13:11:21.750232  862106 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I1028 13:11:21.767138  862106 ssh_runner.go:195] Run: openssl version

	I1028 13:11:21.772855  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/847062.pem && ln -fs /usr/share/ca-certificates/847062.pem /etc/ssl/certs/847062.pem"

	I1028 13:11:21.783895  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.788920  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Oct 28 13:01 /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.789013  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/847062.pem

	I1028 13:11:21.795538  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/847062.pem /etc/ssl/certs/51391683.0"

	I1028 13:11:21.806866  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8470622.pem && ln -fs /usr/share/ca-certificates/8470622.pem /etc/ssl/certs/8470622.pem"

	I1028 13:11:21.818968  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.823589  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Oct 28 13:01 /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.823673  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8470622.pem

	I1028 13:11:21.829690  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8470622.pem /etc/ssl/certs/3ec20f2e.0"

	I1028 13:11:21.840568  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I1028 13:11:21.851939  862106 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.857586  862106 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Oct 28 12:21 /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.857660  862106 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I1028 13:11:21.863890  862106 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I1028 13:11:21.875293  862106 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I1028 13:11:21.879705  862106 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I1028 13:11:21.879811  862106 kubeadm.go:934] updating node {m03 192.168.39.22 8443 v1.31.2 crio true true} ...

	I1028 13:11:21.879924  862106 kubeadm.go:946] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.31.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-798963-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.22

	[Install]

	 config:

	{KubernetesVersion:v1.31.2 ClusterName:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I1028 13:11:21.879964  862106 kube-vip.go:115] generating kube-vip config ...

	I1028 13:11:21.880015  862106 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I1028 13:11:21.899027  862106 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I1028 13:11:21.899121  862106 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.4

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I1028 13:11:21.899189  862106 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.31.2

	I1028 13:11:21.909174  862106 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.31.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.31.2': No such file or directory

	Initiating transfer...

	I1028 13:11:21.909251  862106 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.31.2

	I1028 13:11:21.919595  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubelet.sha256

	I1028 13:11:21.919595  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubeadm.sha256

	I1028 13:11:21.919661  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:11:21.919666  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm -> /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:11:21.919734  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm

	I1028 13:11:21.919596  862106 binary.go:74] Not caching binary, using https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.31.2/bin/linux/amd64/kubectl.sha256

	I1028 13:11:21.919769  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl -> /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:11:21.919829  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl

	I1028 13:11:21.929846  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubectl': No such file or directory

	I1028 13:11:21.929900  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubectl --> /var/lib/minikube/binaries/v1.31.2/kubectl (56381592 bytes)

	I1028 13:11:21.929907  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubeadm': No such file or directory

	I1028 13:11:21.929940  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubeadm --> /var/lib/minikube/binaries/v1.31.2/kubeadm (58290328 bytes)

	I1028 13:11:21.967513  862106 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet -> /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:11:21.967622  862106 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet

	I1028 13:11:22.100910  862106 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.31.2/kubelet: stat -c "%s %y" /var/lib/minikube/binaries/v1.31.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.31.2/kubelet': No such file or directory

	I1028 13:11:22.100971  862106 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19865-839778/.minikube/cache/linux/amd64/v1.31.2/kubelet --> /var/lib/minikube/binaries/v1.31.2/kubelet (76902744 bytes)

	I1028 13:11:22.865953  862106 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I1028 13:11:22.877219  862106 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I1028 13:11:22.895542  862106 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I1028 13:11:22.913654  862106 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I1028 13:11:22.931775  862106 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I1028 13:11:22.935865  862106 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I1028 13:11:22.948405  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:11:23.077983  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:11:23.095707  862106 host.go:66] Checking if "ha-798963" exists ...

	I1028 13:11:23.096270  862106 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I1028 13:11:23.096349  862106 main.go:141] libmachine: Launching plugin server for driver kvm2

	I1028 13:11:23.112694  862106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39623

	I1028 13:11:23.113318  862106 main.go:141] libmachine: () Calling .GetVersion

	I1028 13:11:23.113918  862106 main.go:141] libmachine: Using API Version  1

	I1028 13:11:23.113943  862106 main.go:141] libmachine: () Calling .SetConfigRaw

	I1028 13:11:23.114443  862106 main.go:141] libmachine: () Calling .GetMachineName

	I1028 13:11:23.114718  862106 main.go:141] libmachine: (ha-798963) Calling .DriverName

	I1028 13:11:23.114884  862106 start.go:317] joinCluster: &{Name:ha-798963 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19806/minikube-v1.34.0-1729002252-19806-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.45-1729876044-19868@sha256:98fb05d9d766cf8d630ce90381e12faa07711c611be9bb2c767cfc936533477e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.31.2 Cluster

Name:ha-798963 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.179 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.22 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false amd-gpu-device-plugin:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false inaccel:false ingress:false ingress-d

ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror:

DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I1028 13:11:23.115032  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I1028 13:11:23.115052  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHHostname

	I1028 13:11:23.117980  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:23.118457  862106 main.go:141] libmachine: (ha-798963) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:aa:02:0b", ip: ""} in network mk-ha-798963: {Iface:virbr1 ExpiryTime:2024-10-28 14:09:09 +0000 UTC Type:0 Mac:52:54:00:aa:02:0b Iaid: IPaddr:192.168.39.179 Prefix:24 Hostname:ha-798963 Clientid:01:52:54:00:aa:02:0b}

	I1028 13:11:23.118489  862106 main.go:141] libmachine: (ha-798963) DBG | domain ha-798963 has defined IP address 192.168.39.179 and MAC address 52:54:00:aa:02:0b in network mk-ha-798963

	I1028 13:11:23.118682  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHPort

	I1028 13:11:23.118883  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHKeyPath

	I1028 13:11:23.119045  862106 main.go:141] libmachine: (ha-798963) Calling .GetSSHUsername

	I1028 13:11:23.119242  862106 sshutil.go:53] new ssh client: &{IP:192.168.39.179 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19865-839778/.minikube/machines/ha-798963/id_rsa Username:docker}

	I1028 13:11:23.278294  862106 start.go:343] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.22 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:11:23.278359  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 7bw2w9.tm44hy401jutwnn7 --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m03 --control-plane --apiserver-advertise-address=192.168.39.22 --apiserver-bind-port=8443"

	I1028 13:11:46.129202  862106 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.31.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 7bw2w9.tm44hy401jutwnn7 --discovery-token-ca-cert-hash sha256:37c7254480a8ba3d927cfb3c3558d3cb4cc7eb6e28dba8c3215c3732ef96528d --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-798963-m03 --control-plane --apiserver-advertise-address=192.168.39.22 --apiserver-bind-port=8443": (22.8507898s)

	I1028 13:11:46.129241  862106 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I1028 13:11:46.714736  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-798963-m03 minikube.k8s.io/updated_at=2024_10_28T13_11_46_0700 minikube.k8s.io/version=v1.34.0 minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc minikube.k8s.io/name=ha-798963 minikube.k8s.io/primary=false

	I1028 13:11:46.854280  862106 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.31.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-798963-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I1028 13:11:46.968024  862106 start.go:319] duration metric: took 23.853147601s to joinCluster

	I1028 13:11:46.968195  862106 start.go:235] Will wait 6m0s for node &{Name:m03 IP:192.168.39.22 Port:8443 KubernetesVersion:v1.31.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I1028 13:11:46.968614  862106 config.go:182] Loaded profile config "ha-798963": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.31.2

	I1028 13:11:46.971219  862106 out.go:177] * Verifying Kubernetes components...

	I1028 13:11:46.972990  862106 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I1028 13:11:47.231231  862106 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I1028 13:11:47.310133  862106 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19865-839778/kubeconfig

	I1028 13:11:47.310473  862106 kapi.go:59] client config for ha-798963: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.crt", KeyFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/profiles/ha-798963/client.key", CAFile:"/home/jenkins/minikube-integration/19865-839778/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x2439ec0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W1028 13:11:47.310988  862106 kubeadm.go:483] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.179:8443

	I1028 13:11:47.312238  862106 node_ready.go:35] waiting up to 6m0s for node "ha-798963-m03" to be "Ready" ...

	I1028 13:11:47.312381  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:47.312393  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:47.312404  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:47.312410  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:47.316954  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:47.812518  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:47.812547  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:47.812555  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:47.812559  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:47.816919  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:48.313316  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:48.313342  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:48.313351  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:48.313356  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:48.317261  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:48.813088  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:48.813119  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:48.813132  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:48.813139  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:48.816489  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:49.312690  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:49.312718  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:49.312728  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:49.312732  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:49.316198  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:49.316807  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:49.813117  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:49.813150  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:49.813164  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:49.813170  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:49.817118  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:50.313080  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:50.313119  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:50.313130  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:50.313136  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:50.318258  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:11:50.812971  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:50.812996  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:50.813004  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:50.813008  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:50.817641  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:51.312873  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:51.312900  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:51.312909  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:51.312915  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:51.317497  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:51.318095  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:51.813121  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:51.813160  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:51.813173  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:51.813178  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:51.816880  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:52.313447  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:52.313478  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:52.313493  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:52.313501  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:52.317360  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:52.813107  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:52.813143  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:52.813156  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:52.813161  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:52.817062  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:53.313338  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:53.313369  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:53.313383  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:53.313389  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:53.317314  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:53.813338  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:53.813363  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:53.813372  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:53.813375  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:53.817321  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:53.817898  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:54.313122  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:54.313145  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:54.313153  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:54.313158  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:54.317346  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:54.812531  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:54.812557  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:54.812566  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:54.812572  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:54.816528  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:55.313312  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:55.313333  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:55.313341  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:55.313344  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:55.318403  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:11:55.813095  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:55.813124  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:55.813135  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:55.813140  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:55.817082  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:56.313040  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:56.313066  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:56.313075  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:56.313078  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:56.316501  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:56.316942  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:56.813092  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:56.813118  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:56.813127  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:56.813131  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:56.817321  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:57.313363  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:57.313388  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:57.313399  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:57.313405  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:57.317277  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:57.812796  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:57.812822  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:57.812830  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:57.812834  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:57.816289  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:58.312654  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:58.312680  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:58.312691  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:58.312695  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:58.317251  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:11:58.317795  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:11:58.813076  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:58.813108  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:58.813118  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:58.813122  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:58.816604  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:59.313052  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:59.313080  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:59.313091  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:59.313118  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:59.316562  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:11:59.812477  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:11:59.812503  862106 round_trippers.go:469] Request Headers:

	I1028 13:11:59.812511  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:11:59.812514  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:11:59.816200  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:00.313237  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:00.313282  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:00.313294  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:00.313300  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:00.316714  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:00.813335  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:00.813365  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:00.813375  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:00.813389  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:00.817154  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:00.817976  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:12:01.312651  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:01.312674  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:01.312686  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:01.312690  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:01.316888  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:01.812732  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:01.812759  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:01.812772  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:01.812778  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:01.816876  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:02.313031  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:02.313067  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:02.313080  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:02.313089  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:02.316362  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:02.813263  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:02.813287  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:02.813297  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:02.813303  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:02.817262  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:03.312875  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:03.312901  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:03.312909  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:03.312914  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:03.316584  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:03.317194  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:12:03.812576  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:03.812610  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:03.812619  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:03.812625  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:03.815796  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:04.312708  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:04.312733  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:04.312742  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:04.312746  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:04.316530  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:04.813485  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:04.813513  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:04.813521  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:04.813525  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:04.817777  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:05.313514  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:05.313540  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:05.313551  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:05.313556  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:05.317623  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:05.318128  862106 node_ready.go:53] node "ha-798963-m03" has status "Ready":"False"

	I1028 13:12:05.813495  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:05.813522  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:05.813530  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:05.813534  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:05.817916  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:06.313490  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:06.313516  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.313525  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.313529  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.317617  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:06.318134  862106 node_ready.go:49] node "ha-798963-m03" has status "Ready":"True"

	I1028 13:12:06.318158  862106 node_ready.go:38] duration metric: took 19.005890906s for node "ha-798963-m03" to be "Ready" ...

	I1028 13:12:06.318170  862106 pod_ready.go:36] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:12:06.318257  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:06.318270  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.318281  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.318287  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.325329  862106 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I1028 13:12:06.332608  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.332712  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-7x97m

	I1028 13:12:06.332722  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.332730  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.332735  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.336764  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:06.337822  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:06.337850  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.337862  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.337869  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.340953  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.341417  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.341452  862106 pod_ready.go:82] duration metric: took 8.810785ms for pod "coredns-7c65d6cfc9-7x97m" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.341466  862106 pod_ready.go:79] waiting up to 6m0s for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.341553  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/coredns-7c65d6cfc9-bdv2v

	I1028 13:12:06.341563  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.341570  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.341574  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.347268  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:12:06.348205  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:06.348228  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.348239  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.348246  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.351222  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:12:06.352239  862106 pod_ready.go:93] pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.352264  862106 pod_ready.go:82] duration metric: took 10.789556ms for pod "coredns-7c65d6cfc9-bdv2v" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.352278  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.352368  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963

	I1028 13:12:06.352379  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.352389  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.352396  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.355719  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.356377  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:06.356397  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.356407  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.356412  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.359573  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.360167  862106 pod_ready.go:93] pod "etcd-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.360189  862106 pod_ready.go:82] duration metric: took 7.903896ms for pod "etcd-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.360199  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.360274  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m02

	I1028 13:12:06.360284  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.360292  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.360297  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.363570  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.364099  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:06.364114  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.364122  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.364128  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.366807  862106 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I1028 13:12:06.367300  862106 pod_ready.go:93] pod "etcd-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.367320  862106 pod_ready.go:82] duration metric: took 7.113533ms for pod "etcd-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.367332  862106 pod_ready.go:79] waiting up to 6m0s for pod "etcd-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.513665  862106 request.go:632] Waited for 146.244316ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m03

	I1028 13:12:06.513759  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/etcd-ha-798963-m03

	I1028 13:12:06.513765  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.513772  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.513776  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.517625  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.713582  862106 request.go:632] Waited for 195.302177ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:06.713677  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:06.713683  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.713693  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.713697  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.717372  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:06.718301  862106 pod_ready.go:93] pod "etcd-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:06.718323  862106 pod_ready.go:82] duration metric: took 350.983163ms for pod "etcd-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.718339  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:06.913595  862106 request.go:632] Waited for 195.182715ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:12:06.913692  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963

	I1028 13:12:06.913701  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:06.913710  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:06.913714  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:06.917368  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:07.114493  862106 request.go:632] Waited for 196.400044ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:07.114623  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:07.114654  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.114669  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.114679  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.118462  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:07.118997  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:07.119020  862106 pod_ready.go:82] duration metric: took 400.673467ms for pod "kube-apiserver-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.119031  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.314142  862106 request.go:632] Waited for 195.007097ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:12:07.314248  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m02

	I1028 13:12:07.314260  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.314273  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.314282  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.322683  862106 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I1028 13:12:07.513795  862106 request.go:632] Waited for 190.442824ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:07.513881  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:07.513892  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.513905  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.513916  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.518175  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:07.518756  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:07.518784  862106 pod_ready.go:82] duration metric: took 399.744785ms for pod "kube-apiserver-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.518799  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-apiserver-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.713798  862106 request.go:632] Waited for 194.910105ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m03

	I1028 13:12:07.713866  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-798963-m03

	I1028 13:12:07.713872  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.713881  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.713886  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.718462  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:07.914092  862106 request.go:632] Waited for 194.338244ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:07.914162  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:07.914169  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:07.914181  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:07.914192  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:07.917666  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:07.918344  862106 pod_ready.go:93] pod "kube-apiserver-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:07.918367  862106 pod_ready.go:82] duration metric: took 399.560719ms for pod "kube-apiserver-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:07.918378  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.114520  862106 request.go:632] Waited for 196.013722ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:12:08.114597  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963

	I1028 13:12:08.114602  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.114613  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.114619  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.118293  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:08.314398  862106 request.go:632] Waited for 195.403712ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:08.314476  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:08.314487  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.314497  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.314505  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.318433  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:08.318965  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:08.318987  862106 pod_ready.go:82] duration metric: took 400.600208ms for pod "kube-controller-manager-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.319000  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.514210  862106 request.go:632] Waited for 195.114115ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:12:08.514292  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m02

	I1028 13:12:08.514297  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.514305  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.514310  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.518338  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:08.713518  862106 request.go:632] Waited for 194.314657ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:08.713609  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:08.713616  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.713628  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.713664  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.717711  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:08.718259  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:08.718285  862106 pod_ready.go:82] duration metric: took 399.274271ms for pod "kube-controller-manager-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.718299  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-controller-manager-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:08.914405  862106 request.go:632] Waited for 195.97635ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m03

	I1028 13:12:08.914485  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-798963-m03

	I1028 13:12:08.914492  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:08.914500  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:08.914504  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:08.918184  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.114370  862106 request.go:632] Waited for 195.412683ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.114451  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.114459  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.114470  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.114478  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.118332  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.118868  862106 pod_ready.go:93] pod "kube-controller-manager-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:09.118890  862106 pod_ready.go:82] duration metric: took 400.583554ms for pod "kube-controller-manager-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.118901  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.314002  862106 request.go:632] Waited for 195.020962ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:12:09.314075  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-6j2hc

	I1028 13:12:09.314082  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.314091  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.314096  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.317294  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.514483  862106 request.go:632] Waited for 196.396761ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:09.514553  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:09.514565  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.514580  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.514585  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.518434  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.519040  862106 pod_ready.go:93] pod "kube-proxy-6j2hc" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:09.519070  862106 pod_ready.go:82] duration metric: took 400.161852ms for pod "kube-proxy-6j2hc" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.519085  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-7xs2n" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.714183  862106 request.go:632] Waited for 194.999401ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7xs2n

	I1028 13:12:09.714251  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-7xs2n

	I1028 13:12:09.714257  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.714265  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.714271  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.718005  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.913595  862106 request.go:632] Waited for 194.841352ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.913694  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:09.913703  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:09.913714  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:09.913725  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:09.917053  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:09.917714  862106 pod_ready.go:93] pod "kube-proxy-7xs2n" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:09.917734  862106 pod_ready.go:82] duration metric: took 398.638102ms for pod "kube-proxy-7xs2n" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:09.917747  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.114084  862106 request.go:632] Waited for 196.130523ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:12:10.114185  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ltx8s

	I1028 13:12:10.114197  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.114214  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.114226  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.118633  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:10.313732  862106 request.go:632] Waited for 194.304231ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:10.313810  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:10.313816  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.313824  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.313828  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.317722  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:10.318285  862106 pod_ready.go:93] pod "kube-proxy-ltx8s" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:10.318307  862106 pod_ready.go:82] duration metric: took 400.55347ms for pod "kube-proxy-ltx8s" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.318317  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.514568  862106 request.go:632] Waited for 196.139269ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:12:10.514648  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963

	I1028 13:12:10.514659  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.514672  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.514679  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.519045  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:10.714075  862106 request.go:632] Waited for 194.390595ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:10.714146  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963

	I1028 13:12:10.714158  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.714170  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.714175  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.717323  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:10.717813  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:10.717835  862106 pod_ready.go:82] duration metric: took 399.512114ms for pod "kube-scheduler-ha-798963" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.717847  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:10.913990  862106 request.go:632] Waited for 196.038539ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:12:10.914073  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m02

	I1028 13:12:10.914079  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:10.914087  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:10.914099  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:10.917877  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:11.113506  862106 request.go:632] Waited for 194.978362ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:11.113605  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m02

	I1028 13:12:11.113617  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.113629  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.113638  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.117559  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:11.118136  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:11.118165  862106 pod_ready.go:82] duration metric: took 400.309713ms for pod "kube-scheduler-ha-798963-m02" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:11.118183  862106 pod_ready.go:79] waiting up to 6m0s for pod "kube-scheduler-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:11.314391  862106 request.go:632] Waited for 196.099367ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m03

	I1028 13:12:11.314478  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-798963-m03

	I1028 13:12:11.314489  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.314501  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.314513  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.319958  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:12:11.514098  862106 request.go:632] Waited for 193.368848ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:11.514176  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes/ha-798963-m03

	I1028 13:12:11.514251  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.514266  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.514270  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.517766  862106 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I1028 13:12:11.518431  862106 pod_ready.go:93] pod "kube-scheduler-ha-798963-m03" in "kube-system" namespace has status "Ready":"True"

	I1028 13:12:11.518454  862106 pod_ready.go:82] duration metric: took 400.260585ms for pod "kube-scheduler-ha-798963-m03" in "kube-system" namespace to be "Ready" ...

	I1028 13:12:11.518469  862106 pod_ready.go:39] duration metric: took 5.200285512s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I1028 13:12:11.518493  862106 api_server.go:52] waiting for apiserver process to appear ...

	I1028 13:12:11.518550  862106 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I1028 13:12:11.533390  862106 api_server.go:72] duration metric: took 24.565133834s to wait for apiserver process to appear ...

	I1028 13:12:11.533417  862106 api_server.go:88] waiting for apiserver healthz status ...

	I1028 13:12:11.533440  862106 api_server.go:253] Checking apiserver healthz at https://192.168.39.179:8443/healthz ...

	I1028 13:12:11.539587  862106 api_server.go:279] https://192.168.39.179:8443/healthz returned 200:

	ok

	I1028 13:12:11.539676  862106 round_trippers.go:463] GET https://192.168.39.179:8443/version

	I1028 13:12:11.539684  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.539693  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.539697  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.540699  862106 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I1028 13:12:11.540763  862106 api_server.go:141] control plane version: v1.31.2

	I1028 13:12:11.540777  862106 api_server.go:131] duration metric: took 7.353485ms to wait for apiserver health ...

	I1028 13:12:11.540789  862106 system_pods.go:43] waiting for kube-system pods to appear ...

	I1028 13:12:11.714204  862106 request.go:632] Waited for 173.306405ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:11.714267  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:11.714273  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.714281  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.714286  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.720558  862106 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I1028 13:12:11.726967  862106 system_pods.go:59] 24 kube-system pods found

	I1028 13:12:11.727007  862106 system_pods.go:61] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:12:11.727013  862106 system_pods.go:61] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:12:11.727017  862106 system_pods.go:61] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:12:11.727020  862106 system_pods.go:61] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:12:11.727023  862106 system_pods.go:61] "etcd-ha-798963-m03" [1f79ef8e-3ad7-4661-b55d-9ecdfe0c6f93] Running

	I1028 13:12:11.727026  862106 system_pods.go:61] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:12:11.727030  862106 system_pods.go:61] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:12:11.727033  862106 system_pods.go:61] "kindnet-fqc7b" [c0e1b714-47e3-44fd-9e87-692df3f2620c] Running

	I1028 13:12:11.727036  862106 system_pods.go:61] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:12:11.727039  862106 system_pods.go:61] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:12:11.727042  862106 system_pods.go:61] "kube-apiserver-ha-798963-m03" [5ba03b60-173f-4796-9803-2e55f5b72770] Running

	I1028 13:12:11.727045  862106 system_pods.go:61] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:12:11.727048  862106 system_pods.go:61] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:12:11.727050  862106 system_pods.go:61] "kube-controller-manager-ha-798963-m03" [0eb11503-cae9-4981-964a-59dbe1026305] Running

	I1028 13:12:11.727053  862106 system_pods.go:61] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:12:11.727056  862106 system_pods.go:61] "kube-proxy-7xs2n" [84d19e98-573b-4105-8ab9-f10b6a92dd95] Running

	I1028 13:12:11.727058  862106 system_pods.go:61] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:12:11.727061  862106 system_pods.go:61] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:12:11.727069  862106 system_pods.go:61] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:12:11.727072  862106 system_pods.go:61] "kube-scheduler-ha-798963-m03" [62d6b3e8-973e-4bed-a412-faa22e21b9f7] Running

	I1028 13:12:11.727075  862106 system_pods.go:61] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:12:11.727078  862106 system_pods.go:61] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:12:11.727081  862106 system_pods.go:61] "kube-vip-ha-798963-m03" [9796a102-575e-4d85-acf7-817d1f50d1f3] Running

	I1028 13:12:11.727084  862106 system_pods.go:61] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:12:11.727090  862106 system_pods.go:74] duration metric: took 186.291332ms to wait for pod list to return data ...

	I1028 13:12:11.727099  862106 default_sa.go:34] waiting for default service account to be created ...

	I1028 13:12:11.914614  862106 request.go:632] Waited for 187.423359ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:12:11.914693  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/default/serviceaccounts

	I1028 13:12:11.914701  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:11.914712  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:11.914720  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:11.919465  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:11.919622  862106 default_sa.go:45] found service account: "default"

	I1028 13:12:11.919639  862106 default_sa.go:55] duration metric: took 192.533902ms for default service account to be created ...

	I1028 13:12:11.919649  862106 system_pods.go:116] waiting for k8s-apps to be running ...

	I1028 13:12:12.114135  862106 request.go:632] Waited for 194.365447ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:12.114225  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/namespaces/kube-system/pods

	I1028 13:12:12.114233  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:12.114241  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:12.114246  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:12.119917  862106 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I1028 13:12:12.126683  862106 system_pods.go:86] 24 kube-system pods found

	I1028 13:12:12.126720  862106 system_pods.go:89] "coredns-7c65d6cfc9-7x97m" [c7d05c6c-0f32-4117-b2ed-0d78ba540398] Running

	I1028 13:12:12.126727  862106 system_pods.go:89] "coredns-7c65d6cfc9-bdv2v" [b37baf73-b638-4344-afae-c876511e5212] Running

	I1028 13:12:12.126731  862106 system_pods.go:89] "etcd-ha-798963" [8fed6f57-59d2-4d35-921f-0d0087d8c827] Running

	I1028 13:12:12.126735  862106 system_pods.go:89] "etcd-ha-798963-m02" [779599f3-efda-4c5c-94c5-37fbb94b8c82] Running

	I1028 13:12:12.126738  862106 system_pods.go:89] "etcd-ha-798963-m03" [1f79ef8e-3ad7-4661-b55d-9ecdfe0c6f93] Running

	I1028 13:12:12.126742  862106 system_pods.go:89] "kindnet-46mzj" [d9757600-09b2-4bf8-9b0f-b0ca2190ec22] Running

	I1028 13:12:12.126745  862106 system_pods.go:89] "kindnet-9m2qk" [fec3821c-4171-4585-ab17-1799300aac7c] Running

	I1028 13:12:12.126750  862106 system_pods.go:89] "kindnet-fqc7b" [c0e1b714-47e3-44fd-9e87-692df3f2620c] Running

	I1028 13:12:12.126755  862106 system_pods.go:89] "kube-apiserver-ha-798963" [db81579f-4c40-4144-a661-021fe9104d17] Running

	I1028 13:12:12.126761  862106 system_pods.go:89] "kube-apiserver-ha-798963-m02" [ce0aaaf0-067e-414a-aac7-b5df159a84fc] Running

	I1028 13:12:12.126766  862106 system_pods.go:89] "kube-apiserver-ha-798963-m03" [5ba03b60-173f-4796-9803-2e55f5b72770] Running

	I1028 13:12:12.126773  862106 system_pods.go:89] "kube-controller-manager-ha-798963" [ca98cf48-498e-4686-baf7-5a809782d138] Running

	I1028 13:12:12.126779  862106 system_pods.go:89] "kube-controller-manager-ha-798963-m02" [8ee1c045-6054-4ecf-88ae-efea472e93b3] Running

	I1028 13:12:12.126784  862106 system_pods.go:89] "kube-controller-manager-ha-798963-m03" [0eb11503-cae9-4981-964a-59dbe1026305] Running

	I1028 13:12:12.126793  862106 system_pods.go:89] "kube-proxy-6j2hc" [9228fc3d-f9df-4683-86ac-9a302cbcf375] Running

	I1028 13:12:12.126798  862106 system_pods.go:89] "kube-proxy-7xs2n" [84d19e98-573b-4105-8ab9-f10b6a92dd95] Running

	I1028 13:12:12.126803  862106 system_pods.go:89] "kube-proxy-ltx8s" [b278b4cc-2129-4fbc-ad47-22dccdd27277] Running

	I1028 13:12:12.126809  862106 system_pods.go:89] "kube-scheduler-ha-798963" [deb1e2e8-9094-4c55-8ea6-9b62020930ae] Running

	I1028 13:12:12.126814  862106 system_pods.go:89] "kube-scheduler-ha-798963-m02" [ae72caa1-6cf2-4fe6-b2eb-3f5cdd45d53f] Running

	I1028 13:12:12.126819  862106 system_pods.go:89] "kube-scheduler-ha-798963-m03" [62d6b3e8-973e-4bed-a412-faa22e21b9f7] Running

	I1028 13:12:12.126826  862106 system_pods.go:89] "kube-vip-ha-798963" [56f9f069-df85-4e0a-984d-952535ef4abf] Running

	I1028 13:12:12.126829  862106 system_pods.go:89] "kube-vip-ha-798963-m02" [2f1db448-3573-4e17-b0aa-ad26bcbe7ece] Running

	I1028 13:12:12.126832  862106 system_pods.go:89] "kube-vip-ha-798963-m03" [9796a102-575e-4d85-acf7-817d1f50d1f3] Running

	I1028 13:12:12.126835  862106 system_pods.go:89] "storage-provisioner" [511a7476-ef8d-4f7f-891d-99c4b1edaca1] Running

	I1028 13:12:12.126843  862106 system_pods.go:126] duration metric: took 207.188515ms to wait for k8s-apps to be running ...

	I1028 13:12:12.126855  862106 system_svc.go:44] waiting for kubelet service to be running ....

	I1028 13:12:12.126916  862106 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I1028 13:12:12.143874  862106 system_svc.go:56] duration metric: took 17.004242ms WaitForService to wait for kubelet

	I1028 13:12:12.143919  862106 kubeadm.go:582] duration metric: took 25.175668488s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I1028 13:12:12.143952  862106 node_conditions.go:102] verifying NodePressure condition ...

	I1028 13:12:12.314519  862106 request.go:632] Waited for 170.436984ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.179:8443/api/v1/nodes

	I1028 13:12:12.314593  862106 round_trippers.go:463] GET https://192.168.39.179:8443/api/v1/nodes

	I1028 13:12:12.314604  862106 round_trippers.go:469] Request Headers:

	I1028 13:12:12.314615  862106 round_trippers.go:473]     Accept: application/json, */*

	I1028 13:12:12.314624  862106 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I1028 13:12:12.318728  862106 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I1028 13:12:12.319643  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:12:12.319665  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:12:12.319677  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:12:12.319681  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:12:12.319684  862106 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I1028 13:12:12.319688  862106 node_conditions.go:123] node cpu capacity is 2

	I1028 13:12:12.319692  862106 node_conditions.go:105] duration metric: took 175.73394ms to run NodePressure ...

	I1028 13:12:12.319703  862106 start.go:241] waiting for startup goroutines ...

	I1028 13:12:12.319724  862106 start.go:255] writing updated cluster config ...

	I1028 13:12:12.320061  862106 ssh_runner.go:195] Run: rm -f paused

	I1028 13:12:12.373485  862106 start.go:600] kubectl: 1.31.2, cluster: 1.31.2 (minor skew: 0)

	I1028 13:12:12.375904  862106 out.go:177] * Done! kubectl is now configured to use "ha-798963" cluster and "default" namespace by default

	==> CRI-O <==

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.161855124Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121361161834350,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=09099c41-1c7e-471f-941e-ac5350e74417 name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.162605314Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=1323a1a2-dbb3-489e-9d5a-80d5484916e8 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.162672356Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=1323a1a2-dbb3-489e-9d5a-80d5484916e8 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.162898394Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=1323a1a2-dbb3-489e-9d5a-80d5484916e8 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.204069220Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=961cfe76-92cb-4576-b3e7-fd7da597c15b name=/runtime.v1.RuntimeService/Version

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.204148722Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=961cfe76-92cb-4576-b3e7-fd7da597c15b name=/runtime.v1.RuntimeService/Version

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.205080619Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=d4add6d6-abe7-4c42-b991-7829ce1370c3 name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.205581964Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121361205557488,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=d4add6d6-abe7-4c42-b991-7829ce1370c3 name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.206113126Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=ba37cb9a-2384-41a0-bd50-62dc6a016718 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.206167437Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=ba37cb9a-2384-41a0-bd50-62dc6a016718 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.206497526Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=ba37cb9a-2384-41a0-bd50-62dc6a016718 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.254034763Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=7950e1b3-af7b-4d72-bd3e-8b060cccc446 name=/runtime.v1.RuntimeService/Version

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.254120923Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=7950e1b3-af7b-4d72-bd3e-8b060cccc446 name=/runtime.v1.RuntimeService/Version

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.255409788Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=40a2e93f-7af1-4392-be9a-0d477618732d name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.256260827Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121361256230291,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=40a2e93f-7af1-4392-be9a-0d477618732d name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.256773993Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=e67905cb-d4be-46be-9877-70687ce2ca7d name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.256827784Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=e67905cb-d4be-46be-9877-70687ce2ca7d name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.257145326Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=e67905cb-d4be-46be-9877-70687ce2ca7d name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.296458359Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=b1c7d5e4-57be-4f05-9add-0601c1e48adc name=/runtime.v1.RuntimeService/Version

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.296681379Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=b1c7d5e4-57be-4f05-9add-0601c1e48adc name=/runtime.v1.RuntimeService/Version

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.297930797Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=9aecc9d8-32a9-4ac8-b2e7-0863aab2a13c name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.298429823Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121361298406566,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=9aecc9d8-32a9-4ac8-b2e7-0863aab2a13c name=/runtime.v1.ImageService/ImageFsInfo

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.298893206Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=1860baa0-79e7-43bf-a67b-5f9bb0f82432 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.298946154Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=1860baa0-79e7-43bf-a67b-5f9bb0f82432 name=/runtime.v1.RuntimeService/ListContainers

	Oct 28 13:16:01 ha-798963 crio[665]: time="2024-10-28 13:16:01.299186660Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:d62f32fce43d762d6aec806e90fba097937c9682076ca5272ba46fa3de1e7e6f,PodSandboxId:6e6fe8abbe2d9c7e2b0fc57766b0621c26eb43d2a2884314895180481000fab0,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1730121137258223955,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-7dff88458-t5f9c,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 7eddf23e-f543-4920-a8ee-11a04fa53a71,},Annotations:map[string]string{io.kubernetes.container.hash: 82159afa,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803,PodSandboxId:e837604bf0b51a0a90acc674848f6b5860af5ec25a1237560d35f11be7f6b6c3,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120997006004335,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-7x97m,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c7d05c6c-0f32-4117-b2ed-0d78ba540398,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a,PodSandboxId:70433a36bd3f3b006eeefa8e2311b8d54baa08e6c6beffdb3bf716716350c878,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6,State:CONTAINER_RUNNING,CreatedAt:1730120996989953392,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7c65d6cfc9-bdv2v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

b37baf73-b638-4344-afae-c876511e5212,},Annotations:map[string]string{io.kubernetes.container.hash: 2a3a204d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:48ce850f7834320347519b61c595d8ed6cd3a3d1d816ca9478e55724e87491dd,PodSandboxId:a692c9ac64a0540423be8d88ba465e7c531939df9a3e59afca6ef950237739f8,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1730120996894419334,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 511a7476-ef8d-4f7f-891d-99c4b1edaca1,},Annotations:map[string]string{io.kubernetes.container.hash: 6c6bf961,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf,PodSandboxId:50601025470b27d21f611c930db5bfaa81d73fcea6e1010d7039c6ff825ff428,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9ca7e41918271bb074bb20850743fd9455129b071204789f09fa2b7304d7fad5,State:CO

NTAINER_RUNNING,CreatedAt:1730120985267484100,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-46mzj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d9757600-09b2-4bf8-9b0f-b0ca2190ec22,},Annotations:map[string]string{io.kubernetes.container.hash: e48ee0f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b,PodSandboxId:2d34c3aac8eea591247c804971ca65671f7db6fc43088d1eb0ee698f84ae654b,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38,State:CONTAINER_RUNNING,CreatedAt:1730120981

598578531,Labels:map[string]string{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-6j2hc,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 9228fc3d-f9df-4683-86ac-9a302cbcf375,},Annotations:map[string]string{io.kubernetes.container.hash: adb187fb,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:5e7810e058b3f953e1c72bc96db51cb0c1fa0c834d227a2e2bf21f8245fb7aca,PodSandboxId:084dc7a97d4f33cf3ef9673bc2dcdd88400f0f4fc8f5499bfb8169502f13785a,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:016cfb97b0edc5f5faf96fd4671670e2ee0c2263308214ac118721a81729592d,State:CONTAINER_RUNNING,CreatedAt:173012097346

9979704,Labels:map[string]string{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: de5ba8deb4e9a41c9db2d2b17222fa60,},Annotations:map[string]string{io.kubernetes.container.hash: f5549532,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f,PodSandboxId:9a475e92c2e11536433939fa3f85e1aa12d1bbb9dd0b2effa0ac467f6b6d60f0,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173,State:CONTAINER_RUNNING,CreatedAt:1730120970706096609,Labels:map[string]string{

io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: dbf1cd6f41523cdf9d1a370f3d9daa76,},Annotations:map[string]string{io.kubernetes.container.hash: c6927529,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc,PodSandboxId:4270e75a12719214707816f8bc357d3bb7274328baa632dd931be25843a448eb,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503,State:CONTAINER_RUNNING,CreatedAt:1730120970665976842,Labels:map[string]string{io.kubernete

s.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e810ac08ddc526831310ae5cfb01157a,},Annotations:map[string]string{io.kubernetes.container.hash: 3111262b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a,PodSandboxId:949f6bfe75a5f32fc4d045cd7864c746d9189f06ab282f9d465046c3959bde2e,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856,State:CONTAINER_RUNNING,CreatedAt:1730120970737772659,Labels:map[string]string{io.kubernetes.c

ontainer.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: cdaee35c49df265bcf11a4740313cff1,},Annotations:map[string]string{io.kubernetes.container.hash: 16c835f9,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de,PodSandboxId:ba99675ddb4fe1dd1c3bab5f022b2c4e25bd6457f36dd788bc2f3c07db54bf12,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4,State:CONTAINER_RUNNING,CreatedAt:1730120970650926195,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernet

es.pod.name: etcd-ha-798963,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: fe39a3c737f28198efc85ce46ba83a93,},Annotations:map[string]string{io.kubernetes.container.hash: cdf7d3fa,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=1860baa0-79e7-43bf-a67b-5f9bb0f82432 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	d62f32fce43d7       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   6e6fe8abbe2d9       busybox-7dff88458-t5f9c

	48a6bf2a9741a       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      6 minutes ago       Running             coredns                   0                   e837604bf0b51       coredns-7c65d6cfc9-7x97m

	84e026d6301e8       c69fa2e9cbf5f42dc48af631e956d3f95724c13f91596bc567591790e5e36db6                                      6 minutes ago       Running             coredns                   0                   70433a36bd3f3       coredns-7c65d6cfc9-bdv2v

	48ce850f78343       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      6 minutes ago       Running             storage-provisioner       0                   a692c9ac64a05       storage-provisioner

	e21d34c0daca4       docker.io/kindest/kindnetd@sha256:cddd34f7d74bf898f14080ed61e322a492689043dae46e93106c013373d68d16    6 minutes ago       Running             kindnet-cni               0                   50601025470b2       kindnet-46mzj

	f9e8711e7ed65       505d571f5fd56726488d27af0d9a8e02c6db58f5d62ea51dd10d47de7a0c2d38                                      6 minutes ago       Running             kube-proxy                0                   2d34c3aac8eea       kube-proxy-6j2hc

	5e7810e058b3f       ghcr.io/kube-vip/kube-vip@sha256:3742a655001d24c4ec1a4da019fdbacb1699cd42d40e34753848fb6b0c8b5215     6 minutes ago       Running             kube-vip                  0                   084dc7a97d4f3       kube-vip-ha-798963

	e3a123f30200b       847c7bc1a541865e150af08318f49d02d0e0cff4a0530fd4ffe369e294dd2856                                      6 minutes ago       Running             kube-scheduler            0                   949f6bfe75a5f       kube-scheduler-ha-798963

	bd9de91780ff9       9499c9960544e80a96c223cdc5d3059dd7c2cc37ea20e7138af4a6e415a49173                                      6 minutes ago       Running             kube-apiserver            0                   9a475e92c2e11       kube-apiserver-ha-798963

	e06d5644fa9b5       0486b6c53a1b5af26f2ad2fb89a089e04c6baa6369f8545ab0854f9d62b44503                                      6 minutes ago       Running             kube-controller-manager   0                   4270e75a12719       kube-controller-manager-ha-798963

	c9a5739fb7047       2e96e5913fc06e3d26915af3d0f2ca5048cc4b6327e661e80da792cbf8d8d9d4                                      6 minutes ago       Running             etcd                      0                   ba99675ddb4fe       etcd-ha-798963

	==> coredns [48a6bf2a9741a4fb4838d3d2c2182efd33fdcf92d7f170e9bf0b8c20083fd803] <==

	[INFO] 10.244.1.2:56690 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000223484s

	[INFO] 10.244.1.2:47912 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004320495s

	[INFO] 10.244.1.2:58339 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004513483s

	[INFO] 10.244.1.2:51885 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000171959s

	[INFO] 10.244.1.2:45279 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000157522s

	[INFO] 10.244.2.2:33883 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000143736s

	[INFO] 10.244.0.4:39492 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00011415s

	[INFO] 10.244.0.4:51848 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000160839s

	[INFO] 10.244.0.4:48729 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001822259s

	[INFO] 10.244.0.4:53755 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000075931s

	[INFO] 10.244.0.4:35896 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000083659s

	[INFO] 10.244.1.2:49722 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000191857s

	[INFO] 10.244.1.2:58322 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00013307s

	[INFO] 10.244.2.2:40226 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000206867s

	[INFO] 10.244.2.2:32858 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.00011172s

	[INFO] 10.244.0.4:50865 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000089979s

	[INFO] 10.244.0.4:35561 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00006698s

	[INFO] 10.244.1.2:49357 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000392457s

	[INFO] 10.244.1.2:41923 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000114873s

	[INFO] 10.244.2.2:55444 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000239522s

	[INFO] 10.244.2.2:40681 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000112375s

	[INFO] 10.244.2.2:41379 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000151313s

	[INFO] 10.244.0.4:38006 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000159949s

	[INFO] 10.244.0.4:37765 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000067573s

	[INFO] 10.244.0.4:36336 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000089052s

	==> coredns [84e026d6301e8c67450df06e6dd818944583e5d1b002a7a9c34551a04e81121a] <==

	[INFO] 10.244.0.4:36976 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 31 0.001704473s

	[INFO] 10.244.0.4:44372 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001893947s

	[INFO] 10.244.1.2:37811 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00029107s

	[INFO] 10.244.1.2:49904 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000177601s

	[INFO] 10.244.1.2:51519 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000140741s

	[INFO] 10.244.2.2:41916 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000187911s

	[INFO] 10.244.2.2:37867 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001984278s

	[INFO] 10.244.2.2:34700 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000124738s

	[INFO] 10.244.2.2:45453 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000096384s

	[INFO] 10.244.2.2:46559 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001825921s

	[INFO] 10.244.2.2:39372 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000147221s

	[INFO] 10.244.2.2:32893 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00014343s

	[INFO] 10.244.0.4:54361 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00195716s

	[INFO] 10.244.0.4:46218 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000082754s

	[INFO] 10.244.0.4:44534 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000091291s

	[INFO] 10.244.1.2:58259 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000132144s

	[INFO] 10.244.1.2:32828 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000095461s

	[INFO] 10.244.2.2:34997 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000134992s

	[INFO] 10.244.2.2:41428 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000106967s

	[INFO] 10.244.0.4:58880 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000108657s

	[INFO] 10.244.0.4:39030 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000096859s

	[INFO] 10.244.1.2:48049 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000161435s

	[INFO] 10.244.1.2:50102 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000135551s

	[INFO] 10.244.2.2:48432 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000222303s

	[INFO] 10.244.0.4:48688 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000155639s

	==> describe nodes <==

	Name:               ha-798963

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_10_28T13_09_37_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:09:36 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:15:55 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:36 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:36 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:36 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 28 Oct 2024 13:12:41 +0000   Mon, 28 Oct 2024 13:09:56 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.179

	  Hostname:    ha-798963

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 49efb145624c49b5a9f48be508f8d65b

	  System UUID:                49efb145-624c-49b5-a9f4-8be508f8d65b

	  Boot ID:                    cf911098-fde4-48dc-84d1-5147be1eaed0

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-t5f9c              0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m48s

	  kube-system                 coredns-7c65d6cfc9-7x97m             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m20s

	  kube-system                 coredns-7c65d6cfc9-bdv2v             100m (5%)     0 (0%)      70Mi (3%)        170Mi (8%)     6m20s

	  kube-system                 etcd-ha-798963                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         6m24s

	  kube-system                 kindnet-46mzj                        100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      6m21s

	  kube-system                 kube-apiserver-ha-798963             250m (12%)    0 (0%)      0 (0%)           0 (0%)         6m24s

	  kube-system                 kube-controller-manager-ha-798963    200m (10%)    0 (0%)      0 (0%)           0 (0%)         6m24s

	  kube-system                 kube-proxy-6j2hc                     0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m21s

	  kube-system                 kube-scheduler-ha-798963             100m (5%)     0 (0%)      0 (0%)           0 (0%)         6m24s

	  kube-system                 kube-vip-ha-798963                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m24s

	  kube-system                 storage-provisioner                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         6m19s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%)   100m (5%)

	  memory             290Mi (13%)  390Mi (18%)

	  ephemeral-storage  0 (0%)       0 (0%)

	  hugepages-2Mi      0 (0%)       0 (0%)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 6m19s  kube-proxy       

	  Normal  Starting                 6m24s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m24s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m24s  kubelet          Node ha-798963 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m24s  kubelet          Node ha-798963 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m24s  kubelet          Node ha-798963 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m21s  node-controller  Node ha-798963 event: Registered Node ha-798963 in Controller

	  Normal  NodeReady                6m5s   kubelet          Node ha-798963 status is now: NodeReady

	  Normal  RegisteredNode           5m27s  node-controller  Node ha-798963 event: Registered Node ha-798963 in Controller

	  Normal  RegisteredNode           4m9s   node-controller  Node ha-798963 event: Registered Node ha-798963 in Controller

	Name:               ha-798963-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_10_28T13_10_29_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:10:27 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:13:31 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 28 Oct 2024 13:12:29 +0000   Mon, 28 Oct 2024 13:14:12 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.109

	  Hostname:    ha-798963-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 298ea6cf54e048a39e3ca5a6051cbc47

	  System UUID:                298ea6cf-54e0-48a3-9e3c-a5a6051cbc47

	  Boot ID:                    306b3ff3-b813-4776-afa8-c5bb38a7fd70

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-2qlvb                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m48s

	  kube-system                 etcd-ha-798963-m02                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         5m33s

	  kube-system                 kindnet-9m2qk                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      5m34s

	  kube-system                 kube-apiserver-ha-798963-m02             250m (12%)    0 (0%)      0 (0%)           0 (0%)         5m33s

	  kube-system                 kube-controller-manager-ha-798963-m02    200m (10%)    0 (0%)      0 (0%)           0 (0%)         5m33s

	  kube-system                 kube-proxy-ltx8s                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m34s

	  kube-system                 kube-scheduler-ha-798963-m02             100m (5%)     0 (0%)      0 (0%)           0 (0%)         5m26s

	  kube-system                 kube-vip-ha-798963-m02                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         5m30s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m30s                  kube-proxy       

	  Normal  NodeAllocatableEnforced  5m35s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  5m34s (x8 over 5m35s)  kubelet          Node ha-798963-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m34s (x8 over 5m35s)  kubelet          Node ha-798963-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m34s (x7 over 5m35s)  kubelet          Node ha-798963-m02 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           5m31s                  node-controller  Node ha-798963-m02 event: Registered Node ha-798963-m02 in Controller

	  Normal  RegisteredNode           5m27s                  node-controller  Node ha-798963-m02 event: Registered Node ha-798963-m02 in Controller

	  Normal  RegisteredNode           4m9s                   node-controller  Node ha-798963-m02 event: Registered Node ha-798963-m02 in Controller

	  Normal  NodeNotReady             109s                   node-controller  Node ha-798963-m02 status is now: NodeNotReady

	Name:               ha-798963-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_10_28T13_11_46_0700

	                    minikube.k8s.io/version=v1.34.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:11:43 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:15:59 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:11:43 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:11:43 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:11:43 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 28 Oct 2024 13:12:45 +0000   Mon, 28 Oct 2024 13:12:05 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.22

	  Hostname:    ha-798963-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 9520468054654151a7aaac7502074668

	  System UUID:                95204680-5465-4151-a7aa-ac7502074668

	  Boot ID:                    883fec3c-b4bc-4622-ae3e-114be4ae0345

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-7dff88458-d2mnl                  0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m48s

	  kube-system                 etcd-ha-798963-m03                       100m (5%)     0 (0%)      100Mi (4%)       0 (0%)         4m16s

	  kube-system                 kindnet-fqc7b                            100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      4m18s

	  kube-system                 kube-apiserver-ha-798963-m03             250m (12%)    0 (0%)      0 (0%)           0 (0%)         4m16s

	  kube-system                 kube-controller-manager-ha-798963-m03    200m (10%)    0 (0%)      0 (0%)           0 (0%)         4m16s

	  kube-system                 kube-proxy-7xs2n                         0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m18s

	  kube-system                 kube-scheduler-ha-798963-m03             100m (5%)     0 (0%)      0 (0%)           0 (0%)         4m11s

	  kube-system                 kube-vip-ha-798963-m03                   0 (0%)        0 (0%)      0 (0%)           0 (0%)         4m13s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%)  100m (5%)

	  memory             150Mi (7%)  50Mi (2%)

	  ephemeral-storage  0 (0%)      0 (0%)

	  hugepages-2Mi      0 (0%)      0 (0%)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m13s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  4m18s (x8 over 4m18s)  kubelet          Node ha-798963-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m18s (x8 over 4m18s)  kubelet          Node ha-798963-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m18s (x7 over 4m18s)  kubelet          Node ha-798963-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m18s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m17s                  node-controller  Node ha-798963-m03 event: Registered Node ha-798963-m03 in Controller

	  Normal  RegisteredNode           4m16s                  node-controller  Node ha-798963-m03 event: Registered Node ha-798963-m03 in Controller

	  Normal  RegisteredNode           4m9s                   node-controller  Node ha-798963-m03 event: Registered Node ha-798963-m03 in Controller

	Name:               ha-798963-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-798963-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=c99b33efccb2a6f55e7d55ee119e421996ce77bc

	                    minikube.k8s.io/name=ha-798963

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_10_28T13_12_52_0700

	                    minikube.k8s.io/version=v1.34.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 28 Oct 2024 13:12:52 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-798963-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 28 Oct 2024 13:15:55 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:12:52 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:12:52 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:12:52 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 28 Oct 2024 13:13:22 +0000   Mon, 28 Oct 2024 13:13:13 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.242

	  Hostname:    ha-798963-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 ecce8c01220046a09ed45b783db17dc3

	  System UUID:                ecce8c01-2200-46a0-9ed4-5b783db17dc3

	  Boot ID:                    c67cbe63-b326-411a-852b-3c4030c64a40

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.31.2

	  Kube-Proxy Version:         v1.31.2

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-7svj5       100m (5%)     100m (5%)   50Mi (2%)        50Mi (2%)      3m9s

	  kube-system                 kube-proxy-497js    0 (0%)        0 (0%)      0 (0%)           0 (0%)         3m9s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%)  100m (5%)

	  memory             50Mi (2%)  50Mi (2%)

	  ephemeral-storage  0 (0%)     0 (0%)

	  hugepages-2Mi      0 (0%)     0 (0%)

	Events:

	  Type    Reason                   Age                   From             Message

	  ----    ------                   ----                  ----             -------

	  Normal  Starting                 3m3s                  kube-proxy       

	  Normal  RegisteredNode           3m9s                  node-controller  Node ha-798963-m04 event: Registered Node ha-798963-m04 in Controller

	  Normal  NodeHasSufficientMemory  3m9s (x2 over 3m10s)  kubelet          Node ha-798963-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m9s (x2 over 3m10s)  kubelet          Node ha-798963-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m9s (x2 over 3m10s)  kubelet          Node ha-798963-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m9s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m7s                  node-controller  Node ha-798963-m04 event: Registered Node ha-798963-m04 in Controller

	  Normal  RegisteredNode           3m6s                  node-controller  Node ha-798963-m04 event: Registered Node ha-798963-m04 in Controller

	  Normal  NodeReady                2m48s                 kubelet          Node ha-798963-m04 status is now: NodeReady

	==> dmesg <==

	[Oct28 13:08] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.051002] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.038028] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[Oct28 13:09] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.908676] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.542211] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[ +10.009744] systemd-fstab-generator[587]: Ignoring "noauto" option for root device

	[  +0.063468] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.060133] systemd-fstab-generator[599]: Ignoring "noauto" option for root device

	[  +0.166730] systemd-fstab-generator[613]: Ignoring "noauto" option for root device

	[  +0.141134] systemd-fstab-generator[625]: Ignoring "noauto" option for root device

	[  +0.283777] systemd-fstab-generator[655]: Ignoring "noauto" option for root device

	[  +3.959689] systemd-fstab-generator[750]: Ignoring "noauto" option for root device

	[  +3.755625] systemd-fstab-generator[880]: Ignoring "noauto" option for root device

	[  +0.059298] kauditd_printk_skb: 158 callbacks suppressed

	[  +7.363407] systemd-fstab-generator[1300]: Ignoring "noauto" option for root device

	[  +0.075053] kauditd_printk_skb: 79 callbacks suppressed

	[  +5.328623] kauditd_printk_skb: 36 callbacks suppressed

	[ +14.589935] kauditd_printk_skb: 23 callbacks suppressed

	[Oct28 13:10] kauditd_printk_skb: 28 callbacks suppressed

	==> etcd [c9a5739fb70471ec482c33332fbe3241eaad941396ea114d4a4c992acd9e88de] <==

	{"level":"warn","ts":"2024-10-28T13:16:01.412667Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.417624Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.441587Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.592391Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.599913Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.607030Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.611398Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.615402Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.620949Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.627022Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.634893Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.653442Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.658790Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.662979Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.670462Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.670684Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.674454Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.678037Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.684698Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.688515Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.691839Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.696179Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.706821Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.715553Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-10-28T13:16:01.719786Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"9edf382f8ea095e5","from":"9edf382f8ea095e5","remote-peer-id":"c0811e05d94f1e8d","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 13:16:01 up 7 min,  0 users,  load average: 0.31, 0.23, 0.11

	Linux ha-798963 5.10.207 #1 SMP Tue Oct 15 19:19:35 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [e21d34c0daca4bacf3a9eb595f851dee10dad02464efdc15873a4c87af040adf] <==

	I1028 13:15:26.229203       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	I1028 13:15:36.224990       1 main.go:297] Handling node with IPs: map[192.168.39.179:{}]

	I1028 13:15:36.225299       1 main.go:301] handling current node

	I1028 13:15:36.225525       1 main.go:297] Handling node with IPs: map[192.168.39.109:{}]

	I1028 13:15:36.225574       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	I1028 13:15:36.226089       1 main.go:297] Handling node with IPs: map[192.168.39.22:{}]

	I1028 13:15:36.226144       1 main.go:324] Node ha-798963-m03 has CIDR [10.244.2.0/24] 

	I1028 13:15:36.226487       1 main.go:297] Handling node with IPs: map[192.168.39.242:{}]

	I1028 13:15:36.226555       1 main.go:324] Node ha-798963-m04 has CIDR [10.244.3.0/24] 

	I1028 13:15:46.224388       1 main.go:297] Handling node with IPs: map[192.168.39.22:{}]

	I1028 13:15:46.224529       1 main.go:324] Node ha-798963-m03 has CIDR [10.244.2.0/24] 

	I1028 13:15:46.224948       1 main.go:297] Handling node with IPs: map[192.168.39.242:{}]

	I1028 13:15:46.225005       1 main.go:324] Node ha-798963-m04 has CIDR [10.244.3.0/24] 

	I1028 13:15:46.225291       1 main.go:297] Handling node with IPs: map[192.168.39.179:{}]

	I1028 13:15:46.225407       1 main.go:301] handling current node

	I1028 13:15:46.225442       1 main.go:297] Handling node with IPs: map[192.168.39.109:{}]

	I1028 13:15:46.225467       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	I1028 13:15:56.232861       1 main.go:297] Handling node with IPs: map[192.168.39.179:{}]

	I1028 13:15:56.232925       1 main.go:301] handling current node

	I1028 13:15:56.232955       1 main.go:297] Handling node with IPs: map[192.168.39.109:{}]

	I1028 13:15:56.232964       1 main.go:324] Node ha-798963-m02 has CIDR [10.244.1.0/24] 

	I1028 13:15:56.234289       1 main.go:297] Handling node with IPs: map[192.168.39.22:{}]

	I1028 13:15:56.234393       1 main.go:324] Node ha-798963-m03 has CIDR [10.244.2.0/24] 

	I1028 13:15:56.234645       1 main.go:297] Handling node with IPs: map[192.168.39.242:{}]

	I1028 13:15:56.234653       1 main.go:324] Node ha-798963-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [bd9de91780ff931cdf20ce0d4f67adf087138cabbbe1a431ee74622bcb325d8f] <==

	I1028 13:09:37.161352       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I1028 13:09:40.959590       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I1028 13:09:41.110761       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E1028 13:10:27.853740       1 writers.go:122] "Unhandled Error" err="apiserver was unable to write a JSON response: http: Handler timeout" logger="UnhandledError"

	E1028 13:10:27.854868       1 finisher.go:175] "Unhandled Error" err="FinishRequest: post-timeout activity - time-elapsed: 908.321µs, panicked: false, err: context canceled, panic-reason: <nil>" logger="UnhandledError"

	E1028 13:10:27.855010       1 status.go:71] "Unhandled Error" err="apiserver received an error that is not an metav1.Status: &errors.errorString{s:\"http: Handler timeout\"}: http: Handler timeout" logger="UnhandledError"

	E1028 13:10:27.856242       1 writers.go:135] "Unhandled Error" err="apiserver was unable to write a fallback JSON response: http: Handler timeout" logger="UnhandledError"

	E1028 13:10:27.857591       1 timeout.go:140] "Post-timeout activity" logger="UnhandledError" timeElapsed="4.111957ms" method="POST" path="/api/v1/namespaces/kube-system/events" result=null

	E1028 13:11:44.716219       1 finisher.go:175] "Unhandled Error" err="FinishRequest: post-timeout activity - time-elapsed: 6.388µs, panicked: false, err: context canceled, panic-reason: <nil>" logger="UnhandledError"

	E1028 13:11:44.716271       1 wrap.go:53] "Timeout or abort while handling" logger="UnhandledError" method="POST" URI="/api/v1/namespaces/kube-system/events" auditID="1270982c-88af-4eba-a9fd-c0cb7dc8d117"

	E1028 13:11:44.716439       1 timeout.go:140] "Post-timeout activity" logger="UnhandledError" timeElapsed="2.892µs" method="POST" path="/api/v1/namespaces/kube-system/events" result=null

	E1028 13:12:18.560996       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59344: use of closed network connection

	E1028 13:12:18.751076       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59362: use of closed network connection

	E1028 13:12:18.949498       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59384: use of closed network connection

	E1028 13:12:19.148562       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59392: use of closed network connection

	E1028 13:12:19.344290       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59406: use of closed network connection

	E1028 13:12:19.547565       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59418: use of closed network connection

	E1028 13:12:19.731759       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59434: use of closed network connection

	E1028 13:12:19.917937       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59462: use of closed network connection

	E1028 13:12:20.100646       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59482: use of closed network connection

	E1028 13:12:20.423551       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59526: use of closed network connection

	E1028 13:12:20.612666       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:59546: use of closed network connection

	E1028 13:12:20.980438       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:41212: use of closed network connection

	E1028 13:12:21.172635       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:41234: use of closed network connection

	E1028 13:12:21.359029       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:41258: use of closed network connection

	==> kube-controller-manager [e06d5644fa9b50f95795c31d8b4ba575d8e127318f91d8c56f28368e20bdfddc] <==

	I1028 13:12:52.142803       1 range_allocator.go:422] "Set node PodCIDR" logger="node-ipam-controller" node="ha-798963-m04" podCIDRs=["10.244.3.0/24"]

	I1028 13:12:52.142851       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.143062       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.166788       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.213127       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.319500       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:52.637873       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:54.742175       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:54.796500       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:55.524212       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:12:55.525971       1 node_lifecycle_controller.go:884] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-798963-m04"

	I1028 13:12:55.609249       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:02.569475       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:13.493496       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:13.494498       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-798963-m04"

	I1028 13:13:13.513512       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:14.755883       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:13:22.843583       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m04"

	I1028 13:14:12.250546       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-798963-m04"

	I1028 13:14:12.250795       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	I1028 13:14:12.275269       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	I1028 13:14:12.338511       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="15.100805ms"

	I1028 13:14:12.339034       1 replica_set.go:679] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-7dff88458" duration="103.795µs"

	I1028 13:14:15.638707       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	I1028 13:14:17.576466       1 range_allocator.go:241] "Successfully synced" logger="node-ipam-controller" key="ha-798963-m02"

	==> kube-proxy [f9e8711e7ed656e23016809b7b14567af4f9b723b5b59bc24e826fb2dc76773b] <==

		add table ip kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	E1028 13:09:42.137583       1 proxier.go:734] "Error cleaning up nftables rules" err=<

		could not run nftables command: /dev/stdin:1:1-25: Error: Could not process rule: Operation not supported

		add table ip6 kube-proxy

		^^^^^^^^^^^^^^^^^^^^^^^^^

	 >

	I1028 13:09:42.164503       1 server.go:677] "Successfully retrieved node IP(s)" IPs=["192.168.39.179"]

	E1028 13:09:42.164841       1 server.go:234] "Kube-proxy configuration may be incomplete or incorrect" err="nodePortAddresses is unset; NodePort connections will be accepted on all local IPs. Consider using `--nodeport-addresses primary`"

	I1028 13:09:42.201122       1 server_linux.go:146] "No iptables support for family" ipFamily="IPv6"

	I1028 13:09:42.201244       1 server.go:245] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I1028 13:09:42.201287       1 server_linux.go:169] "Using iptables Proxier"

	I1028 13:09:42.207249       1 proxier.go:255] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses" ipFamily="IPv4"

	I1028 13:09:42.208140       1 server.go:483] "Version info" version="v1.31.2"

	I1028 13:09:42.208190       1 server.go:485] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I1028 13:09:42.213020       1 config.go:199] "Starting service config controller"

	I1028 13:09:42.214093       1 shared_informer.go:313] Waiting for caches to sync for service config

	I1028 13:09:42.214167       1 config.go:105] "Starting endpoint slice config controller"

	I1028 13:09:42.214185       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I1028 13:09:42.214880       1 config.go:328] "Starting node config controller"

	I1028 13:09:42.214928       1 shared_informer.go:313] Waiting for caches to sync for node config

	I1028 13:09:42.315117       1 shared_informer.go:320] Caches are synced for node config

	I1028 13:09:42.315149       1 shared_informer.go:320] Caches are synced for service config

	I1028 13:09:42.315172       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [e3a123f30200b11a0764eea7b85d24bf2691d5bc5cabb7047b568789b184f35a] <==

	W1028 13:09:34.868574       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E1028 13:09:34.868633       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User \"system:kube-scheduler\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError"

	W1028 13:09:34.872157       1 reflector.go:561] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E1028 13:09:34.872875       1 reflector.go:158] "Unhandled Error" err="runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps \"extension-apiserver-authentication\" is forbidden: User \"system:kube-scheduler\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kube-system\"" logger="UnhandledError"

	W1028 13:09:34.899618       1 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E1028 13:09:34.899665       1 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User \"system:kube-scheduler\" cannot list resource \"csinodes\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError"

	I1028 13:09:36.607872       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E1028 13:12:13.405664       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-d2mnl\": pod busybox-7dff88458-d2mnl is already assigned to node \"ha-798963-m03\"" plugin="DefaultBinder" pod="default/busybox-7dff88458-d2mnl" node="ha-798963-m03"

	E1028 13:12:13.409088       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod fdf9a1c8-2afb-40ae-9322-38a216ef73e3(default/busybox-7dff88458-d2mnl) wasn't assumed so cannot be forgotten" pod="default/busybox-7dff88458-d2mnl"

	E1028 13:12:13.409201       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-7dff88458-d2mnl\": pod busybox-7dff88458-d2mnl is already assigned to node \"ha-798963-m03\"" pod="default/busybox-7dff88458-d2mnl"

	I1028 13:12:13.409298       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-7dff88458-d2mnl" node="ha-798963-m03"

	E1028 13:12:52.211697       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-7svj5\": pod kindnet-7svj5 is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-7svj5" node="ha-798963-m04"

	E1028 13:12:52.212004       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-7svj5\": pod kindnet-7svj5 is already assigned to node \"ha-798963-m04\"" pod="kube-system/kindnet-7svj5"

	E1028 13:12:52.258545       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-xgxl8\": pod kube-proxy-xgxl8 is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-xgxl8" node="ha-798963-m04"

	E1028 13:12:52.258637       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod a54a30d8-7a02-416c-93c0-5c38f51f5fd5(kube-system/kube-proxy-xgxl8) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-xgxl8"

	E1028 13:12:52.258659       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-xgxl8\": pod kube-proxy-xgxl8 is already assigned to node \"ha-798963-m04\"" pod="kube-system/kube-proxy-xgxl8"

	I1028 13:12:52.258679       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-xgxl8" node="ha-798963-m04"

	E1028 13:12:52.310730       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-6qqx2\": pod kindnet-6qqx2 is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-6qqx2" node="ha-798963-m04"

	E1028 13:12:52.311083       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 6afd7781-540b-49bc-848a-58be4edbceef(kube-system/kindnet-6qqx2) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-6qqx2"

	E1028 13:12:52.311236       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-6qqx2\": pod kindnet-6qqx2 is already assigned to node \"ha-798963-m04\"" pod="kube-system/kindnet-6qqx2"

	I1028 13:12:52.311413       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-6qqx2" node="ha-798963-m04"

	E1028 13:12:52.344533       1 framework.go:1305] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-pbw9k\": pod kube-proxy-pbw9k is already assigned to node \"ha-798963-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-pbw9k" node="ha-798963-m04"

	E1028 13:12:52.344601       1 schedule_one.go:348] "scheduler cache ForgetPod failed" err="pod 63648c50-4487-4d6c-89a0-318172691bf5(kube-system/kube-proxy-pbw9k) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-pbw9k"

	E1028 13:12:52.344630       1 schedule_one.go:1057] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-pbw9k\": pod kube-proxy-pbw9k is already assigned to node \"ha-798963-m04\"" pod="kube-system/kube-proxy-pbw9k"

	I1028 13:12:52.344650       1 schedule_one.go:1070] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-pbw9k" node="ha-798963-m04"

	==> kubelet <==

	Oct 28 13:14:37 ha-798963 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 28 13:14:37 ha-798963 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 28 13:14:37 ha-798963 kubelet[1307]: E1028 13:14:37.267723    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121277267381342,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:37 ha-798963 kubelet[1307]: E1028 13:14:37.267759    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121277267381342,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:47 ha-798963 kubelet[1307]: E1028 13:14:47.269530    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121287269119624,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:47 ha-798963 kubelet[1307]: E1028 13:14:47.269816    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121287269119624,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:57 ha-798963 kubelet[1307]: E1028 13:14:57.271476    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121297271006652,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:14:57 ha-798963 kubelet[1307]: E1028 13:14:57.271533    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121297271006652,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:07 ha-798963 kubelet[1307]: E1028 13:15:07.273643    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121307273189567,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:07 ha-798963 kubelet[1307]: E1028 13:15:07.273701    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121307273189567,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:17 ha-798963 kubelet[1307]: E1028 13:15:17.275885    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121317275419786,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:17 ha-798963 kubelet[1307]: E1028 13:15:17.276167    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121317275419786,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:27 ha-798963 kubelet[1307]: E1028 13:15:27.278169    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121327277752589,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:27 ha-798963 kubelet[1307]: E1028 13:15:27.278218    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121327277752589,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:37 ha-798963 kubelet[1307]: E1028 13:15:37.193137    1307 iptables.go:577] "Could not set up iptables canary" err=<

	Oct 28 13:15:37 ha-798963 kubelet[1307]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Oct 28 13:15:37 ha-798963 kubelet[1307]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Oct 28 13:15:37 ha-798963 kubelet[1307]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Oct 28 13:15:37 ha-798963 kubelet[1307]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Oct 28 13:15:37 ha-798963 kubelet[1307]: E1028 13:15:37.280395    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121337280079403,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:37 ha-798963 kubelet[1307]: E1028 13:15:37.280419    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121337280079403,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:47 ha-798963 kubelet[1307]: E1028 13:15:47.282359    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121347281914833,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:47 ha-798963 kubelet[1307]: E1028 13:15:47.282762    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121347281914833,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:57 ha-798963 kubelet[1307]: E1028 13:15:57.285076    1307 eviction_manager.go:257] "Eviction manager: failed to get HasDedicatedImageFs" err="missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121357284592013,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

	Oct 28 13:15:57 ha-798963 kubelet[1307]: E1028 13:15:57.285126    1307 eviction_manager.go:212] "Eviction manager: failed to synchronize" err="eviction manager: failed to get HasDedicatedImageFs: missing image stats: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1730121357284592013,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:156106,},InodesUsed:&UInt64Value{Value:72,},},},ContainerFilesystems:[]*FilesystemUsage{},}"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-798963 -n ha-798963

helpers_test.go:261: (dbg) Run:  kubectl --context ha-798963 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/DegradedAfterControlPlaneNodeStop (5.79s)