=== RUN   TestAddons/Setup

addons_test.go:109: (dbg) Run:  out/minikube-linux-amd64 start -p addons-943107 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:109: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-943107 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: signal: killed (39m59.938666576s)

-- stdout --

	* [addons-943107] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=18773

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/18773-847310/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18773-847310/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-943107" primary control-plane node in "addons-943107" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	  - Using image docker.io/registry:2.8.3

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	  - Using image ghcr.io/helm/tiller:v2.17.0

	  - Using image docker.io/marcnuri/yakd:0.0.4

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.27.0

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.16

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.15.0

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	  - Using image docker.io/busybox:stable

	* Verifying ingress addon...

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-943107 service yakd-dashboard -n yakd-dashboard

	* Verifying registry addon...

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	* Verifying csi-hostpath-driver addon...

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-943107 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: metrics-server, cloud-spanner, yakd, storage-provisioner, ingress-dns, nvidia-device-plugin, inspektor-gadget, helm-tiller, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

-- /stdout --

** stderr ** 

	I0429 11:58:33.257243  855239 out.go:291] Setting OutFile to fd 1 ...

	I0429 11:58:33.257363  855239 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 11:58:33.257375  855239 out.go:304] Setting ErrFile to fd 2...

	I0429 11:58:33.257381  855239 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 11:58:33.257599  855239 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 11:58:33.258341  855239 out.go:298] Setting JSON to false

	I0429 11:58:33.259250  855239 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-12","uptime":74458,"bootTime":1714317455,"procs":177,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0429 11:58:33.259331  855239 start.go:139] virtualization: kvm guest

	I0429 11:58:33.262205  855239 out.go:177] * [addons-943107] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	I0429 11:58:33.263808  855239 out.go:177]   - MINIKUBE_LOCATION=18773

	I0429 11:58:33.263749  855239 notify.go:220] Checking for updates...

	I0429 11:58:33.265047  855239 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0429 11:58:33.266420  855239 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 11:58:33.267902  855239 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 11:58:33.269263  855239 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0429 11:58:33.270633  855239 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0429 11:58:33.272291  855239 driver.go:392] Setting default libvirt URI to qemu:///system

	I0429 11:58:33.306183  855239 out.go:177] * Using the kvm2 driver based on user configuration

	I0429 11:58:33.307502  855239 start.go:297] selected driver: kvm2

	I0429 11:58:33.307527  855239 start.go:901] validating driver "kvm2" against <nil>

	I0429 11:58:33.307541  855239 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0429 11:58:33.308241  855239 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0429 11:58:33.308338  855239 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18773-847310/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0429 11:58:33.324898  855239 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0

	I0429 11:58:33.325007  855239 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0429 11:58:33.325249  855239 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 11:58:33.325298  855239 cni.go:84] Creating CNI manager for ""

	I0429 11:58:33.325312  855239 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0429 11:58:33.325320  855239 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0429 11:58:33.325382  855239 start.go:340] cluster config:

	{Name:addons-943107 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:addons-943107 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c

rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg

entPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 11:58:33.325477  855239 iso.go:125] acquiring lock: {Name:mk86e9cd005d09998272ae59568d4d340a1c61b2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0429 11:58:33.327525  855239 out.go:177] * Starting "addons-943107" primary control-plane node in "addons-943107" cluster

	I0429 11:58:33.328909  855239 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 11:58:33.328967  855239 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4

	I0429 11:58:33.328980  855239 cache.go:56] Caching tarball of preloaded images

	I0429 11:58:33.329068  855239 preload.go:173] Found /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0429 11:58:33.329080  855239 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0429 11:58:33.329406  855239 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/config.json ...

	I0429 11:58:33.329431  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/config.json: {Name:mk9f7e9a33d9bf2d965b49cdce35ae43541052ad Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:58:33.329575  855239 start.go:360] acquireMachinesLock for addons-943107: {Name:mk2ade588bdb49db467a1dc12f643b97a2b1f5bb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0429 11:58:33.329624  855239 start.go:364] duration metric: took 35.404µs to acquireMachinesLock for "addons-943107"

	I0429 11:58:33.329642  855239 start.go:93] Provisioning new machine with config: &{Name:addons-943107 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.30.0 ClusterName:addons-943107 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 11:58:33.329697  855239 start.go:125] createHost starting for "" (driver="kvm2")

	I0429 11:58:33.331494  855239 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0429 11:58:33.331672  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:58:33.331727  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:58:33.347431  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46193

	I0429 11:58:33.347946  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:58:33.348577  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:58:33.348600  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:58:33.349029  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:58:33.349245  855239 main.go:141] libmachine: (addons-943107) Calling .GetMachineName

	I0429 11:58:33.349425  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:58:33.349574  855239 start.go:159] libmachine.API.Create for "addons-943107" (driver="kvm2")

	I0429 11:58:33.349601  855239 client.go:168] LocalClient.Create starting

	I0429 11:58:33.349639  855239 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem

	I0429 11:58:33.473170  855239 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem

	I0429 11:58:33.827103  855239 main.go:141] libmachine: Running pre-create checks...

	I0429 11:58:33.827133  855239 main.go:141] libmachine: (addons-943107) Calling .PreCreateCheck

	I0429 11:58:33.827751  855239 main.go:141] libmachine: (addons-943107) Calling .GetConfigRaw

	I0429 11:58:33.828232  855239 main.go:141] libmachine: Creating machine...

	I0429 11:58:33.828249  855239 main.go:141] libmachine: (addons-943107) Calling .Create

	I0429 11:58:33.828436  855239 main.go:141] libmachine: (addons-943107) Creating KVM machine...

	I0429 11:58:33.829743  855239 main.go:141] libmachine: (addons-943107) DBG | found existing default KVM network

	I0429 11:58:33.830557  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:33.830414  855261 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ad0}

	I0429 11:58:33.830577  855239 main.go:141] libmachine: (addons-943107) DBG | created network xml: 

	I0429 11:58:33.830589  855239 main.go:141] libmachine: (addons-943107) DBG | <network>

	I0429 11:58:33.830596  855239 main.go:141] libmachine: (addons-943107) DBG |   <name>mk-addons-943107</name>

	I0429 11:58:33.830607  855239 main.go:141] libmachine: (addons-943107) DBG |   <dns enable='no'/>

	I0429 11:58:33.830612  855239 main.go:141] libmachine: (addons-943107) DBG |   

	I0429 11:58:33.830620  855239 main.go:141] libmachine: (addons-943107) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0429 11:58:33.830631  855239 main.go:141] libmachine: (addons-943107) DBG |     <dhcp>

	I0429 11:58:33.830643  855239 main.go:141] libmachine: (addons-943107) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0429 11:58:33.830655  855239 main.go:141] libmachine: (addons-943107) DBG |     </dhcp>

	I0429 11:58:33.830672  855239 main.go:141] libmachine: (addons-943107) DBG |   </ip>

	I0429 11:58:33.830679  855239 main.go:141] libmachine: (addons-943107) DBG |   

	I0429 11:58:33.830683  855239 main.go:141] libmachine: (addons-943107) DBG | </network>

	I0429 11:58:33.830689  855239 main.go:141] libmachine: (addons-943107) DBG | 

	I0429 11:58:33.836251  855239 main.go:141] libmachine: (addons-943107) DBG | trying to create private KVM network mk-addons-943107 192.168.39.0/24...

	I0429 11:58:33.912374  855239 main.go:141] libmachine: (addons-943107) Setting up store path in /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107 ...

	I0429 11:58:33.912412  855239 main.go:141] libmachine: (addons-943107) Building disk image from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0429 11:58:33.912435  855239 main.go:141] libmachine: (addons-943107) DBG | private KVM network mk-addons-943107 192.168.39.0/24 created

	I0429 11:58:33.912453  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:33.912311  855261 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 11:58:33.912515  855239 main.go:141] libmachine: (addons-943107) Downloading /home/jenkins/minikube-integration/18773-847310/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0429 11:58:34.162934  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:34.162769  855261 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa...

	I0429 11:58:34.356661  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:34.356492  855261 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/addons-943107.rawdisk...

	I0429 11:58:34.356698  855239 main.go:141] libmachine: (addons-943107) DBG | Writing magic tar header

	I0429 11:58:34.356708  855239 main.go:141] libmachine: (addons-943107) DBG | Writing SSH key tar header

	I0429 11:58:34.356716  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:34.356654  855261 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107 ...

	I0429 11:58:34.356819  855239 main.go:141] libmachine: (addons-943107) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107

	I0429 11:58:34.356844  855239 main.go:141] libmachine: (addons-943107) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines

	I0429 11:58:34.356858  855239 main.go:141] libmachine: (addons-943107) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107 (perms=drwx------)

	I0429 11:58:34.356871  855239 main.go:141] libmachine: (addons-943107) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines (perms=drwxr-xr-x)

	I0429 11:58:34.356882  855239 main.go:141] libmachine: (addons-943107) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube (perms=drwxr-xr-x)

	I0429 11:58:34.356898  855239 main.go:141] libmachine: (addons-943107) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310 (perms=drwxrwxr-x)

	I0429 11:58:34.356924  855239 main.go:141] libmachine: (addons-943107) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0429 11:58:34.356940  855239 main.go:141] libmachine: (addons-943107) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 11:58:34.356967  855239 main.go:141] libmachine: (addons-943107) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310

	I0429 11:58:34.356996  855239 main.go:141] libmachine: (addons-943107) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0429 11:58:34.357007  855239 main.go:141] libmachine: (addons-943107) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0429 11:58:34.357022  855239 main.go:141] libmachine: (addons-943107) DBG | Checking permissions on dir: /home/jenkins

	I0429 11:58:34.357035  855239 main.go:141] libmachine: (addons-943107) DBG | Checking permissions on dir: /home

	I0429 11:58:34.357047  855239 main.go:141] libmachine: (addons-943107) DBG | Skipping /home - not owner

	I0429 11:58:34.357061  855239 main.go:141] libmachine: (addons-943107) Creating domain...

	I0429 11:58:34.358298  855239 main.go:141] libmachine: (addons-943107) define libvirt domain using xml: 

	I0429 11:58:34.358330  855239 main.go:141] libmachine: (addons-943107) <domain type='kvm'>

	I0429 11:58:34.358339  855239 main.go:141] libmachine: (addons-943107)   <name>addons-943107</name>

	I0429 11:58:34.358352  855239 main.go:141] libmachine: (addons-943107)   <memory unit='MiB'>4000</memory>

	I0429 11:58:34.358425  855239 main.go:141] libmachine: (addons-943107)   <vcpu>2</vcpu>

	I0429 11:58:34.358450  855239 main.go:141] libmachine: (addons-943107)   <features>

	I0429 11:58:34.358456  855239 main.go:141] libmachine: (addons-943107)     <acpi/>

	I0429 11:58:34.358464  855239 main.go:141] libmachine: (addons-943107)     <apic/>

	I0429 11:58:34.358469  855239 main.go:141] libmachine: (addons-943107)     <pae/>

	I0429 11:58:34.358474  855239 main.go:141] libmachine: (addons-943107)     

	I0429 11:58:34.358481  855239 main.go:141] libmachine: (addons-943107)   </features>

	I0429 11:58:34.358487  855239 main.go:141] libmachine: (addons-943107)   <cpu mode='host-passthrough'>

	I0429 11:58:34.358495  855239 main.go:141] libmachine: (addons-943107)   

	I0429 11:58:34.358504  855239 main.go:141] libmachine: (addons-943107)   </cpu>

	I0429 11:58:34.358511  855239 main.go:141] libmachine: (addons-943107)   <os>

	I0429 11:58:34.358516  855239 main.go:141] libmachine: (addons-943107)     <type>hvm</type>

	I0429 11:58:34.358524  855239 main.go:141] libmachine: (addons-943107)     <boot dev='cdrom'/>

	I0429 11:58:34.358528  855239 main.go:141] libmachine: (addons-943107)     <boot dev='hd'/>

	I0429 11:58:34.358535  855239 main.go:141] libmachine: (addons-943107)     <bootmenu enable='no'/>

	I0429 11:58:34.358543  855239 main.go:141] libmachine: (addons-943107)   </os>

	I0429 11:58:34.358550  855239 main.go:141] libmachine: (addons-943107)   <devices>

	I0429 11:58:34.358559  855239 main.go:141] libmachine: (addons-943107)     <disk type='file' device='cdrom'>

	I0429 11:58:34.358573  855239 main.go:141] libmachine: (addons-943107)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/boot2docker.iso'/>

	I0429 11:58:34.358587  855239 main.go:141] libmachine: (addons-943107)       <target dev='hdc' bus='scsi'/>

	I0429 11:58:34.358596  855239 main.go:141] libmachine: (addons-943107)       <readonly/>

	I0429 11:58:34.358603  855239 main.go:141] libmachine: (addons-943107)     </disk>

	I0429 11:58:34.358613  855239 main.go:141] libmachine: (addons-943107)     <disk type='file' device='disk'>

	I0429 11:58:34.358619  855239 main.go:141] libmachine: (addons-943107)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0429 11:58:34.358627  855239 main.go:141] libmachine: (addons-943107)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/addons-943107.rawdisk'/>

	I0429 11:58:34.358635  855239 main.go:141] libmachine: (addons-943107)       <target dev='hda' bus='virtio'/>

	I0429 11:58:34.358640  855239 main.go:141] libmachine: (addons-943107)     </disk>

	I0429 11:58:34.358644  855239 main.go:141] libmachine: (addons-943107)     <interface type='network'>

	I0429 11:58:34.358652  855239 main.go:141] libmachine: (addons-943107)       <source network='mk-addons-943107'/>

	I0429 11:58:34.358657  855239 main.go:141] libmachine: (addons-943107)       <model type='virtio'/>

	I0429 11:58:34.358664  855239 main.go:141] libmachine: (addons-943107)     </interface>

	I0429 11:58:34.358669  855239 main.go:141] libmachine: (addons-943107)     <interface type='network'>

	I0429 11:58:34.358675  855239 main.go:141] libmachine: (addons-943107)       <source network='default'/>

	I0429 11:58:34.358680  855239 main.go:141] libmachine: (addons-943107)       <model type='virtio'/>

	I0429 11:58:34.358720  855239 main.go:141] libmachine: (addons-943107)     </interface>

	I0429 11:58:34.358758  855239 main.go:141] libmachine: (addons-943107)     <serial type='pty'>

	I0429 11:58:34.358775  855239 main.go:141] libmachine: (addons-943107)       <target port='0'/>

	I0429 11:58:34.358786  855239 main.go:141] libmachine: (addons-943107)     </serial>

	I0429 11:58:34.358803  855239 main.go:141] libmachine: (addons-943107)     <console type='pty'>

	I0429 11:58:34.358816  855239 main.go:141] libmachine: (addons-943107)       <target type='serial' port='0'/>

	I0429 11:58:34.358827  855239 main.go:141] libmachine: (addons-943107)     </console>

	I0429 11:58:34.358839  855239 main.go:141] libmachine: (addons-943107)     <rng model='virtio'>

	I0429 11:58:34.358857  855239 main.go:141] libmachine: (addons-943107)       <backend model='random'>/dev/random</backend>

	I0429 11:58:34.358869  855239 main.go:141] libmachine: (addons-943107)     </rng>

	I0429 11:58:34.358877  855239 main.go:141] libmachine: (addons-943107)     

	I0429 11:58:34.358889  855239 main.go:141] libmachine: (addons-943107)     

	I0429 11:58:34.358899  855239 main.go:141] libmachine: (addons-943107)   </devices>

	I0429 11:58:34.358910  855239 main.go:141] libmachine: (addons-943107) </domain>

	I0429 11:58:34.358918  855239 main.go:141] libmachine: (addons-943107) 

	I0429 11:58:34.363965  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:92:29:6d in network default

	I0429 11:58:34.364727  855239 main.go:141] libmachine: (addons-943107) Ensuring networks are active...

	I0429 11:58:34.364744  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:34.365457  855239 main.go:141] libmachine: (addons-943107) Ensuring network default is active

	I0429 11:58:34.365819  855239 main.go:141] libmachine: (addons-943107) Ensuring network mk-addons-943107 is active

	I0429 11:58:34.366429  855239 main.go:141] libmachine: (addons-943107) Getting domain xml...

	I0429 11:58:34.367351  855239 main.go:141] libmachine: (addons-943107) Creating domain...

	I0429 11:58:35.595620  855239 main.go:141] libmachine: (addons-943107) Waiting to get IP...

	I0429 11:58:35.596424  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:35.596801  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:35.596831  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:35.596778  855261 retry.go:31] will retry after 204.672352ms: waiting for machine to come up

	I0429 11:58:35.803548  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:35.804125  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:35.804164  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:35.804038  855261 retry.go:31] will retry after 346.803922ms: waiting for machine to come up

	I0429 11:58:36.152879  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:36.153294  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:36.153323  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:36.153249  855261 retry.go:31] will retry after 309.478581ms: waiting for machine to come up

	I0429 11:58:36.464862  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:36.465323  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:36.465360  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:36.465269  855261 retry.go:31] will retry after 511.038905ms: waiting for machine to come up

	I0429 11:58:36.977986  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:36.978366  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:36.978392  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:36.978318  855261 retry.go:31] will retry after 547.497252ms: waiting for machine to come up

	I0429 11:58:37.527119  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:37.527647  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:37.527692  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:37.527566  855261 retry.go:31] will retry after 579.855719ms: waiting for machine to come up

	I0429 11:58:38.109424  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:38.109970  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:38.109996  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:38.109868  855261 retry.go:31] will retry after 970.342231ms: waiting for machine to come up

	I0429 11:58:39.081825  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:39.082174  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:39.082202  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:39.082135  855261 retry.go:31] will retry after 1.386140204s: waiting for machine to come up

	I0429 11:58:40.470833  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:40.471264  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:40.471284  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:40.471216  855261 retry.go:31] will retry after 1.248843306s: waiting for machine to come up

	I0429 11:58:41.721814  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:41.722271  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:41.722304  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:41.722217  855261 retry.go:31] will retry after 1.814517167s: waiting for machine to come up

	I0429 11:58:43.539158  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:43.539622  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:43.539651  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:43.539578  855261 retry.go:31] will retry after 1.998355959s: waiting for machine to come up

	I0429 11:58:45.540991  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:45.541629  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:45.541660  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:45.541578  855261 retry.go:31] will retry after 2.619980651s: waiting for machine to come up

	I0429 11:58:48.164343  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:48.164776  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:48.164803  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:48.164732  855261 retry.go:31] will retry after 3.948644521s: waiting for machine to come up

	I0429 11:58:52.117704  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:52.118236  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find current IP address of domain addons-943107 in network mk-addons-943107

	I0429 11:58:52.118268  855239 main.go:141] libmachine: (addons-943107) DBG | I0429 11:58:52.118129  855261 retry.go:31] will retry after 3.847570469s: waiting for machine to come up

	I0429 11:58:55.968651  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:55.969204  855239 main.go:141] libmachine: (addons-943107) Found IP for machine: 192.168.39.39

	I0429 11:58:55.969258  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has current primary IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:55.969272  855239 main.go:141] libmachine: (addons-943107) Reserving static IP address...

	I0429 11:58:55.969608  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find host DHCP lease matching {name: "addons-943107", mac: "52:54:00:57:1a:36", ip: "192.168.39.39"} in network mk-addons-943107

	I0429 11:58:56.064457  855239 main.go:141] libmachine: (addons-943107) DBG | Getting to WaitForSSH function...

	I0429 11:58:56.064493  855239 main.go:141] libmachine: (addons-943107) Reserved static IP address: 192.168.39.39

	I0429 11:58:56.064507  855239 main.go:141] libmachine: (addons-943107) Waiting for SSH to be available...

	I0429 11:58:56.067561  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:56.067896  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107

	I0429 11:58:56.067930  855239 main.go:141] libmachine: (addons-943107) DBG | unable to find defined IP address of network mk-addons-943107 interface with MAC address 52:54:00:57:1a:36

	I0429 11:58:56.068168  855239 main.go:141] libmachine: (addons-943107) DBG | Using SSH client type: external

	I0429 11:58:56.068208  855239 main.go:141] libmachine: (addons-943107) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa (-rw-------)

	I0429 11:58:56.068241  855239 main.go:141] libmachine: (addons-943107) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 11:58:56.068270  855239 main.go:141] libmachine: (addons-943107) DBG | About to run SSH command:

	I0429 11:58:56.068288  855239 main.go:141] libmachine: (addons-943107) DBG | exit 0

	I0429 11:58:56.072676  855239 main.go:141] libmachine: (addons-943107) DBG | SSH cmd err, output: exit status 255: 

	I0429 11:58:56.072706  855239 main.go:141] libmachine: (addons-943107) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0429 11:58:56.072714  855239 main.go:141] libmachine: (addons-943107) DBG | command : exit 0

	I0429 11:58:56.072719  855239 main.go:141] libmachine: (addons-943107) DBG | err     : exit status 255

	I0429 11:58:56.072727  855239 main.go:141] libmachine: (addons-943107) DBG | output  : 

	I0429 11:58:59.073587  855239 main.go:141] libmachine: (addons-943107) DBG | Getting to WaitForSSH function...

	I0429 11:58:59.076554  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.076968  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.077006  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.077022  855239 main.go:141] libmachine: (addons-943107) DBG | Using SSH client type: external

	I0429 11:58:59.077030  855239 main.go:141] libmachine: (addons-943107) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa (-rw-------)

	I0429 11:58:59.077050  855239 main.go:141] libmachine: (addons-943107) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.39 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 11:58:59.077065  855239 main.go:141] libmachine: (addons-943107) DBG | About to run SSH command:

	I0429 11:58:59.077075  855239 main.go:141] libmachine: (addons-943107) DBG | exit 0

	I0429 11:58:59.199777  855239 main.go:141] libmachine: (addons-943107) DBG | SSH cmd err, output: <nil>: 

	I0429 11:58:59.200151  855239 main.go:141] libmachine: (addons-943107) KVM machine creation complete!

	I0429 11:58:59.200609  855239 main.go:141] libmachine: (addons-943107) Calling .GetConfigRaw

	I0429 11:58:59.238187  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:58:59.238627  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:58:59.238911  855239 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0429 11:58:59.238935  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:58:59.240906  855239 main.go:141] libmachine: Detecting operating system of created instance...

	I0429 11:58:59.240928  855239 main.go:141] libmachine: Waiting for SSH to be available...

	I0429 11:58:59.240936  855239 main.go:141] libmachine: Getting to WaitForSSH function...

	I0429 11:58:59.240945  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:58:59.244004  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.244343  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.244379  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.244521  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:58:59.244773  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.244978  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.245143  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:58:59.245341  855239 main.go:141] libmachine: Using SSH client type: native

	I0429 11:58:59.245627  855239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.39 22 <nil> <nil>}

	I0429 11:58:59.245646  855239 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0429 11:58:59.351290  855239 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 11:58:59.351317  855239 main.go:141] libmachine: Detecting the provisioner...

	I0429 11:58:59.351325  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:58:59.354829  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.355284  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.355318  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.355541  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:58:59.355802  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.356036  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.356249  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:58:59.356465  855239 main.go:141] libmachine: Using SSH client type: native

	I0429 11:58:59.356677  855239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.39 22 <nil> <nil>}

	I0429 11:58:59.356691  855239 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0429 11:58:59.460946  855239 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0429 11:58:59.461072  855239 main.go:141] libmachine: found compatible host: buildroot

	I0429 11:58:59.461085  855239 main.go:141] libmachine: Provisioning with buildroot...

	I0429 11:58:59.461097  855239 main.go:141] libmachine: (addons-943107) Calling .GetMachineName

	I0429 11:58:59.461422  855239 buildroot.go:166] provisioning hostname "addons-943107"

	I0429 11:58:59.461453  855239 main.go:141] libmachine: (addons-943107) Calling .GetMachineName

	I0429 11:58:59.461758  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:58:59.464735  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.465129  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.465157  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.465496  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:58:59.465709  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.465912  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.466092  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:58:59.466290  855239 main.go:141] libmachine: Using SSH client type: native

	I0429 11:58:59.466483  855239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.39 22 <nil> <nil>}

	I0429 11:58:59.466495  855239 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-943107 && echo "addons-943107" | sudo tee /etc/hostname

	I0429 11:58:59.589578  855239 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-943107

	I0429 11:58:59.589618  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:58:59.592924  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.593246  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.593276  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.593427  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:58:59.593683  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.593862  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.594000  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:58:59.594153  855239 main.go:141] libmachine: Using SSH client type: native

	I0429 11:58:59.594351  855239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.39 22 <nil> <nil>}

	I0429 11:58:59.594375  855239 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-943107' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-943107/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-943107' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0429 11:58:59.711807  855239 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 11:58:59.711847  855239 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18773-847310/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-847310/.minikube}

	I0429 11:58:59.711876  855239 buildroot.go:174] setting up certificates

	I0429 11:58:59.711894  855239 provision.go:84] configureAuth start

	I0429 11:58:59.711909  855239 main.go:141] libmachine: (addons-943107) Calling .GetMachineName

	I0429 11:58:59.712302  855239 main.go:141] libmachine: (addons-943107) Calling .GetIP

	I0429 11:58:59.715304  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.715779  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.715809  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.715974  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:58:59.718510  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.719038  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.719072  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.719258  855239 provision.go:143] copyHostCerts

	I0429 11:58:59.719352  855239 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem (1078 bytes)

	I0429 11:58:59.719533  855239 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem (1123 bytes)

	I0429 11:58:59.719637  855239 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem (1679 bytes)

	I0429 11:58:59.719726  855239 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem org=jenkins.addons-943107 san=[127.0.0.1 192.168.39.39 addons-943107 localhost minikube]

	I0429 11:58:59.897840  855239 provision.go:177] copyRemoteCerts

	I0429 11:58:59.897928  855239 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0429 11:58:59.897977  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:58:59.900918  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.901228  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:58:59.901254  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:58:59.901431  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:58:59.901685  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:58:59.901842  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:58:59.902020  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:58:59.983122  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0429 11:59:00.009907  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0429 11:59:00.036765  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0429 11:59:00.063537  855239 provision.go:87] duration metric: took 351.624331ms to configureAuth

	I0429 11:59:00.063579  855239 buildroot.go:189] setting minikube options for container-runtime

	I0429 11:59:00.063764  855239 config.go:182] Loaded profile config "addons-943107": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 11:59:00.063857  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:00.066671  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.067007  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.067055  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.067214  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:00.067474  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:00.067666  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:00.068002  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:00.068186  855239 main.go:141] libmachine: Using SSH client type: native

	I0429 11:59:00.068391  855239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.39 22 <nil> <nil>}

	I0429 11:59:00.068407  855239 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0429 11:59:00.348248  855239 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0429 11:59:00.348280  855239 main.go:141] libmachine: Checking connection to Docker...

	I0429 11:59:00.348292  855239 main.go:141] libmachine: (addons-943107) Calling .GetURL

	I0429 11:59:00.349792  855239 main.go:141] libmachine: (addons-943107) DBG | Using libvirt version 6000000

	I0429 11:59:00.352330  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.352710  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.352767  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.352953  855239 main.go:141] libmachine: Docker is up and running!

	I0429 11:59:00.352975  855239 main.go:141] libmachine: Reticulating splines...

	I0429 11:59:00.352986  855239 client.go:171] duration metric: took 27.003376189s to LocalClient.Create

	I0429 11:59:00.353018  855239 start.go:167] duration metric: took 27.003443831s to libmachine.API.Create "addons-943107"

	I0429 11:59:00.353032  855239 start.go:293] postStartSetup for "addons-943107" (driver="kvm2")

	I0429 11:59:00.353049  855239 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0429 11:59:00.353073  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:00.353382  855239 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0429 11:59:00.353410  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:00.355578  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.355903  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.355929  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.356138  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:00.356387  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:00.356539  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:00.356708  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:00.439300  855239 ssh_runner.go:195] Run: cat /etc/os-release

	I0429 11:59:00.444114  855239 info.go:137] Remote host: Buildroot 2023.02.9

	I0429 11:59:00.444154  855239 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/addons for local assets ...

	I0429 11:59:00.444257  855239 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/files for local assets ...

	I0429 11:59:00.444283  855239 start.go:296] duration metric: took 91.243677ms for postStartSetup

	I0429 11:59:00.444327  855239 main.go:141] libmachine: (addons-943107) Calling .GetConfigRaw

	I0429 11:59:00.445031  855239 main.go:141] libmachine: (addons-943107) Calling .GetIP

	I0429 11:59:00.447832  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.448151  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.448186  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.448560  855239 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/config.json ...

	I0429 11:59:00.448848  855239 start.go:128] duration metric: took 27.119135672s to createHost

	I0429 11:59:00.448891  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:00.451776  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.452145  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.452174  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.452342  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:00.452609  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:00.452791  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:00.452969  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:00.453303  855239 main.go:141] libmachine: Using SSH client type: native

	I0429 11:59:00.453513  855239 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.39 22 <nil> <nil>}

	I0429 11:59:00.453529  855239 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0429 11:59:00.556621  855239 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714391940.532906001

	I0429 11:59:00.556668  855239 fix.go:216] guest clock: 1714391940.532906001

	I0429 11:59:00.556681  855239 fix.go:229] Guest: 2024-04-29 11:59:00.532906001 +0000 UTC Remote: 2024-04-29 11:59:00.448866864 +0000 UTC m=+27.241160902 (delta=84.039137ms)

	I0429 11:59:00.556743  855239 fix.go:200] guest clock delta is within tolerance: 84.039137ms

	I0429 11:59:00.556750  855239 start.go:83] releasing machines lock for "addons-943107", held for 27.227116472s

	I0429 11:59:00.556783  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:00.557097  855239 main.go:141] libmachine: (addons-943107) Calling .GetIP

	I0429 11:59:00.559916  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.560300  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.560331  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.560720  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:00.561322  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:00.561544  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:00.561653  855239 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0429 11:59:00.561710  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:00.561755  855239 ssh_runner.go:195] Run: cat /version.json

	I0429 11:59:00.561785  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:00.564460  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.564718  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.564830  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.564854  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.565042  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:00.565122  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:00.565150  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:00.565277  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:00.565350  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:00.565475  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:00.565503  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:00.565758  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:00.565776  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:00.565925  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:00.669912  855239 ssh_runner.go:195] Run: systemctl --version

	I0429 11:59:00.676320  855239 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0429 11:59:00.839890  855239 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0429 11:59:00.847394  855239 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0429 11:59:00.847493  855239 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0429 11:59:00.865283  855239 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0429 11:59:00.865318  855239 start.go:494] detecting cgroup driver to use...

	I0429 11:59:00.865413  855239 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0429 11:59:00.885607  855239 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0429 11:59:00.899984  855239 docker.go:217] disabling cri-docker service (if available) ...

	I0429 11:59:00.900073  855239 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0429 11:59:00.914657  855239 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0429 11:59:00.929621  855239 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0429 11:59:01.048083  855239 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0429 11:59:01.196443  855239 docker.go:233] disabling docker service ...

	I0429 11:59:01.196554  855239 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0429 11:59:01.211997  855239 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0429 11:59:01.226316  855239 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0429 11:59:01.369905  855239 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0429 11:59:01.495868  855239 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0429 11:59:01.511295  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0429 11:59:01.532545  855239 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0429 11:59:01.532628  855239 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 11:59:01.544697  855239 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0429 11:59:01.544788  855239 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 11:59:01.557002  855239 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 11:59:01.569105  855239 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 11:59:01.581033  855239 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0429 11:59:01.593618  855239 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 11:59:01.605682  855239 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 11:59:01.625337  855239 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 11:59:01.637949  855239 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0429 11:59:01.649978  855239 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0429 11:59:01.650059  855239 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0429 11:59:01.667512  855239 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0429 11:59:01.680181  855239 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 11:59:01.813636  855239 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0429 11:59:01.966608  855239 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0429 11:59:01.966707  855239 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0429 11:59:01.972137  855239 start.go:562] Will wait 60s for crictl version

	I0429 11:59:01.972238  855239 ssh_runner.go:195] Run: which crictl

	I0429 11:59:01.976590  855239 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0429 11:59:02.024149  855239 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0429 11:59:02.024254  855239 ssh_runner.go:195] Run: crio --version

	I0429 11:59:02.055429  855239 ssh_runner.go:195] Run: crio --version

	I0429 11:59:02.088217  855239 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0429 11:59:02.089724  855239 main.go:141] libmachine: (addons-943107) Calling .GetIP

	I0429 11:59:02.092994  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:02.093485  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:02.093522  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:02.093821  855239 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0429 11:59:02.098872  855239 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 11:59:02.113579  855239 kubeadm.go:877] updating cluster {Name:addons-943107 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.

0 ClusterName:addons-943107 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.39 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountTy

pe:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0429 11:59:02.113719  855239 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 11:59:02.113773  855239 ssh_runner.go:195] Run: sudo crictl images --output json

	I0429 11:59:02.150050  855239 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0". assuming images are not preloaded.

	I0429 11:59:02.150129  855239 ssh_runner.go:195] Run: which lz4

	I0429 11:59:02.154569  855239 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0429 11:59:02.159042  855239 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0429 11:59:02.159090  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394544937 bytes)

	I0429 11:59:03.585872  855239 crio.go:462] duration metric: took 1.431351918s to copy over tarball

	I0429 11:59:03.585960  855239 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0429 11:59:05.988863  855239 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.402865341s)

	I0429 11:59:05.988905  855239 crio.go:469] duration metric: took 2.402993879s to extract the tarball

	I0429 11:59:05.988918  855239 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0429 11:59:06.028257  855239 ssh_runner.go:195] Run: sudo crictl images --output json

	I0429 11:59:06.076088  855239 crio.go:514] all images are preloaded for cri-o runtime.

	I0429 11:59:06.076120  855239 cache_images.go:84] Images are preloaded, skipping loading

	I0429 11:59:06.076129  855239 kubeadm.go:928] updating node { 192.168.39.39 8443 v1.30.0 crio true true} ...

	I0429 11:59:06.076326  855239 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-943107 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.39

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:addons-943107 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0429 11:59:06.076422  855239 ssh_runner.go:195] Run: crio config

	I0429 11:59:06.124788  855239 cni.go:84] Creating CNI manager for ""

	I0429 11:59:06.124817  855239 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0429 11:59:06.124839  855239 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0429 11:59:06.124877  855239 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.39 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-943107 NodeName:addons-943107 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.39"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.39 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube

rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0429 11:59:06.125090  855239 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.39

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-943107"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.39

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.39"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0429 11:59:06.125196  855239 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0429 11:59:06.137399  855239 binaries.go:44] Found k8s binaries, skipping transfer

	I0429 11:59:06.137506  855239 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0429 11:59:06.148662  855239 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0429 11:59:06.167424  855239 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0429 11:59:06.186708  855239 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)

	I0429 11:59:06.207010  855239 ssh_runner.go:195] Run: grep 192.168.39.39	control-plane.minikube.internal$ /etc/hosts

	I0429 11:59:06.211164  855239 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.39	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 11:59:06.225093  855239 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 11:59:06.358797  855239 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 11:59:06.381825  855239 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107 for IP: 192.168.39.39

	I0429 11:59:06.381857  855239 certs.go:194] generating shared ca certs ...

	I0429 11:59:06.381876  855239 certs.go:226] acquiring lock for ca certs: {Name:mk6be02e49d8ee7e457b7d9b7cd478c5e883ea66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.382049  855239 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key

	I0429 11:59:06.513386  855239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt ...

	I0429 11:59:06.513429  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt: {Name:mk39b1bec1d4d16eb6fafeb0984c7e01ffe5830c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.513641  855239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key ...

	I0429 11:59:06.513656  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key: {Name:mkbe7605cd61a4b65455e73eb81a81b05113b7fb Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.513764  855239 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key

	I0429 11:59:06.686124  855239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt ...

	I0429 11:59:06.686168  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt: {Name:mk4a69cb30023074d361c666567fef53b992197c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.686348  855239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key ...

	I0429 11:59:06.686359  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key: {Name:mk8776204f36aaa310b069828f51dcf285140a60 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.686432  855239 certs.go:256] generating profile certs ...

	I0429 11:59:06.686520  855239 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/client.key

	I0429 11:59:06.686541  855239 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/client.crt with IP's: []

	I0429 11:59:06.834181  855239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/client.crt ...

	I0429 11:59:06.834220  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/client.crt: {Name:mk07c6137e4b93baf00cb40880dbc5c2e17fcc30 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.834402  855239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/client.key ...

	I0429 11:59:06.834414  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/client.key: {Name:mk92b4b1ba1bbaed5a5d1bc05bf57a6740084630 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.834486  855239 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.key.a1643f6f

	I0429 11:59:06.834507  855239 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.crt.a1643f6f with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.39]

	I0429 11:59:06.978215  855239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.crt.a1643f6f ...

	I0429 11:59:06.978253  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.crt.a1643f6f: {Name:mk6744f584dddd2fb811eb74924f1d60df0716b7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.978423  855239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.key.a1643f6f ...

	I0429 11:59:06.978437  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.key.a1643f6f: {Name:mk4ff6f18d368edae5e633865a73df79f531663d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:06.978503  855239 certs.go:381] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.crt.a1643f6f -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.crt

	I0429 11:59:06.978610  855239 certs.go:385] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.key.a1643f6f -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.key

	I0429 11:59:06.978666  855239 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.key

	I0429 11:59:06.978686  855239 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.crt with IP's: []

	I0429 11:59:07.159870  855239 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.crt ...

	I0429 11:59:07.159906  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.crt: {Name:mk85620ffc41629f8934863a8eb5836192dfb762 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:07.160074  855239 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.key ...

	I0429 11:59:07.160087  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.key: {Name:mkf8566b21c1bc51e851b337ec21bc0e0fc4f5a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:07.160259  855239 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem (1679 bytes)

	I0429 11:59:07.160298  855239 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem (1078 bytes)

	I0429 11:59:07.160333  855239 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem (1123 bytes)

	I0429 11:59:07.160372  855239 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem (1679 bytes)

	I0429 11:59:07.161035  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0429 11:59:07.192333  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0429 11:59:07.218424  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0429 11:59:07.247229  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0429 11:59:07.276274  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0429 11:59:07.308080  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0429 11:59:07.334803  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0429 11:59:07.361167  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/addons-943107/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0429 11:59:07.388300  855239 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0429 11:59:07.414513  855239 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0429 11:59:07.433756  855239 ssh_runner.go:195] Run: openssl version

	I0429 11:59:07.440213  855239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0429 11:59:07.452983  855239 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0429 11:59:07.458583  855239 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:59 /usr/share/ca-certificates/minikubeCA.pem

	I0429 11:59:07.458675  855239 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0429 11:59:07.465385  855239 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0429 11:59:07.478318  855239 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0429 11:59:07.483111  855239 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0429 11:59:07.483171  855239 kubeadm.go:391] StartCluster: {Name:addons-943107 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 C

lusterName:addons-943107 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.39 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 11:59:07.483263  855239 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0429 11:59:07.483371  855239 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0429 11:59:07.522863  855239 cri.go:89] found id: ""

	I0429 11:59:07.522971  855239 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0429 11:59:07.534661  855239 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0429 11:59:07.546042  855239 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0429 11:59:07.557172  855239 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0429 11:59:07.557201  855239 kubeadm.go:156] found existing configuration files:

	I0429 11:59:07.557267  855239 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0429 11:59:07.568662  855239 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0429 11:59:07.568754  855239 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0429 11:59:07.580084  855239 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0429 11:59:07.590505  855239 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0429 11:59:07.590597  855239 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0429 11:59:07.602387  855239 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0429 11:59:07.612757  855239 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0429 11:59:07.612830  855239 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0429 11:59:07.623622  855239 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0429 11:59:07.634185  855239 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0429 11:59:07.634258  855239 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0429 11:59:07.645349  855239 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0429 11:59:07.715861  855239 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0

	I0429 11:59:07.715969  855239 kubeadm.go:309] [preflight] Running pre-flight checks

	I0429 11:59:07.864554  855239 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0429 11:59:07.864708  855239 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0429 11:59:07.864847  855239 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0429 11:59:08.106533  855239 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0429 11:59:08.108653  855239 out.go:204]   - Generating certificates and keys ...

	I0429 11:59:08.108771  855239 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0429 11:59:08.108850  855239 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0429 11:59:08.353598  855239 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0429 11:59:08.436399  855239 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0429 11:59:08.532276  855239 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0429 11:59:08.806247  855239 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0429 11:59:08.948919  855239 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0429 11:59:08.949131  855239 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [addons-943107 localhost] and IPs [192.168.39.39 127.0.0.1 ::1]

	I0429 11:59:09.138342  855239 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0429 11:59:09.138503  855239 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [addons-943107 localhost] and IPs [192.168.39.39 127.0.0.1 ::1]

	I0429 11:59:09.259195  855239 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0429 11:59:09.867320  855239 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0429 11:59:09.993085  855239 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0429 11:59:09.993165  855239 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0429 11:59:10.047239  855239 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0429 11:59:10.210114  855239 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0429 11:59:10.356479  855239 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0429 11:59:10.489232  855239 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0429 11:59:10.651230  855239 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0429 11:59:10.651760  855239 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0429 11:59:10.655881  855239 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0429 11:59:10.658082  855239 out.go:204]   - Booting up control plane ...

	I0429 11:59:10.658224  855239 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0429 11:59:10.658370  855239 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0429 11:59:10.658508  855239 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0429 11:59:10.673902  855239 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0429 11:59:10.675229  855239 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0429 11:59:10.675307  855239 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0429 11:59:10.811461  855239 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0429 11:59:10.811572  855239 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0429 11:59:11.312418  855239 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 501.32722ms

	I0429 11:59:11.312553  855239 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0429 11:59:16.813025  855239 kubeadm.go:309] [api-check] The API server is healthy after 5.501575158s

	I0429 11:59:16.824379  855239 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0429 11:59:16.847607  855239 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0429 11:59:16.884479  855239 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0429 11:59:16.884783  855239 kubeadm.go:309] [mark-control-plane] Marking the node addons-943107 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0429 11:59:16.897867  855239 kubeadm.go:309] [bootstrap-token] Using token: dn98sn.1vhq1ml92wc4bpyx

	I0429 11:59:16.899437  855239 out.go:204]   - Configuring RBAC rules ...

	I0429 11:59:16.899609  855239 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0429 11:59:16.905859  855239 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0429 11:59:16.915061  855239 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0429 11:59:16.922854  855239 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0429 11:59:16.927213  855239 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0429 11:59:16.931540  855239 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0429 11:59:17.220936  855239 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0429 11:59:17.658516  855239 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0429 11:59:18.217775  855239 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0429 11:59:18.218794  855239 kubeadm.go:309] 

	I0429 11:59:18.218859  855239 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0429 11:59:18.218864  855239 kubeadm.go:309] 

	I0429 11:59:18.218941  855239 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0429 11:59:18.218948  855239 kubeadm.go:309] 

	I0429 11:59:18.218979  855239 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0429 11:59:18.219106  855239 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0429 11:59:18.219208  855239 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0429 11:59:18.219224  855239 kubeadm.go:309] 

	I0429 11:59:18.219314  855239 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0429 11:59:18.219334  855239 kubeadm.go:309] 

	I0429 11:59:18.219417  855239 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0429 11:59:18.219427  855239 kubeadm.go:309] 

	I0429 11:59:18.219505  855239 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0429 11:59:18.219612  855239 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0429 11:59:18.219704  855239 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0429 11:59:18.219722  855239 kubeadm.go:309] 

	I0429 11:59:18.219856  855239 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0429 11:59:18.219976  855239 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0429 11:59:18.219988  855239 kubeadm.go:309] 

	I0429 11:59:18.220096  855239 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token dn98sn.1vhq1ml92wc4bpyx \

	I0429 11:59:18.220227  855239 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 \

	I0429 11:59:18.220252  855239 kubeadm.go:309] 	--control-plane 

	I0429 11:59:18.220257  855239 kubeadm.go:309] 

	I0429 11:59:18.220342  855239 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0429 11:59:18.220350  855239 kubeadm.go:309] 

	I0429 11:59:18.220440  855239 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token dn98sn.1vhq1ml92wc4bpyx \

	I0429 11:59:18.220568  855239 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 

	I0429 11:59:18.221219  855239 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0429 11:59:18.221340  855239 cni.go:84] Creating CNI manager for ""

	I0429 11:59:18.221358  855239 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0429 11:59:18.223178  855239 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0429 11:59:18.224660  855239 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0429 11:59:18.238734  855239 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0429 11:59:18.259228  855239 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0429 11:59:18.259314  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:18.259314  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-943107 minikube.k8s.io/updated_at=2024_04_29T11_59_18_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332 minikube.k8s.io/name=addons-943107 minikube.k8s.io/primary=true

	I0429 11:59:18.288888  855239 ops.go:34] apiserver oom_adj: -16

	I0429 11:59:18.419145  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:18.919908  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:19.419405  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:19.919270  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:20.419412  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:20.919159  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:21.419630  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:21.919337  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:22.419820  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:22.919559  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:23.419508  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:23.919808  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:24.419415  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:24.919891  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:25.419474  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:25.920174  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:26.419269  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:26.920258  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:27.420013  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:27.919455  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:28.419846  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:28.919349  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:29.419291  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:29.919302  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:30.419805  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:30.920011  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:31.419963  855239 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 11:59:31.760636  855239 kubeadm.go:1107] duration metric: took 13.501398084s to wait for elevateKubeSystemPrivileges

	W0429 11:59:31.760683  855239 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0429 11:59:31.760692  855239 kubeadm.go:393] duration metric: took 24.277526228s to StartCluster

	I0429 11:59:31.760715  855239 settings.go:142] acquiring lock: {Name:mkfc2a12c970f9efb6ef840042bb7ab028a1a307 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:31.760866  855239 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 11:59:31.761326  855239 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/kubeconfig: {Name:mkadb918f2b0432255c1cf69aa2465afc0e639c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 11:59:31.761569  855239 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.39 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 11:59:31.763662  855239 out.go:177] * Verifying Kubernetes components...

	I0429 11:59:31.761604  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0429 11:59:31.761621  855239 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]

	I0429 11:59:31.761814  855239 config.go:182] Loaded profile config "addons-943107": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 11:59:31.765085  855239 addons.go:69] Setting yakd=true in profile "addons-943107"

	I0429 11:59:31.765127  855239 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 11:59:31.765140  855239 addons.go:234] Setting addon yakd=true in "addons-943107"

	I0429 11:59:31.765181  855239 addons.go:69] Setting ingress-dns=true in profile "addons-943107"

	I0429 11:59:31.765203  855239 addons.go:69] Setting inspektor-gadget=true in profile "addons-943107"

	I0429 11:59:31.765217  855239 addons.go:234] Setting addon ingress-dns=true in "addons-943107"

	I0429 11:59:31.765222  855239 addons.go:69] Setting default-storageclass=true in profile "addons-943107"

	I0429 11:59:31.765254  855239 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-943107"

	I0429 11:59:31.765266  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.765310  855239 addons.go:234] Setting addon inspektor-gadget=true in "addons-943107"

	I0429 11:59:31.765192  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.765368  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.765659  855239 addons.go:69] Setting metrics-server=true in profile "addons-943107"

	I0429 11:59:31.765681  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.765697  855239 addons.go:234] Setting addon metrics-server=true in "addons-943107"

	I0429 11:59:31.765710  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.765715  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.765731  855239 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-943107"

	I0429 11:59:31.765745  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.765749  855239 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-943107"

	I0429 11:59:31.765764  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.765790  855239 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-943107"

	I0429 11:59:31.765887  855239 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-943107"

	I0429 11:59:31.765935  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.766115  855239 addons.go:69] Setting ingress=true in profile "addons-943107"

	I0429 11:59:31.766155  855239 addons.go:69] Setting registry=true in profile "addons-943107"

	I0429 11:59:31.766169  855239 addons.go:234] Setting addon ingress=true in "addons-943107"

	I0429 11:59:31.766199  855239 addons.go:234] Setting addon registry=true in "addons-943107"

	I0429 11:59:31.766211  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.766227  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.766294  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.766314  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.766535  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.766541  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.766560  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.766563  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.766579  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.766599  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.766640  855239 addons.go:69] Setting cloud-spanner=true in profile "addons-943107"

	I0429 11:59:31.766139  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.766668  855239 addons.go:234] Setting addon cloud-spanner=true in "addons-943107"

	I0429 11:59:31.765665  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.766670  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.766690  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.766689  855239 addons.go:69] Setting gcp-auth=true in profile "addons-943107"

	I0429 11:59:31.766712  855239 mustload.go:65] Loading cluster: addons-943107

	I0429 11:59:31.765720  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.766753  855239 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-943107"

	I0429 11:59:31.766780  855239 addons.go:69] Setting helm-tiller=true in profile "addons-943107"

	I0429 11:59:31.766779  855239 addons.go:69] Setting volumesnapshots=true in profile "addons-943107"

	I0429 11:59:31.766800  855239 addons.go:234] Setting addon helm-tiller=true in "addons-943107"

	I0429 11:59:31.766821  855239 addons.go:234] Setting addon volumesnapshots=true in "addons-943107"

	I0429 11:59:31.766781  855239 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-943107"

	I0429 11:59:31.766759  855239 addons.go:69] Setting storage-provisioner=true in profile "addons-943107"

	I0429 11:59:31.766870  855239 addons.go:234] Setting addon storage-provisioner=true in "addons-943107"

	I0429 11:59:31.766911  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.766914  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.767071  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.767098  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.767257  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.767295  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.767297  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.767326  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.767427  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.767934  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.767986  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.772404  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.772876  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.772917  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.788237  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41229

	I0429 11:59:31.788515  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38955

	I0429 11:59:31.788633  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33141

	I0429 11:59:31.789172  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.789427  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.789857  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.790083  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.790097  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.790697  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.790724  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.790800  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.790937  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.790952  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.791265  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.791655  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.791690  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.792231  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.792842  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.792936  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.803136  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34413

	I0429 11:59:31.803868  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.804586  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.804613  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.805030  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.805727  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.805754  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.805936  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34035

	I0429 11:59:31.807671  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33617

	I0429 11:59:31.809462  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.809512  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.809758  855239 config.go:182] Loaded profile config "addons-943107": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 11:59:31.810151  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.810177  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.811467  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.811505  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.818438  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.818626  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45875

	I0429 11:59:31.818837  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.819491  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.819519  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.819613  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.819779  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.819790  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.820375  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.820440  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.820455  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.820477  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.821029  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.821056  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.821275  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.821325  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.821689  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.822410  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.822500  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.830247  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38259

	I0429 11:59:31.830812  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32979

	I0429 11:59:31.831151  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.831575  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33989

	I0429 11:59:31.831620  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.832018  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.832173  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.832202  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.832305  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.832331  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.832758  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.832824  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.832889  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.832914  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.833504  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.833627  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.833687  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.835861  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.836238  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.836686  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.836723  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.839085  855239 addons.go:234] Setting addon default-storageclass=true in "addons-943107"

	I0429 11:59:31.839141  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.839581  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.839646  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.839936  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.840040  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35247

	I0429 11:59:31.904551  855239 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0

	I0429 11:59:31.840567  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.845834  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40721

	I0429 11:59:31.846555  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33175

	I0429 11:59:31.851265  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34985

	I0429 11:59:31.851294  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45089

	I0429 11:59:31.853468  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36585

	I0429 11:59:31.860944  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42315

	I0429 11:59:31.860993  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39193

	I0429 11:59:31.866600  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41555

	I0429 11:59:31.870061  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40439

	I0429 11:59:31.870052  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39505

	I0429 11:59:31.872227  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42039

	I0429 11:59:31.874894  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44357

	I0429 11:59:31.876212  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38283

	I0429 11:59:31.908143  855239 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0429 11:59:31.907642  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907672  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907680  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907684  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907684  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907714  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907744  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907751  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907754  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907757  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907759  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907793  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.907831  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.908083  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.909735  855239 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0429 11:59:31.912561  855239 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0429 11:59:31.912585  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0429 11:59:31.912606  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.909944  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911576  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.912711  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911591  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.912764  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911599  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.912808  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911647  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.912853  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911654  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.912905  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911664  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.912954  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911675  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.913009  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911680  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.913054  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911691  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.913099  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911756  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.913135  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911762  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.913176  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911768  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.913215  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.911780  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.913247  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.913330  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.913398  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.913438  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914165  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914227  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914270  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914307  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914346  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914382  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914421  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.914565  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.914614  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.914842  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.914873  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.914896  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.914955  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.915007  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.915287  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.915349  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.915408  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.915423  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.915432  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.915444  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.915474  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.915656  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.915876  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.915913  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.916956  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.917019  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.917068  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.917526  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.917570  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.918847  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.920830  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.920878  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.920936  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.922630  855239 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I0429 11:59:31.921316  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.921688  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.922168  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.923259  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.924163  855239 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0429 11:59:31.924221  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.924953  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.925450  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.925482  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0429 11:59:31.925501  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.925138  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.925138  855239 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-943107"

	I0429 11:59:31.925382  855239 out.go:177]   - Using image docker.io/registry:2.8.3

	I0429 11:59:31.928486  855239 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0429 11:59:31.930304  855239 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0

	I0429 11:59:31.929667  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.933011  855239 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4

	I0429 11:59:31.926535  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.925402  855239 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.27.0

	I0429 11:59:31.929897  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:31.929993  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.930243  855239 addons.go:426] installing /etc/kubernetes/addons/registry-rc.yaml

	I0429 11:59:31.931659  855239 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0429 11:59:31.931699  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.934321  855239 addons.go:426] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0429 11:59:31.934375  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0429 11:59:31.934404  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.935544  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0429 11:59:31.935630  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)

	I0429 11:59:31.935687  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)

	I0429 11:59:31.935728  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.935965  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.935993  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.936991  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.937003  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0429 11:59:31.937015  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.937821  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.938017  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.938224  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.938504  855239 addons.go:426] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0429 11:59:31.938584  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35069

	I0429 11:59:31.938604  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.938623  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.939982  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.940049  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0429 11:59:31.942618  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.940161  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.940252  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.940275  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0429 11:59:31.940558  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.945815  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0429 11:59:31.944972  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.947083  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.947144  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0429 11:59:31.947400  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38599

	I0429 11:59:31.947622  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.947751  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.948318  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.948520  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0429 11:59:31.948560  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43929

	I0429 11:59:31.948752  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.948778  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.949058  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33743

	I0429 11:59:31.949453  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.950113  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.949555  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.950154  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.950176  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.950177  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.950199  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.950082  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0429 11:59:31.950501  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.950688  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.950729  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.950746  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.950927  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.951107  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.951147  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39803

	I0429 11:59:31.951528  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.952127  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.951836  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0429 11:59:31.953396  855239 addons.go:426] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0429 11:59:31.953416  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0429 11:59:31.952542  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.953436  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.952564  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.952567  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.952574  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.952603  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.952748  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.953628  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.952795  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.952982  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.953765  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.953805  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.953867  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.953911  855239 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0429 11:59:31.953910  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.953924  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0429 11:59:31.953942  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.953999  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.953091  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.954228  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.954310  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.954359  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.954417  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.954337  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.954775  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.954961  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.955136  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.956132  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.956626  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.956644  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.957828  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.958146  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.958214  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.958255  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.958305  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.958359  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.958893  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.958919  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.960718  855239 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0429 11:59:31.959099  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.959998  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.960153  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.960997  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.962089  855239 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	I0429 11:59:31.963429  855239 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0429 11:59:31.963451  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0429 11:59:31.963483  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.962211  855239 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.16

	I0429 11:59:31.962265  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.962094  855239 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0429 11:59:31.962594  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.962599  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.964654  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44427

	I0429 11:59:31.964976  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0429 11:59:31.965072  855239 addons.go:426] installing /etc/kubernetes/addons/deployment.yaml

	I0429 11:59:31.965093  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.965438  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.966223  855239 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.15.0

	I0429 11:59:31.967509  855239 addons.go:426] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0429 11:59:31.967521  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0429 11:59:31.967536  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.965470  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.966116  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35963

	I0429 11:59:31.966349  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0429 11:59:31.967680  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.966373  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.966419  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.967095  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.968016  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.968470  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.968490  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.968569  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.968894  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.969218  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.969233  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.969335  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.969773  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:31.969803  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:31.969999  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.970245  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.972021  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.972304  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.972474  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.972489  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.972772  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.972829  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.972838  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.972997  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.973051  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.973225  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.973241  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.973417  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.973492  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.973514  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.973744  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.973980  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.974075  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.974302  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.974598  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.974786  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.975162  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.975704  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.975735  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.976196  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.976273  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.976496  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	W0429 11:59:31.976513  855239 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:37162->192.168.39.39:22: read: connection reset by peer

	I0429 11:59:31.977972  855239 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0429 11:59:31.976544  855239 retry.go:31] will retry after 205.986115ms: ssh: handshake failed: read tcp 192.168.39.1:37162->192.168.39.39:22: read: connection reset by peer

	I0429 11:59:31.976687  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.979157  855239 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0429 11:59:31.979188  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0429 11:59:31.979213  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:31.979262  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:31.982668  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:31.983079  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:31.983094  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	W0429 11:59:31.983188  855239 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:37170->192.168.39.39:22: read: connection reset by peer

	I0429 11:59:31.983207  855239 retry.go:31] will retry after 181.256893ms: ssh: handshake failed: read tcp 192.168.39.1:37170->192.168.39.39:22: read: connection reset by peer

	I0429 11:59:31.983327  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:31.983575  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:31.983742  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:31.983917  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	W0429 11:59:31.984651  855239 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:37176->192.168.39.39:22: read: connection reset by peer

	I0429 11:59:31.984667  855239 retry.go:31] will retry after 202.699616ms: ssh: handshake failed: read tcp 192.168.39.1:37176->192.168.39.39:22: read: connection reset by peer

	I0429 11:59:31.992476  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37063

	I0429 11:59:31.993005  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:31.993548  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:31.993576  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:31.993933  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:31.994129  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:31.995974  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:31.997853  855239 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0429 11:59:31.999203  855239 out.go:177]   - Using image docker.io/busybox:stable

	I0429 11:59:32.000568  855239 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0429 11:59:32.000589  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0429 11:59:32.000613  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:32.004648  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:32.005081  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:32.005141  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:32.005500  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:32.005720  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:32.005895  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:32.006075  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:32.169398  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0429 11:59:32.256372  855239 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 11:59:32.256550  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0429 11:59:32.270203  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0429 11:59:32.315147  855239 addons.go:426] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0429 11:59:32.315188  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0429 11:59:32.326649  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0429 11:59:32.335887  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0429 11:59:32.453860  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0429 11:59:32.491927  855239 addons.go:426] installing /etc/kubernetes/addons/registry-svc.yaml

	I0429 11:59:32.491957  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0429 11:59:32.563627  855239 addons.go:426] installing /etc/kubernetes/addons/ig-role.yaml

	I0429 11:59:32.563656  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0429 11:59:32.607790  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0429 11:59:32.636707  855239 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0429 11:59:32.636745  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0429 11:59:32.659826  855239 addons.go:426] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0429 11:59:32.659856  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0429 11:59:32.674452  855239 addons.go:426] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0429 11:59:32.674480  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0429 11:59:32.772703  855239 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0429 11:59:32.772740  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0429 11:59:32.772883  855239 addons.go:426] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0429 11:59:32.772903  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0429 11:59:32.789266  855239 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0429 11:59:32.789296  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0429 11:59:32.828587  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0429 11:59:32.831801  855239 addons.go:426] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0429 11:59:32.831835  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0429 11:59:32.868936  855239 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0429 11:59:32.868976  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0429 11:59:32.904187  855239 addons.go:426] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0429 11:59:32.904222  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0429 11:59:32.907296  855239 addons.go:426] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0429 11:59:32.907323  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0429 11:59:32.945764  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0429 11:59:32.963322  855239 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0429 11:59:32.963378  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0429 11:59:33.032898  855239 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0429 11:59:33.032941  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0429 11:59:33.045769  855239 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0429 11:59:33.045803  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0429 11:59:33.068745  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0429 11:59:33.070613  855239 addons.go:426] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0429 11:59:33.070643  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0429 11:59:33.117116  855239 addons.go:426] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0429 11:59:33.117151  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0429 11:59:33.236085  855239 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0429 11:59:33.236115  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0429 11:59:33.344609  855239 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0429 11:59:33.344659  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0429 11:59:33.369041  855239 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0429 11:59:33.369072  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0429 11:59:33.487678  855239 addons.go:426] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0429 11:59:33.487709  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0429 11:59:33.492310  855239 addons.go:426] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0429 11:59:33.492335  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0429 11:59:33.651937  855239 addons.go:426] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0429 11:59:33.651972  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0429 11:59:33.716125  855239 addons.go:426] installing /etc/kubernetes/addons/ig-crd.yaml

	I0429 11:59:33.716156  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0429 11:59:33.722309  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0429 11:59:33.882660  855239 addons.go:426] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0429 11:59:33.882701  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0429 11:59:33.883997  855239 addons.go:426] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0429 11:59:33.884023  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0429 11:59:33.897713  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0429 11:59:34.134293  855239 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0429 11:59:34.134335  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0429 11:59:34.145377  855239 addons.go:426] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0429 11:59:34.145406  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0429 11:59:34.272673  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0429 11:59:34.281467  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0429 11:59:34.450300  855239 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0429 11:59:34.450340  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0429 11:59:34.715423  855239 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0429 11:59:34.715454  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0429 11:59:34.869775  855239 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0429 11:59:34.869801  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0429 11:59:35.052238  855239 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0429 11:59:35.052279  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0429 11:59:35.437929  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0429 11:59:38.989441  855239 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0429 11:59:38.989508  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:38.993153  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:38.993610  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:38.993647  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:38.993829  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:38.994112  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:38.994474  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:38.994679  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:39.565831  855239 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0429 11:59:39.828733  855239 addons.go:234] Setting addon gcp-auth=true in "addons-943107"

	I0429 11:59:39.828819  855239 host.go:66] Checking if "addons-943107" exists ...

	I0429 11:59:39.829301  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:39.829358  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:39.846833  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42499

	I0429 11:59:39.847445  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:39.848033  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:39.848069  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:39.848436  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:39.848929  855239 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 11:59:39.848983  855239 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 11:59:39.866227  855239 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37049

	I0429 11:59:39.866801  855239 main.go:141] libmachine: () Calling .GetVersion

	I0429 11:59:39.867356  855239 main.go:141] libmachine: Using API Version  1

	I0429 11:59:39.867405  855239 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 11:59:39.867872  855239 main.go:141] libmachine: () Calling .GetMachineName

	I0429 11:59:39.868129  855239 main.go:141] libmachine: (addons-943107) Calling .GetState

	I0429 11:59:39.870115  855239 main.go:141] libmachine: (addons-943107) Calling .DriverName

	I0429 11:59:39.870396  855239 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0429 11:59:39.870424  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHHostname

	I0429 11:59:39.873623  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:39.874075  855239 main.go:141] libmachine: (addons-943107) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:57:1a:36", ip: ""} in network mk-addons-943107: {Iface:virbr1 ExpiryTime:2024-04-29 12:58:48 +0000 UTC Type:0 Mac:52:54:00:57:1a:36 Iaid: IPaddr:192.168.39.39 Prefix:24 Hostname:addons-943107 Clientid:01:52:54:00:57:1a:36}

	I0429 11:59:39.874113  855239 main.go:141] libmachine: (addons-943107) DBG | domain addons-943107 has defined IP address 192.168.39.39 and MAC address 52:54:00:57:1a:36 in network mk-addons-943107

	I0429 11:59:39.874257  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHPort

	I0429 11:59:39.874497  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHKeyPath

	I0429 11:59:39.874757  855239 main.go:141] libmachine: (addons-943107) Calling .GetSSHUsername

	I0429 11:59:39.874954  855239 sshutil.go:53] new ssh client: &{IP:192.168.39.39 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/addons-943107/id_rsa Username:docker}

	I0429 11:59:40.698577  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (8.529130403s)

	I0429 11:59:40.698634  855239 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (8.442220785s)

	I0429 11:59:40.698656  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.698666  855239 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (8.442080825s)

	I0429 11:59:40.698689  855239 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0429 11:59:40.698736  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (8.428504213s)

	I0429 11:59:40.698760  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.698777  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.698871  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (8.372160105s)

	I0429 11:59:40.698909  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.362988631s)

	I0429 11:59:40.698921  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.698935  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.698945  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.698979  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (8.245083439s)

	I0429 11:59:40.698994  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699003  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.698947  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699105  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (8.091285115s)

	I0429 11:59:40.699129  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699138  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.698671  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699241  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.870623142s)

	I0429 11:59:40.699262  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699271  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699308  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.753494366s)

	I0429 11:59:40.699339  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699345  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (7.63056887s)

	I0429 11:59:40.699354  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699382  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699393  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699501  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (6.977157312s)

	I0429 11:59:40.699525  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699536  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699612  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (6.801858864s)

	I0429 11:59:40.699628  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699636  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699737  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.427029606s)

	I0429 11:59:40.699754  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699767  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699780  855239 node_ready.go:35] waiting up to 6m0s for node "addons-943107" to be "Ready" ...

	I0429 11:59:40.699872  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.699892  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.699896  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.699905  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.699924  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699931  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699929  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.699941  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.699941  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.699948  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699950  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.699956  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.699959  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.699897  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.700007  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.700011  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.700018  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.700028  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.700035  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.700038  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.700042  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.700050  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.700056  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.700202  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.700223  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.700247  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.700254  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.700262  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.700269  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.700267  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.700303  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.700310  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.700318  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.700321  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.700325  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.700328  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.700338  855239 addons.go:470] Verifying addon ingress=true in "addons-943107"

	I0429 11:59:40.704098  855239 out.go:177] * Verifying ingress addon...

	I0429 11:59:40.700428  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.700452  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.700580  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.700604  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.701596  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.701625  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.701643  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.701666  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.701685  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.701705  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.701720  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.701739  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.701760  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.701776  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.702448  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.702473  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.699967  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.705477  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.705490  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.705498  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.705531  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.705538  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.705546  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.705575  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.705658  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.705676  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.705685  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.705741  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.705750  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.705757  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.705786  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.707414  855239 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-943107 service yakd-dashboard -n yakd-dashboard

	I0429 11:59:40.706456  855239 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0429 11:59:40.706482  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.706631  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.706635  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.706662  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.706663  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.706667  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.706682  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.706684  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.706684  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.706700  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.706707  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.706728  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.706829  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.706928  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.708534  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.708566  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.708711  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.708726  855239 addons.go:470] Verifying addon metrics-server=true in "addons-943107"

	I0429 11:59:40.708750  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.708781  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.708794  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.708856  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.708897  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.708987  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.709006  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.709032  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.709141  855239 addons.go:470] Verifying addon registry=true in "addons-943107"

	I0429 11:59:40.710842  855239 out.go:177] * Verifying registry addon...

	I0429 11:59:40.709583  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.709600  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.712313  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.713383  855239 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0429 11:59:40.730966  855239 node_ready.go:49] node "addons-943107" has status "Ready":"True"

	I0429 11:59:40.730997  855239 node_ready.go:38] duration metric: took 31.166318ms for node "addons-943107" to be "Ready" ...

	I0429 11:59:40.731012  855239 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 11:59:40.742805  855239 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0429 11:59:40.742834  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:40.743004  855239 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0429 11:59:40.743036  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:40.798460  855239 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-b8j9h" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:40.801585  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.801615  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.801925  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.801932  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.801944  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	W0429 11:59:40.802061  855239 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class local-path as non-default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "local-path": the object has been modified; please apply your changes to the latest version and try again]

	I0429 11:59:40.874856  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:40.874904  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:40.875394  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:40.875418  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:40.875419  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:40.915694  855239 pod_ready.go:92] pod "coredns-7db6d8ff4d-b8j9h" in "kube-system" namespace has status "Ready":"True"

	I0429 11:59:40.915723  855239 pod_ready.go:81] duration metric: took 117.219871ms for pod "coredns-7db6d8ff4d-b8j9h" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:40.915734  855239 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-hz22v" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:40.992366  855239 pod_ready.go:92] pod "coredns-7db6d8ff4d-hz22v" in "kube-system" namespace has status "Ready":"True"

	I0429 11:59:40.992395  855239 pod_ready.go:81] duration metric: took 76.653856ms for pod "coredns-7db6d8ff4d-hz22v" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:40.992407  855239 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.064393  855239 pod_ready.go:92] pod "etcd-addons-943107" in "kube-system" namespace has status "Ready":"True"

	I0429 11:59:41.064422  855239 pod_ready.go:81] duration metric: took 72.008777ms for pod "etcd-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.064433  855239 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.088072  855239 pod_ready.go:92] pod "kube-apiserver-addons-943107" in "kube-system" namespace has status "Ready":"True"

	I0429 11:59:41.088102  855239 pod_ready.go:81] duration metric: took 23.662489ms for pod "kube-apiserver-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.088114  855239 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.118501  855239 pod_ready.go:92] pod "kube-controller-manager-addons-943107" in "kube-system" namespace has status "Ready":"True"

	I0429 11:59:41.118528  855239 pod_ready.go:81] duration metric: took 30.40721ms for pod "kube-controller-manager-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.118543  855239 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-bzr8x" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.229544  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:41.238229  855239 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-943107" context rescaled to 1 replicas

	I0429 11:59:41.277028  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:41.615768  855239 pod_ready.go:92] pod "kube-proxy-bzr8x" in "kube-system" namespace has status "Ready":"True"

	I0429 11:59:41.615795  855239 pod_ready.go:81] duration metric: took 497.246004ms for pod "kube-proxy-bzr8x" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.615806  855239 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.793485  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:41.793716  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:41.908568  855239 pod_ready.go:92] pod "kube-scheduler-addons-943107" in "kube-system" namespace has status "Ready":"True"

	I0429 11:59:41.908597  855239 pod_ready.go:81] duration metric: took 292.784273ms for pod "kube-scheduler-addons-943107" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:41.908609  855239 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace to be "Ready" ...

	I0429 11:59:42.009876  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.728346463s)

	W0429 11:59:42.009966  855239 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0429 11:59:42.010005  855239 retry.go:31] will retry after 159.446812ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0429 11:59:42.170161  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0429 11:59:42.250086  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:42.262335  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:42.732793  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:42.735094  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:43.233114  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:43.243576  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:43.296746  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.858736576s)

	I0429 11:59:43.296756  855239 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.426332458s)

	I0429 11:59:43.296831  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:43.296849  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:43.298159  855239 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0429 11:59:43.297242  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:43.298207  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:43.298220  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:43.297275  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:43.298229  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:43.299543  855239 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0429 11:59:43.300758  855239 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0429 11:59:43.300778  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0429 11:59:43.299968  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:43.300881  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:43.300898  855239 addons.go:470] Verifying addon csi-hostpath-driver=true in "addons-943107"

	I0429 11:59:43.300003  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:43.302226  855239 out.go:177] * Verifying csi-hostpath-driver addon...

	I0429 11:59:43.304851  855239 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0429 11:59:43.339215  855239 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0429 11:59:43.339244  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:43.550966  855239 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0429 11:59:43.550996  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0429 11:59:43.626100  855239 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0429 11:59:43.626140  855239 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0429 11:59:43.711057  855239 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0429 11:59:43.717687  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:43.728178  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:43.814936  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:43.920502  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 11:59:44.214161  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:44.219503  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:44.312708  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:44.713772  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:44.718108  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:44.812082  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:44.969274  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.799046271s)

	I0429 11:59:44.969346  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:44.969360  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:44.969721  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:44.969783  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:44.969801  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:44.969816  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:44.969828  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:44.970114  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:44.970136  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:45.218332  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:45.230580  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:45.314284  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:45.736797  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:45.739130  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:45.815126  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:45.999293  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 11:59:46.013436  855239 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (2.30232563s)

	I0429 11:59:46.013504  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:46.013516  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:46.014020  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:46.014051  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:46.014061  855239 main.go:141] libmachine: Making call to close driver server

	I0429 11:59:46.014070  855239 main.go:141] libmachine: (addons-943107) Calling .Close

	I0429 11:59:46.014380  855239 main.go:141] libmachine: Successfully made call to close driver server

	I0429 11:59:46.014438  855239 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 11:59:46.014393  855239 main.go:141] libmachine: (addons-943107) DBG | Closing plugin on server side

	I0429 11:59:46.016564  855239 addons.go:470] Verifying addon gcp-auth=true in "addons-943107"

	I0429 11:59:46.018727  855239 out.go:177] * Verifying gcp-auth addon...

	I0429 11:59:46.021394  855239 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0429 11:59:46.030318  855239 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0429 11:59:46.030355  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:46.213686  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:46.217866  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:46.312035  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:46.525876  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:46.714735  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:46.718546  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:46.811490  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:47.024996  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:47.215098  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:47.219227  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:47.310870  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:47.525179  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:47.714580  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:47.719068  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:47.811646  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:48.025906  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:48.225623  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:48.230120  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:48.312115  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:48.417438  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 11:59:48.526624  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:48.716917  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:48.724442  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:48.817068  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:49.025887  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:49.214719  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:49.218105  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:49.311556  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:49.525510  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:49.714459  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:49.717955  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:49.811376  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:50.025595  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:50.214439  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:50.217787  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:50.314284  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:50.420036  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 11:59:50.527154  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:50.715745  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:50.719350  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:50.819179  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:51.024855  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:51.214548  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:51.217840  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:51.323370  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:51.525935  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:51.713682  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:51.724994  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:51.812318  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:52.025700  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:52.214495  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:52.221994  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:52.311823  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:52.525359  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:52.713664  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:52.718053  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:52.814348  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:52.917163  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 11:59:53.026228  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:53.215110  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:53.222713  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:53.316412  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:53.525937  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:53.714576  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:53.719637  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:53.811106  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:54.025426  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:54.222987  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:54.223049  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:54.311552  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:54.526363  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:54.713495  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:54.719065  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:54.820102  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:55.026277  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:55.213943  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:55.218780  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:55.311201  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:55.415565  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 11:59:55.526366  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:55.735868  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:55.736166  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:55.811130  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:56.025921  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:56.214517  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:56.218017  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:56.311490  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:56.526562  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:56.713693  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:56.718015  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:56.811515  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:57.025859  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:57.214464  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:57.220730  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:57.311461  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:57.416119  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 11:59:57.525778  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:57.714047  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:57.718880  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:57.812143  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:58.026304  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:58.214776  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:58.219077  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:58.311480  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:58.526298  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:58.713701  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:58.720255  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:58.811685  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:59.025932  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:59.214415  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:59.223318  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:59.310528  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:59.525532  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 11:59:59.713888  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 11:59:59.719729  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 11:59:59.811892  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 11:59:59.915633  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:00.026347  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:00.213741  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:00.218786  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:00.311781  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:00.525998  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:00.713373  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:00.720967  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:00.810993  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:01.026369  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:01.227132  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:01.230112  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:01.312792  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:01.526663  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:01.717342  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:01.721992  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:01.810839  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:02.025239  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:02.213966  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:02.219925  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:02.592596  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:02.598576  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:02.602054  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:02.793827  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:02.796498  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:02.823881  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:03.026376  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:03.216584  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:03.220138  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:03.311354  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:03.525446  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:03.731123  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:03.746652  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:03.810274  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:04.026387  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:04.213543  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:04.217810  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:04.311380  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:04.525666  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:04.713838  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:04.722101  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:04.811465  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:04.914680  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:05.025666  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:05.213475  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:05.217420  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:05.310232  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:05.525901  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:05.714168  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:05.717609  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:05.811850  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:06.475799  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:06.476200  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:06.478137  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:06.478789  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:06.526669  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:06.713869  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:06.717932  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:06.811311  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:06.915528  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:07.025405  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:07.214472  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:07.219074  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:07.314038  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:07.525755  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:07.715542  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:07.719133  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:07.811815  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:08.025638  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:08.213736  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:08.218855  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:08.311768  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:08.525697  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:08.713929  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:08.719441  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:08.813211  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:08.918973  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:09.026038  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:09.213731  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:09.218242  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:09.311414  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:09.526203  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:09.721518  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:09.721606  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:09.816245  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:10.026667  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:10.214576  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:10.218005  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:10.311475  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:10.526546  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:10.714067  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:10.718988  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:10.810442  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:11.026272  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:11.213707  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:11.218536  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:11.311981  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:11.422792  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:11.525544  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:11.713887  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:11.719343  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:11.810899  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:12.026743  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:12.214175  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:12.218787  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:12.313863  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:12.525816  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:12.714217  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:12.718752  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:12.813024  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:13.027002  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:13.214226  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:13.218532  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:13.311523  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:13.525940  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:13.713420  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:13.718020  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:13.811311  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:13.915705  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:14.026283  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:14.214240  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:14.218817  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:14.311190  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:14.526102  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:14.715810  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:14.720111  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:14.811784  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:15.025410  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:15.213619  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:15.218340  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:15.310543  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:15.526184  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:15.713738  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:15.722627  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:15.815769  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:16.025118  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:16.213759  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:16.218013  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:16.315691  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:16.415577  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:16.528949  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:16.714383  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:16.720050  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:16.820682  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:17.025716  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:17.214516  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:17.222148  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0429 12:00:17.312892  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:17.525687  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:17.714178  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:17.718972  855239 kapi.go:107] duration metric: took 37.005589903s to wait for kubernetes.io/minikube-addons=registry ...

	I0429 12:00:17.813146  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:18.026174  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:18.213863  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:18.312332  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:18.525810  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:18.714877  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:18.815680  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:18.921026  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:19.025679  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:19.213860  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:19.314560  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:19.526589  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:19.714456  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:19.812379  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:20.026628  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:20.213619  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:20.311379  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:20.525568  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:20.716932  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:20.818932  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:21.025871  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:21.213740  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:21.310587  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:21.415246  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:21.525565  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:21.714841  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:21.811448  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:22.025960  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:22.214182  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:22.315810  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:22.525702  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:22.713814  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:22.817619  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:23.025844  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:23.213976  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:23.314445  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:23.526689  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:23.713688  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:23.810564  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:23.916068  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:24.026017  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:24.214666  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:24.312768  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:24.525705  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:24.714337  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:24.811210  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:25.025726  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:25.214436  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:25.312782  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:25.525951  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:25.713106  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:25.812070  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:25.920058  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:26.025613  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:26.214180  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:26.311136  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:26.526363  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:26.713758  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:26.811465  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:27.025885  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:27.214715  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:27.311306  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:27.526915  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:27.714081  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:27.815998  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:28.026586  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:28.214059  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:28.312503  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:28.415668  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:28.525403  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:28.714107  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:28.811485  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:29.025780  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:29.213893  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:29.311558  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:29.525438  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:29.714194  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:29.812896  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:30.026180  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:30.213707  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:30.311348  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:30.419174  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:30.526037  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:30.714203  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:30.810965  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:31.027264  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:31.213238  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:31.310712  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:31.526076  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:31.713347  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:31.815282  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:32.025850  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:32.214278  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:32.311764  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:32.421832  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:32.525842  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:32.714630  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:33.264618  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:33.270442  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:33.270502  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:33.311773  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:33.528810  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:33.714617  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:33.810972  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:34.026577  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:34.213737  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:34.311719  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:34.526898  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:34.714205  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:34.811692  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:34.915965  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:35.025630  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:35.213894  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:35.318861  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:35.526352  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:35.713490  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:35.812946  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:36.026275  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:36.213805  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:36.310975  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:36.525401  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:37.097353  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:37.101415  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:37.101955  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:37.102357  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:37.214507  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:37.312418  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:37.525267  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:37.718444  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:37.812425  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:38.025961  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:38.215866  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:38.311121  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:38.525771  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:38.714577  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:38.811714  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:39.025952  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:39.213947  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:39.310614  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:39.418637  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:39.526072  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:39.713294  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:39.811328  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:40.025573  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:40.213617  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:40.311137  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:40.534622  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:40.716132  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:40.830681  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:41.026955  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:41.213584  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:41.315098  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:41.525935  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:41.713712  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:41.827732  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:42.391405  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:42.391961  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:42.398285  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:42.398630  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:42.527406  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:42.715165  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:42.811307  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:43.024779  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:43.214071  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:43.311504  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:43.525389  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:43.714140  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:43.811129  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:44.031330  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:44.216478  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:44.311945  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:44.419095  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:44.526032  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:44.714619  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:44.816389  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:45.027237  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:45.213933  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:45.312747  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:45.528272  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:45.714764  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:45.812132  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:46.025804  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:46.214428  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:46.315913  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:46.424832  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:46.533221  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:46.714245  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:46.815950  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:47.031029  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:47.213464  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:47.311066  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:47.526147  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:47.713232  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:47.813700  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:48.025968  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:48.215161  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:48.318215  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:48.526159  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:48.713929  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:48.811486  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:48.916476  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:49.026013  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:49.212955  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:49.318304  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:49.526482  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:49.717909  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:50.046620  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:50.047001  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:50.213729  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:50.310998  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:50.525342  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:50.714000  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:50.810985  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:51.025398  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:51.213767  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:51.310993  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:51.416830  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:51.525882  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:51.716186  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:51.814583  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:52.026084  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:52.213557  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:52.312592  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:52.525927  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:52.713942  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:52.814684  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:53.026226  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:53.213664  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:53.314741  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:53.424865  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:53.527769  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:53.713952  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:53.811720  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:54.025041  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:54.216250  855239 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0429 12:00:54.311718  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:54.526772  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:54.714432  855239 kapi.go:107] duration metric: took 1m14.007973301s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0429 12:00:54.814160  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:55.027613  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:55.312179  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:55.525455  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:55.810941  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:55.916384  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:56.026087  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:56.314221  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:56.525548  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:56.811906  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:57.025480  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0429 12:00:57.316597  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:57.553402  855239 kapi.go:107] duration metric: took 1m11.532006849s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0429 12:00:57.555177  855239 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-943107 cluster.

	I0429 12:00:57.556663  855239 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0429 12:00:57.558048  855239 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0429 12:00:57.818487  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:57.929452  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:00:58.313616  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:58.812494  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:00:59.312793  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:01:00.114425  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:01:00.126902  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:00.311518  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:01:00.811770  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:01:01.310740  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:01:01.817745  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:01:02.311451  855239 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0429 12:01:02.415516  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:02.811570  855239 kapi.go:107] duration metric: took 1m19.50671548s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0429 12:01:02.814792  855239 out.go:177] * Enabled addons: metrics-server, cloud-spanner, yakd, storage-provisioner, ingress-dns, nvidia-device-plugin, inspektor-gadget, helm-tiller, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I0429 12:01:02.816209  855239 addons.go:505] duration metric: took 1m31.054582473s for enable addons: enabled=[metrics-server cloud-spanner yakd storage-provisioner ingress-dns nvidia-device-plugin inspektor-gadget helm-tiller storage-provisioner-rancher volumesnapshots registry ingress gcp-auth csi-hostpath-driver]

	I0429 12:01:04.416003  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:06.446775  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:08.916148  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:10.916305  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:12.916404  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:15.417559  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:17.915646  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:19.917358  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:22.416241  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:24.418487  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:26.916292  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:29.417363  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:31.918430  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:34.416191  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:36.916107  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:38.916310  855239 pod_ready.go:102] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"False"

	I0429 12:01:39.916492  855239 pod_ready.go:92] pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace has status "Ready":"True"

	I0429 12:01:39.916525  855239 pod_ready.go:81] duration metric: took 1m58.007910168s for pod "metrics-server-c59844bb4-9vzhv" in "kube-system" namespace to be "Ready" ...

	I0429 12:01:39.916537  855239 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-vmp66" in "kube-system" namespace to be "Ready" ...

	I0429 12:01:39.923064  855239 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-vmp66" in "kube-system" namespace has status "Ready":"True"

	I0429 12:01:39.923101  855239 pod_ready.go:81] duration metric: took 6.554172ms for pod "nvidia-device-plugin-daemonset-vmp66" in "kube-system" namespace to be "Ready" ...

	I0429 12:01:39.923127  855239 pod_ready.go:38] duration metric: took 1m59.192090909s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:01:39.923156  855239 api_server.go:52] waiting for apiserver process to appear ...

	I0429 12:01:39.923216  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0429 12:01:39.923308  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0429 12:01:39.975179  855239 cri.go:89] found id: "a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84"

	I0429 12:01:39.975255  855239 cri.go:89] found id: ""

	I0429 12:01:39.975265  855239 logs.go:276] 1 containers: [a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84]

	I0429 12:01:39.975338  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:39.981069  855239 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0429 12:01:39.981161  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0429 12:01:40.026925  855239 cri.go:89] found id: "be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374"

	I0429 12:01:40.026956  855239 cri.go:89] found id: ""

	I0429 12:01:40.026967  855239 logs.go:276] 1 containers: [be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374]

	I0429 12:01:40.027039  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:40.032700  855239 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0429 12:01:40.032805  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0429 12:01:40.085315  855239 cri.go:89] found id: "0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462"

	I0429 12:01:40.085351  855239 cri.go:89] found id: ""

	I0429 12:01:40.085363  855239 logs.go:276] 1 containers: [0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462]

	I0429 12:01:40.085434  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:40.092112  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0429 12:01:40.092213  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0429 12:01:40.136191  855239 cri.go:89] found id: "d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb"

	I0429 12:01:40.136223  855239 cri.go:89] found id: ""

	I0429 12:01:40.136233  855239 logs.go:276] 1 containers: [d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb]

	I0429 12:01:40.136396  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:40.141914  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0429 12:01:40.142010  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0429 12:01:40.185651  855239 cri.go:89] found id: "f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738"

	I0429 12:01:40.185679  855239 cri.go:89] found id: ""

	I0429 12:01:40.185691  855239 logs.go:276] 1 containers: [f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738]

	I0429 12:01:40.185764  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:40.191391  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0429 12:01:40.191498  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0429 12:01:40.233822  855239 cri.go:89] found id: "93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89"

	I0429 12:01:40.233855  855239 cri.go:89] found id: ""

	I0429 12:01:40.233865  855239 logs.go:276] 1 containers: [93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89]

	I0429 12:01:40.233946  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:40.238942  855239 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0429 12:01:40.239035  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0429 12:01:40.282880  855239 cri.go:89] found id: ""

	I0429 12:01:40.282914  855239 logs.go:276] 0 containers: []

	W0429 12:01:40.282923  855239 logs.go:278] No container was found matching "kindnet"

	I0429 12:01:40.282934  855239 logs.go:123] Gathering logs for describe nodes ...

	I0429 12:01:40.282952  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0429 12:01:40.449141  855239 logs.go:123] Gathering logs for kube-scheduler [d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb] ...

	I0429 12:01:40.449201  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb"

	I0429 12:01:40.503282  855239 logs.go:123] Gathering logs for kube-proxy [f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738] ...

	I0429 12:01:40.503345  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738"

	I0429 12:01:40.547751  855239 logs.go:123] Gathering logs for CRI-O ...

	I0429 12:01:40.547801  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I0429 12:01:41.331373  855239 logs.go:123] Gathering logs for container status ...

	I0429 12:01:41.331437  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0429 12:01:41.383494  855239 logs.go:123] Gathering logs for kubelet ...

	I0429 12:01:41.383555  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W0429 12:01:41.439625  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: W0429 11:59:32.154586    1277 reflector.go:547] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.439876  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: E0429 11:59:32.154653    1277 reflector.go:150] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.440040  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: W0429 11:59:32.154701    1277 reflector.go:547] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.440265  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: E0429 11:59:32.154710    1277 reflector.go:150] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.445438  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: W0429 11:59:38.706811    1277 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.445595  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: E0429 11:59:38.706850    1277 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.445732  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: W0429 11:59:38.706881    1277 reflector.go:547] object-"local-path-storage"/"local-path-config": failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.445885  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: E0429 11:59:38.706891    1277 reflector.go:150] object-"local-path-storage"/"local-path-config": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.447555  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:39 addons-943107 kubelet[1277]: W0429 11:59:39.708670    1277 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.447710  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:39 addons-943107 kubelet[1277]: E0429 11:59:39.708708    1277 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.457685  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:45 addons-943107 kubelet[1277]: W0429 11:59:45.969556    1277 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.457852  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:45 addons-943107 kubelet[1277]: E0429 11:59:45.969607    1277 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	I0429 12:01:41.480710  855239 logs.go:123] Gathering logs for kube-apiserver [a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84] ...

	I0429 12:01:41.480757  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84"

	I0429 12:01:41.547001  855239 logs.go:123] Gathering logs for etcd [be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374] ...

	I0429 12:01:41.547055  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374"

	I0429 12:01:41.628587  855239 logs.go:123] Gathering logs for coredns [0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462] ...

	I0429 12:01:41.628638  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462"

	I0429 12:01:41.676073  855239 logs.go:123] Gathering logs for kube-controller-manager [93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89] ...

	I0429 12:01:41.676122  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89"

	I0429 12:01:41.751927  855239 logs.go:123] Gathering logs for dmesg ...

	I0429 12:01:41.751977  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0429 12:01:41.769353  855239 out.go:304] Setting ErrFile to fd 2...

	I0429 12:01:41.769387  855239 out.go:338] TERM=,COLORTERM=, which probably does not support color

	W0429 12:01:41.769461  855239 out.go:239] X Problems detected in kubelet:

	X Problems detected in kubelet:

	W0429 12:01:41.769478  855239 out.go:239]   Apr 29 11:59:38 addons-943107 kubelet[1277]: E0429 11:59:38.706891    1277 reflector.go:150] object-"local-path-storage"/"local-path-config": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	  Apr 29 11:59:38 addons-943107 kubelet[1277]: E0429 11:59:38.706891    1277 reflector.go:150] object-"local-path-storage"/"local-path-config": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.769489  855239 out.go:239]   Apr 29 11:59:39 addons-943107 kubelet[1277]: W0429 11:59:39.708670    1277 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	  Apr 29 11:59:39 addons-943107 kubelet[1277]: W0429 11:59:39.708670    1277 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.769499  855239 out.go:239]   Apr 29 11:59:39 addons-943107 kubelet[1277]: E0429 11:59:39.708708    1277 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	  Apr 29 11:59:39 addons-943107 kubelet[1277]: E0429 11:59:39.708708    1277 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.769509  855239 out.go:239]   Apr 29 11:59:45 addons-943107 kubelet[1277]: W0429 11:59:45.969556    1277 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	  Apr 29 11:59:45 addons-943107 kubelet[1277]: W0429 11:59:45.969556    1277 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	W0429 12:01:41.769517  855239 out.go:239]   Apr 29 11:59:45 addons-943107 kubelet[1277]: E0429 11:59:45.969607    1277 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	  Apr 29 11:59:45 addons-943107 kubelet[1277]: E0429 11:59:45.969607    1277 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	I0429 12:01:41.769524  855239 out.go:304] Setting ErrFile to fd 2...

	I0429 12:01:41.769530  855239 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:01:51.770644  855239 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:01:51.798358  855239 api_server.go:72] duration metric: took 2m20.036747204s to wait for apiserver process to appear ...

	I0429 12:01:51.798404  855239 api_server.go:88] waiting for apiserver healthz status ...

	I0429 12:01:51.798460  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0429 12:01:51.798536  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0429 12:01:51.844328  855239 cri.go:89] found id: "a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84"

	I0429 12:01:51.844357  855239 cri.go:89] found id: ""

	I0429 12:01:51.844366  855239 logs.go:276] 1 containers: [a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84]

	I0429 12:01:51.844428  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:51.849774  855239 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0429 12:01:51.849848  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0429 12:01:51.895651  855239 cri.go:89] found id: "be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374"

	I0429 12:01:51.895677  855239 cri.go:89] found id: ""

	I0429 12:01:51.895685  855239 logs.go:276] 1 containers: [be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374]

	I0429 12:01:51.895752  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:51.900599  855239 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0429 12:01:51.900736  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0429 12:01:51.950969  855239 cri.go:89] found id: "0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462"

	I0429 12:01:51.950995  855239 cri.go:89] found id: ""

	I0429 12:01:51.951003  855239 logs.go:276] 1 containers: [0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462]

	I0429 12:01:51.951081  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:51.955820  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0429 12:01:51.955909  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0429 12:01:52.011824  855239 cri.go:89] found id: "d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb"

	I0429 12:01:52.011865  855239 cri.go:89] found id: ""

	I0429 12:01:52.011877  855239 logs.go:276] 1 containers: [d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb]

	I0429 12:01:52.011957  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:52.017980  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0429 12:01:52.018062  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0429 12:01:52.064922  855239 cri.go:89] found id: "f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738"

	I0429 12:01:52.064965  855239 cri.go:89] found id: ""

	I0429 12:01:52.064978  855239 logs.go:276] 1 containers: [f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738]

	I0429 12:01:52.065041  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:52.069763  855239 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0429 12:01:52.069864  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0429 12:01:52.119573  855239 cri.go:89] found id: "93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89"

	I0429 12:01:52.119601  855239 cri.go:89] found id: ""

	I0429 12:01:52.119609  855239 logs.go:276] 1 containers: [93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89]

	I0429 12:01:52.119680  855239 ssh_runner.go:195] Run: which crictl

	I0429 12:01:52.124150  855239 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0429 12:01:52.124265  855239 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0429 12:01:52.173538  855239 cri.go:89] found id: ""

	I0429 12:01:52.173583  855239 logs.go:276] 0 containers: []

	W0429 12:01:52.173595  855239 logs.go:278] No container was found matching "kindnet"

	I0429 12:01:52.173613  855239 logs.go:123] Gathering logs for kube-proxy [f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738] ...

	I0429 12:01:52.173638  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 f790655986b0d7207dded2789ac945e937a79ab5f5ed611615718775fdbd6738"

	I0429 12:01:52.214136  855239 logs.go:123] Gathering logs for kube-controller-manager [93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89] ...

	I0429 12:01:52.214188  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 93dcac1887248edee29b9ab3f4aa8cd1311f573b5999f0b5c36fd8b758fc1d89"

	I0429 12:01:52.277472  855239 logs.go:123] Gathering logs for container status ...

	I0429 12:01:52.277531  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0429 12:01:52.335810  855239 logs.go:123] Gathering logs for dmesg ...

	I0429 12:01:52.335869  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0429 12:01:52.353059  855239 logs.go:123] Gathering logs for describe nodes ...

	I0429 12:01:52.353101  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0429 12:01:52.488525  855239 logs.go:123] Gathering logs for etcd [be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374] ...

	I0429 12:01:52.488574  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 be825776c1734a1d06a5e8eddefd31a60dda358e4e6f19536cf93c7d4de23374"

	I0429 12:01:52.551526  855239 logs.go:123] Gathering logs for coredns [0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462] ...

	I0429 12:01:52.551581  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 0ed95318fd1c00686d0a44d5e98ec637d67a3bd41eddd81812cdba5389dbf462"

	I0429 12:01:52.601175  855239 logs.go:123] Gathering logs for kubelet ...

	I0429 12:01:52.601237  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	W0429 12:01:52.642404  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: W0429 11:59:32.154586    1277 reflector.go:547] object-"kube-system"/"kube-proxy": failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.642582  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: E0429 11:59:32.154653    1277 reflector.go:150] object-"kube-system"/"kube-proxy": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-proxy" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.642717  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: W0429 11:59:32.154701    1277 reflector.go:547] object-"kube-system"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.642872  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:32 addons-943107 kubelet[1277]: E0429 11:59:32.154710    1277 reflector.go:150] object-"kube-system"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "kube-system": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.648150  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: W0429 11:59:38.706811    1277 reflector.go:547] object-"local-path-storage"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.648321  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: E0429 11:59:38.706850    1277 reflector.go:150] object-"local-path-storage"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.648454  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: W0429 11:59:38.706881    1277 reflector.go:547] object-"local-path-storage"/"local-path-config": failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.648600  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:38 addons-943107 kubelet[1277]: E0429 11:59:38.706891    1277 reflector.go:150] object-"local-path-storage"/"local-path-config": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "local-path-config" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "local-path-storage": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.650166  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:39 addons-943107 kubelet[1277]: W0429 11:59:39.708670    1277 reflector.go:547] object-"yakd-dashboard"/"kube-root-ca.crt": failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.650312  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:39 addons-943107 kubelet[1277]: E0429 11:59:39.708708    1277 reflector.go:150] object-"yakd-dashboard"/"kube-root-ca.crt": Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "kube-root-ca.crt" is forbidden: User "system:node:addons-943107" cannot list resource "configmaps" in API group "" in the namespace "yakd-dashboard": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.659990  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:45 addons-943107 kubelet[1277]: W0429 11:59:45.969556    1277 reflector.go:547] object-"gcp-auth"/"gcp-auth-certs": failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	W0429 12:01:52.660152  855239 logs.go:138] Found kubelet problem: Apr 29 11:59:45 addons-943107 kubelet[1277]: E0429 11:59:45.969607    1277 reflector.go:150] object-"gcp-auth"/"gcp-auth-certs": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets "gcp-auth-certs" is forbidden: User "system:node:addons-943107" cannot list resource "secrets" in API group "" in the namespace "gcp-auth": no relationship found between node 'addons-943107' and this object

	I0429 12:01:52.683521  855239 logs.go:123] Gathering logs for kube-apiserver [a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84] ...

	I0429 12:01:52.683577  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 a9a33c146c7b3d4d87881ea442cc92ca36196613ef570c73306c2ef4f2d9ab84"

	I0429 12:01:52.734489  855239 logs.go:123] Gathering logs for kube-scheduler [d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb] ...

	I0429 12:01:52.734544  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d8e1769048948badc7e0ff1d2495946490e520615ed12ce230664429ff8900fb"

	I0429 12:01:52.786132  855239 logs.go:123] Gathering logs for CRI-O ...

	I0429 12:01:52.786188  855239 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

** /stderr **

addons_test.go:111: out/minikube-linux-amd64 start -p addons-943107 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: signal: killed

--- FAIL: TestAddons/Setup (2400.06s)

=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove

functional_test.go:391: (dbg) Run:  out/minikube-linux-amd64 -p functional-341155 image rm gcr.io/google-containers/addon-resizer:functional-341155 --alsologtostderr

functional_test.go:391: (dbg) Done: out/minikube-linux-amd64 -p functional-341155 image rm gcr.io/google-containers/addon-resizer:functional-341155 --alsologtostderr: (2.325246578s)

functional_test.go:447: (dbg) Run:  out/minikube-linux-amd64 -p functional-341155 image ls

functional_test.go:402: expected "gcr.io/google-containers/addon-resizer:functional-341155" to be removed from minikube but still exists

--- FAIL: TestFunctional/parallel/ImageCommands/ImageRemove (2.79s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 node stop m02 -v=7 --alsologtostderr

E0429 12:52:00.214898  854660 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/functional-341155/client.crt: no such file or directory

E0429 12:52:41.175935  854660 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/functional-341155/client.crt: no such file or directory

ha_test.go:363: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.51710203s)

-- stdout --

	* Stopping node "ha-212075-m02"  ...

-- /stdout --

** stderr ** 

	I0429 12:51:43.771748  874259 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:51:43.772073  874259 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:51:43.772087  874259 out.go:304] Setting ErrFile to fd 2...

	I0429 12:51:43.772094  874259 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:51:43.772359  874259 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:51:43.772709  874259 mustload.go:65] Loading cluster: ha-212075

	I0429 12:51:43.773264  874259 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:51:43.773296  874259 stop.go:39] StopHost: ha-212075-m02

	I0429 12:51:43.773826  874259 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:51:43.773872  874259 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:51:43.790743  874259 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37941

	I0429 12:51:43.791328  874259 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:51:43.792070  874259 main.go:141] libmachine: Using API Version  1

	I0429 12:51:43.792098  874259 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:51:43.792427  874259 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:51:43.795045  874259 out.go:177] * Stopping node "ha-212075-m02"  ...

	I0429 12:51:43.796735  874259 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]

	I0429 12:51:43.796784  874259 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:51:43.797214  874259 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup

	I0429 12:51:43.797262  874259 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:51:43.800786  874259 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:51:43.801273  874259 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:51:43.801330  874259 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:51:43.801499  874259 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:51:43.801763  874259 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:51:43.801940  874259 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:51:43.802098  874259 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:51:43.895701  874259 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/cni /var/lib/minikube/backup

	I0429 12:51:43.950867  874259 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/kubernetes /var/lib/minikube/backup

	I0429 12:51:44.006898  874259 main.go:141] libmachine: Stopping "ha-212075-m02"...

	I0429 12:51:44.006934  874259 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:51:44.008680  874259 main.go:141] libmachine: (ha-212075-m02) Calling .Stop

	I0429 12:51:44.012847  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 0/120

	I0429 12:51:45.014556  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 1/120

	I0429 12:51:46.016273  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 2/120

	I0429 12:51:47.017631  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 3/120

	I0429 12:51:48.019182  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 4/120

	I0429 12:51:49.020566  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 5/120

	I0429 12:51:50.022453  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 6/120

	I0429 12:51:51.024794  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 7/120

	I0429 12:51:52.026110  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 8/120

	I0429 12:51:53.027861  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 9/120

	I0429 12:51:54.030446  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 10/120

	I0429 12:51:55.032492  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 11/120

	I0429 12:51:56.034114  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 12/120

	I0429 12:51:57.036630  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 13/120

	I0429 12:51:58.038318  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 14/120

	I0429 12:51:59.040845  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 15/120

	I0429 12:52:00.042445  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 16/120

	I0429 12:52:01.044046  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 17/120

	I0429 12:52:02.046199  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 18/120

	I0429 12:52:03.047598  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 19/120

	I0429 12:52:04.049658  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 20/120

	I0429 12:52:05.051468  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 21/120

	I0429 12:52:06.052958  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 22/120

	I0429 12:52:07.054421  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 23/120

	I0429 12:52:08.056309  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 24/120

	I0429 12:52:09.058899  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 25/120

	I0429 12:52:10.061126  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 26/120

	I0429 12:52:11.062765  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 27/120

	I0429 12:52:12.064700  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 28/120

	I0429 12:52:13.066363  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 29/120

	I0429 12:52:14.068312  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 30/120

	I0429 12:52:15.070133  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 31/120

	I0429 12:52:16.071626  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 32/120

	I0429 12:52:17.073919  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 33/120

	I0429 12:52:18.075811  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 34/120

	I0429 12:52:19.077831  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 35/120

	I0429 12:52:20.079244  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 36/120

	I0429 12:52:21.080611  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 37/120

	I0429 12:52:22.082093  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 38/120

	I0429 12:52:23.083405  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 39/120

	I0429 12:52:24.085750  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 40/120

	I0429 12:52:25.087245  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 41/120

	I0429 12:52:26.088524  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 42/120

	I0429 12:52:27.090072  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 43/120

	I0429 12:52:28.091677  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 44/120

	I0429 12:52:29.094044  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 45/120

	I0429 12:52:30.095646  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 46/120

	I0429 12:52:31.097297  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 47/120

	I0429 12:52:32.098715  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 48/120

	I0429 12:52:33.100294  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 49/120

	I0429 12:52:34.102541  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 50/120

	I0429 12:52:35.104223  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 51/120

	I0429 12:52:36.105721  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 52/120

	I0429 12:52:37.107375  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 53/120

	I0429 12:52:38.108794  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 54/120

	I0429 12:52:39.110929  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 55/120

	I0429 12:52:40.112500  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 56/120

	I0429 12:52:41.114439  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 57/120

	I0429 12:52:42.116178  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 58/120

	I0429 12:52:43.117467  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 59/120

	I0429 12:52:44.119213  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 60/120

	I0429 12:52:45.120729  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 61/120

	I0429 12:52:46.122908  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 62/120

	I0429 12:52:47.124390  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 63/120

	I0429 12:52:48.125844  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 64/120

	I0429 12:52:49.127949  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 65/120

	I0429 12:52:50.129479  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 66/120

	I0429 12:52:51.130959  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 67/120

	I0429 12:52:52.132623  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 68/120

	I0429 12:52:53.134623  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 69/120

	I0429 12:52:54.137030  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 70/120

	I0429 12:52:55.138261  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 71/120

	I0429 12:52:56.139862  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 72/120

	I0429 12:52:57.142301  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 73/120

	I0429 12:52:58.143753  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 74/120

	I0429 12:52:59.145567  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 75/120

	I0429 12:53:00.146990  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 76/120

	I0429 12:53:01.148479  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 77/120

	I0429 12:53:02.151025  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 78/120

	I0429 12:53:03.152850  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 79/120

	I0429 12:53:04.155071  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 80/120

	I0429 12:53:05.156601  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 81/120

	I0429 12:53:06.158369  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 82/120

	I0429 12:53:07.160074  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 83/120

	I0429 12:53:08.162084  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 84/120

	I0429 12:53:09.164036  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 85/120

	I0429 12:53:10.166559  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 86/120

	I0429 12:53:11.168342  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 87/120

	I0429 12:53:12.169998  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 88/120

	I0429 12:53:13.171464  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 89/120

	I0429 12:53:14.173491  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 90/120

	I0429 12:53:15.174968  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 91/120

	I0429 12:53:16.176705  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 92/120

	I0429 12:53:17.178565  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 93/120

	I0429 12:53:18.180110  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 94/120

	I0429 12:53:19.182006  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 95/120

	I0429 12:53:20.183787  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 96/120

	I0429 12:53:21.186076  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 97/120

	I0429 12:53:22.188260  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 98/120

	I0429 12:53:23.189719  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 99/120

	I0429 12:53:24.192321  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 100/120

	I0429 12:53:25.193860  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 101/120

	I0429 12:53:26.195341  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 102/120

	I0429 12:53:27.196759  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 103/120

	I0429 12:53:28.198402  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 104/120

	I0429 12:53:29.199811  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 105/120

	I0429 12:53:30.201944  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 106/120

	I0429 12:53:31.203660  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 107/120

	I0429 12:53:32.205911  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 108/120

	I0429 12:53:33.207406  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 109/120

	I0429 12:53:34.209702  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 110/120

	I0429 12:53:35.211206  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 111/120

	I0429 12:53:36.213121  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 112/120

	I0429 12:53:37.215147  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 113/120

	I0429 12:53:38.216790  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 114/120

	I0429 12:53:39.218790  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 115/120

	I0429 12:53:40.220335  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 116/120

	I0429 12:53:41.221818  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 117/120

	I0429 12:53:42.223909  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 118/120

	I0429 12:53:43.226184  874259 main.go:141] libmachine: (ha-212075-m02) Waiting for machine to stop 119/120

	I0429 12:53:44.227133  874259 stop.go:66] stop err: unable to stop vm, current state "Running"

	W0429 12:53:44.227330  874259 out.go:239] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

	X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

** /stderr **

ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-212075 node stop m02 -v=7 --alsologtostderr": exit status 30

ha_test.go:369: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

E0429 12:54:03.096495  854660 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/functional-341155/client.crt: no such file or directory

ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 3 (19.314369201s)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:53:44.293919  874686 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:53:44.294085  874686 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:53:44.294095  874686 out.go:304] Setting ErrFile to fd 2...

	I0429 12:53:44.294102  874686 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:53:44.294330  874686 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:53:44.294625  874686 out.go:298] Setting JSON to false

	I0429 12:53:44.294676  874686 mustload.go:65] Loading cluster: ha-212075

	I0429 12:53:44.294788  874686 notify.go:220] Checking for updates...

	I0429 12:53:44.295219  874686 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:53:44.295245  874686 status.go:255] checking status of ha-212075 ...

	I0429 12:53:44.295830  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:53:44.295917  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:53:44.313734  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40661

	I0429 12:53:44.314406  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:53:44.315144  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:53:44.315177  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:53:44.315848  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:53:44.316134  874686 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:53:44.318141  874686 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:53:44.318170  874686 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:53:44.318640  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:53:44.318707  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:53:44.336279  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45321

	I0429 12:53:44.336751  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:53:44.337261  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:53:44.337285  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:53:44.337662  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:53:44.337956  874686 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:53:44.341460  874686 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:53:44.341955  874686 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:53:44.342010  874686 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:53:44.342202  874686 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:53:44.342547  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:53:44.342604  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:53:44.359428  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42727

	I0429 12:53:44.359920  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:53:44.360566  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:53:44.360595  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:53:44.360976  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:53:44.361184  874686 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:53:44.361413  874686 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:53:44.361462  874686 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:53:44.364614  874686 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:53:44.365083  874686 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:53:44.365115  874686 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:53:44.365320  874686 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:53:44.365560  874686 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:53:44.365733  874686 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:53:44.365876  874686 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:53:44.457453  874686 ssh_runner.go:195] Run: systemctl --version

	I0429 12:53:44.465590  874686 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:53:44.486752  874686 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:53:44.486790  874686 api_server.go:166] Checking apiserver status ...

	I0429 12:53:44.486828  874686 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:53:44.506280  874686 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:53:44.517369  874686 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:53:44.517443  874686 ssh_runner.go:195] Run: ls

	I0429 12:53:44.522619  874686 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:53:44.527414  874686 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:53:44.527451  874686 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:53:44.527463  874686 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:53:44.527485  874686 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:53:44.527934  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:53:44.527997  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:53:44.543955  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42435

	I0429 12:53:44.544582  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:53:44.545113  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:53:44.545141  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:53:44.545536  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:53:44.545747  874686 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:53:44.547449  874686 status.go:330] ha-212075-m02 host status = "Running" (err=<nil>)

	I0429 12:53:44.547471  874686 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:53:44.547791  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:53:44.547817  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:53:44.563436  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38457

	I0429 12:53:44.563953  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:53:44.564461  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:53:44.564489  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:53:44.564848  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:53:44.565062  874686 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:53:44.568092  874686 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:53:44.568538  874686 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:53:44.568576  874686 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:53:44.568781  874686 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:53:44.569111  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:53:44.569156  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:53:44.585024  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44219

	I0429 12:53:44.585545  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:53:44.586065  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:53:44.586090  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:53:44.586439  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:53:44.586620  874686 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:53:44.586830  874686 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:53:44.586853  874686 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:53:44.589978  874686 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:53:44.590432  874686 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:53:44.590460  874686 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:53:44.590661  874686 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:53:44.590881  874686 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:53:44.591082  874686 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:53:44.591234  874686 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	W0429 12:54:03.151638  874686 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:03.151758  874686 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	E0429 12:54:03.151773  874686 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:03.151784  874686 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 12:54:03.151811  874686 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:03.151818  874686 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:03.152250  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:03.152304  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:03.169267  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33065

	I0429 12:54:03.169857  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:03.170540  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:54:03.170575  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:03.171034  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:03.171321  874686 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:03.173274  874686 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:03.173301  874686 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:03.173756  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:03.173820  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:03.190705  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38691

	I0429 12:54:03.191267  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:03.191927  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:54:03.191960  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:03.192423  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:03.192692  874686 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:03.196102  874686 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:03.196581  874686 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:03.196612  874686 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:03.196844  874686 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:03.197397  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:03.197458  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:03.213920  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41281

	I0429 12:54:03.214458  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:03.214993  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:54:03.215018  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:03.215398  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:03.215613  874686 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:03.215838  874686 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:03.215862  874686 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:03.218444  874686 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:03.218860  874686 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:03.218884  874686 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:03.219083  874686 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:03.219286  874686 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:03.219449  874686 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:03.219614  874686 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:03.309972  874686 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:03.333716  874686 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:03.333753  874686 api_server.go:166] Checking apiserver status ...

	I0429 12:54:03.333788  874686 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:03.350378  874686 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:03.361043  874686 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:03.361111  874686 ssh_runner.go:195] Run: ls

	I0429 12:54:03.366524  874686 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:03.371528  874686 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:03.371568  874686 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:03.371582  874686 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:03.371611  874686 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:03.372029  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:03.372076  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:03.388569  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36681

	I0429 12:54:03.389061  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:03.389568  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:54:03.389595  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:03.390131  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:03.390368  874686 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:03.392081  874686 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:03.392104  874686 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:03.392395  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:03.392428  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:03.408758  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39281

	I0429 12:54:03.409299  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:03.409902  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:54:03.409935  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:03.410293  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:03.410468  874686 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:03.413719  874686 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:03.414250  874686 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:03.414275  874686 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:03.414500  874686 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:03.414811  874686 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:03.414855  874686 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:03.431986  874686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44817

	I0429 12:54:03.432546  874686 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:03.433130  874686 main.go:141] libmachine: Using API Version  1

	I0429 12:54:03.433159  874686 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:03.433549  874686 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:03.433761  874686 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:03.433956  874686 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:03.433974  874686 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:03.436938  874686 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:03.437438  874686 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:03.437474  874686 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:03.437585  874686 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:03.437801  874686 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:03.437968  874686 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:03.438144  874686 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:03.521905  874686 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:03.540860  874686 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:372: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr" : exit status 3

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-212075 -n ha-212075

helpers_test.go:244: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-212075 logs -n 25: (1.624334641s)

helpers_test.go:252: TestMultiControlPlane/serial/StopSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-212075 cp ha-212075-m03:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1860612890/001/cp-test_ha-212075-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m03:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075:/home/docker/cp-test_ha-212075-m03_ha-212075.txt                       |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075 sudo cat                                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m03_ha-212075.txt                                 |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m03:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m02:/home/docker/cp-test_ha-212075-m03_ha-212075-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m02 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m03_ha-212075-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m03:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04:/home/docker/cp-test_ha-212075-m03_ha-212075-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m04 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m03_ha-212075-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-212075 cp testdata/cp-test.txt                                                | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1860612890/001/cp-test_ha-212075-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075:/home/docker/cp-test_ha-212075-m04_ha-212075.txt                       |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075 sudo cat                                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m04_ha-212075.txt                                 |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m02:/home/docker/cp-test_ha-212075-m04_ha-212075-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m02 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m04_ha-212075-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03:/home/docker/cp-test_ha-212075-m04_ha-212075-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m03 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m04_ha-212075-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-212075 node stop m02 -v=7                                                     | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/04/29 12:47:10

	Running on machine: ubuntu-20-agent-12

	Binary: Built with gc go1.22.1 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0429 12:47:10.677919  870218 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:47:10.678233  870218 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:47:10.678243  870218 out.go:304] Setting ErrFile to fd 2...

	I0429 12:47:10.678248  870218 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:47:10.678446  870218 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:47:10.679112  870218 out.go:298] Setting JSON to false

	I0429 12:47:10.680123  870218 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-12","uptime":77376,"bootTime":1714317455,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0429 12:47:10.680195  870218 start.go:139] virtualization: kvm guest

	I0429 12:47:10.682364  870218 out.go:177] * [ha-212075] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	I0429 12:47:10.683575  870218 out.go:177]   - MINIKUBE_LOCATION=18773

	I0429 12:47:10.683620  870218 notify.go:220] Checking for updates...

	I0429 12:47:10.684719  870218 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0429 12:47:10.686075  870218 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:47:10.687233  870218 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:47:10.688452  870218 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0429 12:47:10.689537  870218 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0429 12:47:10.690735  870218 driver.go:392] Setting default libvirt URI to qemu:///system

	I0429 12:47:10.726918  870218 out.go:177] * Using the kvm2 driver based on user configuration

	I0429 12:47:10.728083  870218 start.go:297] selected driver: kvm2

	I0429 12:47:10.728096  870218 start.go:901] validating driver "kvm2" against <nil>

	I0429 12:47:10.728109  870218 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0429 12:47:10.728816  870218 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0429 12:47:10.728911  870218 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18773-847310/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0429 12:47:10.744767  870218 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0

	I0429 12:47:10.744835  870218 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0429 12:47:10.745104  870218 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 12:47:10.745163  870218 cni.go:84] Creating CNI manager for ""

	I0429 12:47:10.745175  870218 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0429 12:47:10.745180  870218 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0429 12:47:10.745248  870218 start.go:340] cluster config:

	{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0429 12:47:10.745350  870218 iso.go:125] acquiring lock: {Name:mk86e9cd005d09998272ae59568d4d340a1c61b2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0429 12:47:10.747127  870218 out.go:177] * Starting "ha-212075" primary control-plane node in "ha-212075" cluster

	I0429 12:47:10.748332  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:47:10.748369  870218 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4

	I0429 12:47:10.748377  870218 cache.go:56] Caching tarball of preloaded images

	I0429 12:47:10.748457  870218 preload.go:173] Found /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0429 12:47:10.748467  870218 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0429 12:47:10.748770  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:47:10.748791  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json: {Name:mkcbad01c1c0b2ec15b4df8b0dfb07d2b34331f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:10.749013  870218 start.go:360] acquireMachinesLock for ha-212075: {Name:mk2ade588bdb49db467a1dc12f643b97a2b1f5bb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0429 12:47:10.749049  870218 start.go:364] duration metric: took 18.822µs to acquireMachinesLock for "ha-212075"

	I0429 12:47:10.749068  870218 start.go:93] Provisioning new machine with config: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:47:10.749132  870218 start.go:125] createHost starting for "" (driver="kvm2")

	I0429 12:47:10.750711  870218 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0429 12:47:10.750854  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:47:10.750892  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:47:10.766284  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42587

	I0429 12:47:10.766814  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:47:10.767483  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:47:10.767507  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:47:10.767857  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:47:10.768171  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:10.768384  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:10.768534  870218 start.go:159] libmachine.API.Create for "ha-212075" (driver="kvm2")

	I0429 12:47:10.768583  870218 client.go:168] LocalClient.Create starting

	I0429 12:47:10.768617  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem

	I0429 12:47:10.768656  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:47:10.768671  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:47:10.768720  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem

	I0429 12:47:10.768743  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:47:10.768756  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:47:10.768775  870218 main.go:141] libmachine: Running pre-create checks...

	I0429 12:47:10.768787  870218 main.go:141] libmachine: (ha-212075) Calling .PreCreateCheck

	I0429 12:47:10.769168  870218 main.go:141] libmachine: (ha-212075) Calling .GetConfigRaw

	I0429 12:47:10.769571  870218 main.go:141] libmachine: Creating machine...

	I0429 12:47:10.769586  870218 main.go:141] libmachine: (ha-212075) Calling .Create

	I0429 12:47:10.769732  870218 main.go:141] libmachine: (ha-212075) Creating KVM machine...

	I0429 12:47:10.771123  870218 main.go:141] libmachine: (ha-212075) DBG | found existing default KVM network

	I0429 12:47:10.771904  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:10.771751  870241 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1f0}

	I0429 12:47:10.771972  870218 main.go:141] libmachine: (ha-212075) DBG | created network xml: 

	I0429 12:47:10.771992  870218 main.go:141] libmachine: (ha-212075) DBG | <network>

	I0429 12:47:10.772001  870218 main.go:141] libmachine: (ha-212075) DBG |   <name>mk-ha-212075</name>

	I0429 12:47:10.772006  870218 main.go:141] libmachine: (ha-212075) DBG |   <dns enable='no'/>

	I0429 12:47:10.772013  870218 main.go:141] libmachine: (ha-212075) DBG |   

	I0429 12:47:10.772019  870218 main.go:141] libmachine: (ha-212075) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0429 12:47:10.772027  870218 main.go:141] libmachine: (ha-212075) DBG |     <dhcp>

	I0429 12:47:10.772033  870218 main.go:141] libmachine: (ha-212075) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0429 12:47:10.772045  870218 main.go:141] libmachine: (ha-212075) DBG |     </dhcp>

	I0429 12:47:10.772053  870218 main.go:141] libmachine: (ha-212075) DBG |   </ip>

	I0429 12:47:10.772063  870218 main.go:141] libmachine: (ha-212075) DBG |   

	I0429 12:47:10.772068  870218 main.go:141] libmachine: (ha-212075) DBG | </network>

	I0429 12:47:10.772075  870218 main.go:141] libmachine: (ha-212075) DBG | 

	I0429 12:47:10.777807  870218 main.go:141] libmachine: (ha-212075) DBG | trying to create private KVM network mk-ha-212075 192.168.39.0/24...

	I0429 12:47:10.853260  870218 main.go:141] libmachine: (ha-212075) DBG | private KVM network mk-ha-212075 192.168.39.0/24 created

	I0429 12:47:10.853342  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:10.853194  870241 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:47:10.853364  870218 main.go:141] libmachine: (ha-212075) Setting up store path in /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075 ...

	I0429 12:47:10.853387  870218 main.go:141] libmachine: (ha-212075) Building disk image from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0429 12:47:10.853475  870218 main.go:141] libmachine: (ha-212075) Downloading /home/jenkins/minikube-integration/18773-847310/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0429 12:47:11.125251  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:11.125115  870241 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa...

	I0429 12:47:11.350613  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:11.350414  870241 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/ha-212075.rawdisk...

	I0429 12:47:11.350656  870218 main.go:141] libmachine: (ha-212075) DBG | Writing magic tar header

	I0429 12:47:11.350671  870218 main.go:141] libmachine: (ha-212075) DBG | Writing SSH key tar header

	I0429 12:47:11.350683  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:11.350536  870241 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075 ...

	I0429 12:47:11.350697  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075

	I0429 12:47:11.350709  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines

	I0429 12:47:11.350722  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075 (perms=drwx------)

	I0429 12:47:11.350739  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines (perms=drwxr-xr-x)

	I0429 12:47:11.350747  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:47:11.350754  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube (perms=drwxr-xr-x)

	I0429 12:47:11.350764  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310 (perms=drwxrwxr-x)

	I0429 12:47:11.350775  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0429 12:47:11.350787  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0429 12:47:11.350799  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310

	I0429 12:47:11.350806  870218 main.go:141] libmachine: (ha-212075) Creating domain...

	I0429 12:47:11.350818  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0429 12:47:11.350832  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins

	I0429 12:47:11.350922  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home

	I0429 12:47:11.350949  870218 main.go:141] libmachine: (ha-212075) DBG | Skipping /home - not owner

	I0429 12:47:11.352182  870218 main.go:141] libmachine: (ha-212075) define libvirt domain using xml: 

	I0429 12:47:11.352232  870218 main.go:141] libmachine: (ha-212075) <domain type='kvm'>

	I0429 12:47:11.352268  870218 main.go:141] libmachine: (ha-212075)   <name>ha-212075</name>

	I0429 12:47:11.352294  870218 main.go:141] libmachine: (ha-212075)   <memory unit='MiB'>2200</memory>

	I0429 12:47:11.352305  870218 main.go:141] libmachine: (ha-212075)   <vcpu>2</vcpu>

	I0429 12:47:11.352316  870218 main.go:141] libmachine: (ha-212075)   <features>

	I0429 12:47:11.352326  870218 main.go:141] libmachine: (ha-212075)     <acpi/>

	I0429 12:47:11.352337  870218 main.go:141] libmachine: (ha-212075)     <apic/>

	I0429 12:47:11.352346  870218 main.go:141] libmachine: (ha-212075)     <pae/>

	I0429 12:47:11.352372  870218 main.go:141] libmachine: (ha-212075)     

	I0429 12:47:11.352384  870218 main.go:141] libmachine: (ha-212075)   </features>

	I0429 12:47:11.352396  870218 main.go:141] libmachine: (ha-212075)   <cpu mode='host-passthrough'>

	I0429 12:47:11.352405  870218 main.go:141] libmachine: (ha-212075)   

	I0429 12:47:11.352415  870218 main.go:141] libmachine: (ha-212075)   </cpu>

	I0429 12:47:11.352424  870218 main.go:141] libmachine: (ha-212075)   <os>

	I0429 12:47:11.352435  870218 main.go:141] libmachine: (ha-212075)     <type>hvm</type>

	I0429 12:47:11.352446  870218 main.go:141] libmachine: (ha-212075)     <boot dev='cdrom'/>

	I0429 12:47:11.352456  870218 main.go:141] libmachine: (ha-212075)     <boot dev='hd'/>

	I0429 12:47:11.352472  870218 main.go:141] libmachine: (ha-212075)     <bootmenu enable='no'/>

	I0429 12:47:11.352482  870218 main.go:141] libmachine: (ha-212075)   </os>

	I0429 12:47:11.352492  870218 main.go:141] libmachine: (ha-212075)   <devices>

	I0429 12:47:11.352506  870218 main.go:141] libmachine: (ha-212075)     <disk type='file' device='cdrom'>

	I0429 12:47:11.352528  870218 main.go:141] libmachine: (ha-212075)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/boot2docker.iso'/>

	I0429 12:47:11.352546  870218 main.go:141] libmachine: (ha-212075)       <target dev='hdc' bus='scsi'/>

	I0429 12:47:11.352558  870218 main.go:141] libmachine: (ha-212075)       <readonly/>

	I0429 12:47:11.352571  870218 main.go:141] libmachine: (ha-212075)     </disk>

	I0429 12:47:11.352580  870218 main.go:141] libmachine: (ha-212075)     <disk type='file' device='disk'>

	I0429 12:47:11.352595  870218 main.go:141] libmachine: (ha-212075)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0429 12:47:11.352614  870218 main.go:141] libmachine: (ha-212075)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/ha-212075.rawdisk'/>

	I0429 12:47:11.352628  870218 main.go:141] libmachine: (ha-212075)       <target dev='hda' bus='virtio'/>

	I0429 12:47:11.352643  870218 main.go:141] libmachine: (ha-212075)     </disk>

	I0429 12:47:11.352660  870218 main.go:141] libmachine: (ha-212075)     <interface type='network'>

	I0429 12:47:11.352671  870218 main.go:141] libmachine: (ha-212075)       <source network='mk-ha-212075'/>

	I0429 12:47:11.352679  870218 main.go:141] libmachine: (ha-212075)       <model type='virtio'/>

	I0429 12:47:11.352691  870218 main.go:141] libmachine: (ha-212075)     </interface>

	I0429 12:47:11.352704  870218 main.go:141] libmachine: (ha-212075)     <interface type='network'>

	I0429 12:47:11.352714  870218 main.go:141] libmachine: (ha-212075)       <source network='default'/>

	I0429 12:47:11.352726  870218 main.go:141] libmachine: (ha-212075)       <model type='virtio'/>

	I0429 12:47:11.352736  870218 main.go:141] libmachine: (ha-212075)     </interface>

	I0429 12:47:11.352747  870218 main.go:141] libmachine: (ha-212075)     <serial type='pty'>

	I0429 12:47:11.352760  870218 main.go:141] libmachine: (ha-212075)       <target port='0'/>

	I0429 12:47:11.352770  870218 main.go:141] libmachine: (ha-212075)     </serial>

	I0429 12:47:11.352783  870218 main.go:141] libmachine: (ha-212075)     <console type='pty'>

	I0429 12:47:11.352796  870218 main.go:141] libmachine: (ha-212075)       <target type='serial' port='0'/>

	I0429 12:47:11.352807  870218 main.go:141] libmachine: (ha-212075)     </console>

	I0429 12:47:11.352818  870218 main.go:141] libmachine: (ha-212075)     <rng model='virtio'>

	I0429 12:47:11.352833  870218 main.go:141] libmachine: (ha-212075)       <backend model='random'>/dev/random</backend>

	I0429 12:47:11.352844  870218 main.go:141] libmachine: (ha-212075)     </rng>

	I0429 12:47:11.352851  870218 main.go:141] libmachine: (ha-212075)     

	I0429 12:47:11.352858  870218 main.go:141] libmachine: (ha-212075)     

	I0429 12:47:11.352867  870218 main.go:141] libmachine: (ha-212075)   </devices>

	I0429 12:47:11.352879  870218 main.go:141] libmachine: (ha-212075) </domain>

	I0429 12:47:11.352888  870218 main.go:141] libmachine: (ha-212075) 

	I0429 12:47:11.358129  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:b9:e2:15 in network default

	I0429 12:47:11.358761  870218 main.go:141] libmachine: (ha-212075) Ensuring networks are active...

	I0429 12:47:11.358785  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:11.359625  870218 main.go:141] libmachine: (ha-212075) Ensuring network default is active

	I0429 12:47:11.359939  870218 main.go:141] libmachine: (ha-212075) Ensuring network mk-ha-212075 is active

	I0429 12:47:11.360450  870218 main.go:141] libmachine: (ha-212075) Getting domain xml...

	I0429 12:47:11.361219  870218 main.go:141] libmachine: (ha-212075) Creating domain...

	I0429 12:47:12.584589  870218 main.go:141] libmachine: (ha-212075) Waiting to get IP...

	I0429 12:47:12.585394  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:12.585797  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:12.585868  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:12.585792  870241 retry.go:31] will retry after 305.881234ms: waiting for machine to come up

	I0429 12:47:12.893551  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:12.894049  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:12.894079  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:12.894024  870241 retry.go:31] will retry after 344.55293ms: waiting for machine to come up

	I0429 12:47:13.241013  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:13.241469  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:13.241496  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:13.241434  870241 retry.go:31] will retry after 343.048472ms: waiting for machine to come up

	I0429 12:47:13.586141  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:13.586605  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:13.586654  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:13.586558  870241 retry.go:31] will retry after 450.225843ms: waiting for machine to come up

	I0429 12:47:14.038240  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:14.038757  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:14.038783  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:14.038699  870241 retry.go:31] will retry after 523.602131ms: waiting for machine to come up

	I0429 12:47:14.563556  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:14.564014  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:14.564045  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:14.563929  870241 retry.go:31] will retry after 805.259699ms: waiting for machine to come up

	I0429 12:47:15.371056  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:15.371475  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:15.371526  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:15.371456  870241 retry.go:31] will retry after 966.64669ms: waiting for machine to come up

	I0429 12:47:16.339433  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:16.339834  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:16.339867  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:16.339785  870241 retry.go:31] will retry after 1.23057243s: waiting for machine to come up

	I0429 12:47:17.572420  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:17.572903  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:17.572937  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:17.572841  870241 retry.go:31] will retry after 1.383346304s: waiting for machine to come up

	I0429 12:47:18.958480  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:18.958907  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:18.958936  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:18.958868  870241 retry.go:31] will retry after 1.674064931s: waiting for machine to come up

	I0429 12:47:20.634352  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:20.634768  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:20.634806  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:20.634700  870241 retry.go:31] will retry after 2.486061293s: waiting for machine to come up

	I0429 12:47:23.122390  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:23.122875  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:23.122898  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:23.122835  870241 retry.go:31] will retry after 2.897978896s: waiting for machine to come up

	I0429 12:47:26.022310  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:26.022740  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:26.022767  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:26.022711  870241 retry.go:31] will retry after 2.882393702s: waiting for machine to come up

	I0429 12:47:28.908794  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:28.909215  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:28.909242  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:28.909174  870241 retry.go:31] will retry after 5.119530721s: waiting for machine to come up

	I0429 12:47:34.030038  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.030480  870218 main.go:141] libmachine: (ha-212075) Found IP for machine: 192.168.39.97

	I0429 12:47:34.030515  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has current primary IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.030535  870218 main.go:141] libmachine: (ha-212075) Reserving static IP address...

	I0429 12:47:34.030917  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find host DHCP lease matching {name: "ha-212075", mac: "52:54:00:c0:56:df", ip: "192.168.39.97"} in network mk-ha-212075

	I0429 12:47:34.119852  870218 main.go:141] libmachine: (ha-212075) DBG | Getting to WaitForSSH function...

	I0429 12:47:34.119883  870218 main.go:141] libmachine: (ha-212075) Reserved static IP address: 192.168.39.97

	I0429 12:47:34.119897  870218 main.go:141] libmachine: (ha-212075) Waiting for SSH to be available...

	I0429 12:47:34.122597  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.123056  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.123087  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.123278  870218 main.go:141] libmachine: (ha-212075) DBG | Using SSH client type: external

	I0429 12:47:34.123304  870218 main.go:141] libmachine: (ha-212075) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa (-rw-------)

	I0429 12:47:34.123350  870218 main.go:141] libmachine: (ha-212075) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.97 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 12:47:34.123423  870218 main.go:141] libmachine: (ha-212075) DBG | About to run SSH command:

	I0429 12:47:34.123437  870218 main.go:141] libmachine: (ha-212075) DBG | exit 0

	I0429 12:47:34.255439  870218 main.go:141] libmachine: (ha-212075) DBG | SSH cmd err, output: <nil>: 

	I0429 12:47:34.255688  870218 main.go:141] libmachine: (ha-212075) KVM machine creation complete!

	I0429 12:47:34.256038  870218 main.go:141] libmachine: (ha-212075) Calling .GetConfigRaw

	I0429 12:47:34.256561  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:34.256768  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:34.256961  870218 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0429 12:47:34.256974  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:47:34.258344  870218 main.go:141] libmachine: Detecting operating system of created instance...

	I0429 12:47:34.258360  870218 main.go:141] libmachine: Waiting for SSH to be available...

	I0429 12:47:34.258367  870218 main.go:141] libmachine: Getting to WaitForSSH function...

	I0429 12:47:34.258376  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.260892  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.261301  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.261335  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.261457  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.261727  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.261875  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.261974  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.262143  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.262365  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.262379  870218 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0429 12:47:34.375070  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:47:34.375104  870218 main.go:141] libmachine: Detecting the provisioner...

	I0429 12:47:34.375116  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.377839  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.378225  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.378270  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.378421  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.378603  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.378801  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.378939  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.379246  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.379463  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.379477  870218 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0429 12:47:34.496702  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0429 12:47:34.496834  870218 main.go:141] libmachine: found compatible host: buildroot

	I0429 12:47:34.496850  870218 main.go:141] libmachine: Provisioning with buildroot...

	I0429 12:47:34.496862  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:34.497129  870218 buildroot.go:166] provisioning hostname "ha-212075"

	I0429 12:47:34.497157  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:34.497396  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.500100  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.500522  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.500549  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.500743  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.500984  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.501170  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.501329  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.501491  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.501694  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.501709  870218 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-212075 && echo "ha-212075" | sudo tee /etc/hostname

	I0429 12:47:34.639970  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-212075

	I0429 12:47:34.640000  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.643277  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.643700  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.643736  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.643969  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.644183  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.644395  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.644531  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.644725  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.644909  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.644929  870218 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-212075' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-212075/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-212075' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0429 12:47:34.769813  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:47:34.769862  870218 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18773-847310/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-847310/.minikube}

	I0429 12:47:34.769887  870218 buildroot.go:174] setting up certificates

	I0429 12:47:34.769902  870218 provision.go:84] configureAuth start

	I0429 12:47:34.769920  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:34.770254  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:34.773213  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.773664  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.773697  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.773877  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.776462  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.776823  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.776853  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.777023  870218 provision.go:143] copyHostCerts

	I0429 12:47:34.777061  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:47:34.777107  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem, removing ...

	I0429 12:47:34.777120  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:47:34.777220  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem (1078 bytes)

	I0429 12:47:34.777336  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:47:34.777363  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem, removing ...

	I0429 12:47:34.777371  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:47:34.777417  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem (1123 bytes)

	I0429 12:47:34.777495  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:47:34.777518  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem, removing ...

	I0429 12:47:34.777525  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:47:34.777561  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem (1679 bytes)

	I0429 12:47:34.777648  870218 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem org=jenkins.ha-212075 san=[127.0.0.1 192.168.39.97 ha-212075 localhost minikube]

	I0429 12:47:34.986246  870218 provision.go:177] copyRemoteCerts

	I0429 12:47:34.986315  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0429 12:47:34.986343  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.989211  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.989554  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.989587  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.989780  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.990033  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.990225  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.990326  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.077898  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0429 12:47:35.078002  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0429 12:47:35.103811  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0429 12:47:35.103903  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)

	I0429 12:47:35.130521  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0429 12:47:35.130625  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0429 12:47:35.158296  870218 provision.go:87] duration metric: took 388.331009ms to configureAuth

	I0429 12:47:35.158348  870218 buildroot.go:189] setting minikube options for container-runtime

	I0429 12:47:35.158647  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:47:35.158755  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.162096  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.162516  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.162550  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.162789  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.163036  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.163228  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.163376  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.163547  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:35.163779  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:35.163806  870218 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0429 12:47:35.454761  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0429 12:47:35.454801  870218 main.go:141] libmachine: Checking connection to Docker...

	I0429 12:47:35.454812  870218 main.go:141] libmachine: (ha-212075) Calling .GetURL

	I0429 12:47:35.456291  870218 main.go:141] libmachine: (ha-212075) DBG | Using libvirt version 6000000

	I0429 12:47:35.459567  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.459976  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.460009  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.460156  870218 main.go:141] libmachine: Docker is up and running!

	I0429 12:47:35.460174  870218 main.go:141] libmachine: Reticulating splines...

	I0429 12:47:35.460182  870218 client.go:171] duration metric: took 24.691589554s to LocalClient.Create

	I0429 12:47:35.460213  870218 start.go:167] duration metric: took 24.691680665s to libmachine.API.Create "ha-212075"

	I0429 12:47:35.460226  870218 start.go:293] postStartSetup for "ha-212075" (driver="kvm2")

	I0429 12:47:35.460240  870218 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0429 12:47:35.460264  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.460530  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0429 12:47:35.460565  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.462997  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.463401  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.463421  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.463619  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.463842  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.463989  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.464114  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.554760  870218 ssh_runner.go:195] Run: cat /etc/os-release

	I0429 12:47:35.559334  870218 info.go:137] Remote host: Buildroot 2023.02.9

	I0429 12:47:35.559381  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/addons for local assets ...

	I0429 12:47:35.559459  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/files for local assets ...

	I0429 12:47:35.559534  870218 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> 8546602.pem in /etc/ssl/certs

	I0429 12:47:35.559544  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /etc/ssl/certs/8546602.pem

	I0429 12:47:35.559645  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0429 12:47:35.569671  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:47:35.596267  870218 start.go:296] duration metric: took 136.022682ms for postStartSetup

	I0429 12:47:35.596345  870218 main.go:141] libmachine: (ha-212075) Calling .GetConfigRaw

	I0429 12:47:35.596981  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:35.599978  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.600353  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.600383  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.600634  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:47:35.600866  870218 start.go:128] duration metric: took 24.851721937s to createHost

	I0429 12:47:35.600897  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.603199  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.603644  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.603674  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.603745  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.603970  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.604159  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.604339  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.604533  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:35.604712  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:35.604729  870218 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0429 12:47:35.720740  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714394855.695919494

	I0429 12:47:35.720765  870218 fix.go:216] guest clock: 1714394855.695919494

	I0429 12:47:35.720776  870218 fix.go:229] Guest: 2024-04-29 12:47:35.695919494 +0000 UTC Remote: 2024-04-29 12:47:35.600880557 +0000 UTC m=+24.976033512 (delta=95.038937ms)

	I0429 12:47:35.720806  870218 fix.go:200] guest clock delta is within tolerance: 95.038937ms

	I0429 12:47:35.720812  870218 start.go:83] releasing machines lock for "ha-212075", held for 24.971753151s

	I0429 12:47:35.720837  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.721124  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:35.723665  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.724032  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.724067  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.724221  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.724774  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.724980  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.725072  870218 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0429 12:47:35.725118  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.725227  870218 ssh_runner.go:195] Run: cat /version.json

	I0429 12:47:35.725260  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.728155  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728311  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728537  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.728566  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728669  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.728701  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728731  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.728877  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.728952  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.729132  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.729136  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.729304  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.729322  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.729443  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.837269  870218 ssh_runner.go:195] Run: systemctl --version

	I0429 12:47:35.844092  870218 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0429 12:47:36.005807  870218 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0429 12:47:36.012800  870218 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0429 12:47:36.012902  870218 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0429 12:47:36.030274  870218 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0429 12:47:36.030311  870218 start.go:494] detecting cgroup driver to use...

	I0429 12:47:36.030402  870218 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0429 12:47:36.046974  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0429 12:47:36.061895  870218 docker.go:217] disabling cri-docker service (if available) ...

	I0429 12:47:36.061982  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0429 12:47:36.076800  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0429 12:47:36.091454  870218 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0429 12:47:36.211024  870218 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0429 12:47:36.351716  870218 docker.go:233] disabling docker service ...

	I0429 12:47:36.351802  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0429 12:47:36.367728  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0429 12:47:36.381746  870218 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0429 12:47:36.521448  870218 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0429 12:47:36.643441  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0429 12:47:36.658397  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0429 12:47:36.678361  870218 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0429 12:47:36.678431  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.690326  870218 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0429 12:47:36.690412  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.702156  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.714496  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.726598  870218 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0429 12:47:36.739087  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.750643  870218 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.769859  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.781534  870218 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0429 12:47:36.791887  870218 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0429 12:47:36.791968  870218 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0429 12:47:36.806869  870218 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0429 12:47:36.817796  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:47:36.937337  870218 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0429 12:47:37.079704  870218 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0429 12:47:37.079785  870218 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0429 12:47:37.084919  870218 start.go:562] Will wait 60s for crictl version

	I0429 12:47:37.085054  870218 ssh_runner.go:195] Run: which crictl

	I0429 12:47:37.089276  870218 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0429 12:47:37.132022  870218 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0429 12:47:37.132124  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:47:37.162365  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:47:37.194434  870218 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0429 12:47:37.195855  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:37.198800  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:37.199235  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:37.199265  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:37.199505  870218 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0429 12:47:37.203973  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:47:37.217992  870218 kubeadm.go:877] updating cluster {Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cl

usterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mo

untType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0429 12:47:37.218119  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:47:37.218170  870218 ssh_runner.go:195] Run: sudo crictl images --output json

	I0429 12:47:37.254058  870218 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0". assuming images are not preloaded.

	I0429 12:47:37.254136  870218 ssh_runner.go:195] Run: which lz4

	I0429 12:47:37.258626  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0429 12:47:37.258735  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0429 12:47:37.263492  870218 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0429 12:47:37.263531  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394544937 bytes)

	I0429 12:47:38.827807  870218 crio.go:462] duration metric: took 1.569087769s to copy over tarball

	I0429 12:47:38.827894  870218 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0429 12:47:41.114738  870218 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.286814073s)

	I0429 12:47:41.114772  870218 crio.go:469] duration metric: took 2.286930667s to extract the tarball

	I0429 12:47:41.114780  870218 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0429 12:47:41.153797  870218 ssh_runner.go:195] Run: sudo crictl images --output json

	I0429 12:47:41.199426  870218 crio.go:514] all images are preloaded for cri-o runtime.

	I0429 12:47:41.199455  870218 cache_images.go:84] Images are preloaded, skipping loading

	I0429 12:47:41.199464  870218 kubeadm.go:928] updating node { 192.168.39.97 8443 v1.30.0 crio true true} ...

	I0429 12:47:41.199578  870218 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-212075 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.97

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0429 12:47:41.199653  870218 ssh_runner.go:195] Run: crio config

	I0429 12:47:41.250499  870218 cni.go:84] Creating CNI manager for ""

	I0429 12:47:41.250526  870218 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0429 12:47:41.250537  870218 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0429 12:47:41.250559  870218 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.97 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-212075 NodeName:ha-212075 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.97"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.97 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/m

anifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0429 12:47:41.250705  870218 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.97

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-212075"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.97

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.97"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0429 12:47:41.250732  870218 kube-vip.go:111] generating kube-vip config ...

	I0429 12:47:41.250777  870218 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0429 12:47:41.269494  870218 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0429 12:47:41.269627  870218 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0429 12:47:41.269685  870218 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0429 12:47:41.280555  870218 binaries.go:44] Found k8s binaries, skipping transfer

	I0429 12:47:41.280644  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0429 12:47:41.291333  870218 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (308 bytes)

	I0429 12:47:41.310105  870218 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0429 12:47:41.328730  870218 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2150 bytes)

	I0429 12:47:41.347634  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1352 bytes)

	I0429 12:47:41.365931  870218 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0429 12:47:41.370302  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:47:41.383866  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:47:41.512387  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:47:41.530551  870218 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075 for IP: 192.168.39.97

	I0429 12:47:41.530581  870218 certs.go:194] generating shared ca certs ...

	I0429 12:47:41.530604  870218 certs.go:226] acquiring lock for ca certs: {Name:mk6be02e49d8ee7e457b7d9b7cd478c5e883ea66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:41.530779  870218 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key

	I0429 12:47:41.530833  870218 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key

	I0429 12:47:41.530848  870218 certs.go:256] generating profile certs ...

	I0429 12:47:41.530915  870218 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key

	I0429 12:47:41.530951  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt with IP's: []

	I0429 12:47:41.722700  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt ...

	I0429 12:47:41.722741  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt: {Name:mk4f0aba10f064735148f15f887ea67a1137a3b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:41.722964  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key ...

	I0429 12:47:41.722982  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key: {Name:mkaee3859a995806ed485f81a0abcc895804c08c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:41.723093  870218 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294

	I0429 12:47:41.723113  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.97 192.168.39.254]

	I0429 12:47:42.017824  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294 ...

	I0429 12:47:42.017866  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294: {Name:mk192112794ed2eccfcd600bb5d5c95e549cded1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.018075  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294 ...

	I0429 12:47:42.018095  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294: {Name:mka4cfea4c0ea9fde780611847d7c0973ea6230b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.018201  870218 certs.go:381] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt

	I0429 12:47:42.018327  870218 certs.go:385] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key

	I0429 12:47:42.018421  870218 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key

	I0429 12:47:42.018445  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt with IP's: []

	I0429 12:47:42.170382  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt ...

	I0429 12:47:42.170425  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt: {Name:mk2c7c2efcf55e17dae029e8d8b23a5d23f2d657 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.170634  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key ...

	I0429 12:47:42.170652  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key: {Name:mk8ce0121b4c42805c1956fc1acf6c7e5ee80e96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.170754  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0429 12:47:42.170777  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0429 12:47:42.170794  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0429 12:47:42.170816  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0429 12:47:42.170839  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0429 12:47:42.170869  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0429 12:47:42.170896  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0429 12:47:42.170915  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0429 12:47:42.170984  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem (1338 bytes)

	W0429 12:47:42.171032  870218 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660_empty.pem, impossibly tiny 0 bytes

	I0429 12:47:42.171059  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem (1679 bytes)

	I0429 12:47:42.171091  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem (1078 bytes)

	I0429 12:47:42.171131  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem (1123 bytes)

	I0429 12:47:42.171221  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem (1679 bytes)

	I0429 12:47:42.171302  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:47:42.171349  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.171385  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem -> /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.171405  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.172051  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0429 12:47:42.204925  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0429 12:47:42.233610  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0429 12:47:42.265193  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0429 12:47:42.292433  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0429 12:47:42.326458  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0429 12:47:42.356962  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0429 12:47:42.386083  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0429 12:47:42.418703  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0429 12:47:42.450096  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem --> /usr/share/ca-certificates/854660.pem (1338 bytes)

	I0429 12:47:42.477246  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /usr/share/ca-certificates/8546602.pem (1708 bytes)

	I0429 12:47:42.506751  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0429 12:47:42.528244  870218 ssh_runner.go:195] Run: openssl version

	I0429 12:47:42.534899  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/854660.pem && ln -fs /usr/share/ca-certificates/854660.pem /etc/ssl/certs/854660.pem"

	I0429 12:47:42.548693  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.554530  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 12:39 /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.554605  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.561916  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/854660.pem /etc/ssl/certs/51391683.0"

	I0429 12:47:42.575762  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8546602.pem && ln -fs /usr/share/ca-certificates/8546602.pem /etc/ssl/certs/8546602.pem"

	I0429 12:47:42.589167  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.594723  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 12:39 /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.594814  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.602038  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8546602.pem /etc/ssl/certs/3ec20f2e.0"

	I0429 12:47:42.615369  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0429 12:47:42.628913  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.634531  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:59 /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.634595  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.641566  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0429 12:47:42.655039  870218 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0429 12:47:42.659883  870218 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0429 12:47:42.659966  870218 kubeadm.go:391] StartCluster: {Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Clust

erName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount

Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 12:47:42.660127  870218 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0429 12:47:42.660199  870218 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0429 12:47:42.701855  870218 cri.go:89] found id: ""

	I0429 12:47:42.701934  870218 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0429 12:47:42.712771  870218 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0429 12:47:42.723461  870218 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0429 12:47:42.735142  870218 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0429 12:47:42.735166  870218 kubeadm.go:156] found existing configuration files:

	I0429 12:47:42.735214  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0429 12:47:42.745568  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0429 12:47:42.745651  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0429 12:47:42.756257  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0429 12:47:42.767063  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0429 12:47:42.767142  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0429 12:47:42.778879  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0429 12:47:42.789320  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0429 12:47:42.789402  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0429 12:47:42.800240  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0429 12:47:42.810530  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0429 12:47:42.810605  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0429 12:47:42.821530  870218 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0429 12:47:42.934280  870218 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0

	I0429 12:47:42.934357  870218 kubeadm.go:309] [preflight] Running pre-flight checks

	I0429 12:47:43.080585  870218 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0429 12:47:43.080749  870218 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0429 12:47:43.080883  870218 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0429 12:47:43.332866  870218 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0429 12:47:43.342245  870218 out.go:204]   - Generating certificates and keys ...

	I0429 12:47:43.342415  870218 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0429 12:47:43.342525  870218 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0429 12:47:43.667747  870218 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0429 12:47:43.718862  870218 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0429 12:47:43.877370  870218 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0429 12:47:43.955431  870218 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0429 12:47:44.025648  870218 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0429 12:47:44.025818  870218 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-212075 localhost] and IPs [192.168.39.97 127.0.0.1 ::1]

	I0429 12:47:44.114660  870218 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0429 12:47:44.114839  870218 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-212075 localhost] and IPs [192.168.39.97 127.0.0.1 ::1]

	I0429 12:47:44.454769  870218 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0429 12:47:44.530738  870218 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0429 12:47:44.602193  870218 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0429 12:47:44.602286  870218 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0429 12:47:44.691879  870218 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0429 12:47:44.867537  870218 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0429 12:47:44.989037  870218 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0429 12:47:45.099892  870218 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0429 12:47:45.247531  870218 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0429 12:47:45.248041  870218 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0429 12:47:45.251054  870218 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0429 12:47:45.254247  870218 out.go:204]   - Booting up control plane ...

	I0429 12:47:45.254379  870218 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0429 12:47:45.254461  870218 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0429 12:47:45.254540  870218 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0429 12:47:45.269826  870218 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0429 12:47:45.270735  870218 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0429 12:47:45.270791  870218 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0429 12:47:45.415518  870218 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0429 12:47:45.415641  870218 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0429 12:47:46.416954  870218 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.002166461s

	I0429 12:47:46.417061  870218 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0429 12:47:52.416938  870218 kubeadm.go:309] [api-check] The API server is healthy after 6.003166313s

	I0429 12:47:52.433395  870218 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0429 12:47:52.450424  870218 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0429 12:47:52.481163  870218 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0429 12:47:52.481367  870218 kubeadm.go:309] [mark-control-plane] Marking the node ha-212075 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0429 12:47:52.494539  870218 kubeadm.go:309] [bootstrap-token] Using token: oy0k5e.zul1f1ey7gnfr2ai

	I0429 12:47:52.496157  870218 out.go:204]   - Configuring RBAC rules ...

	I0429 12:47:52.496331  870218 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0429 12:47:52.502259  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0429 12:47:52.511107  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0429 12:47:52.515407  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0429 12:47:52.518870  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0429 12:47:52.527162  870218 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0429 12:47:52.824005  870218 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0429 12:47:53.332771  870218 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0429 12:47:53.824147  870218 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0429 12:47:53.825228  870218 kubeadm.go:309] 

	I0429 12:47:53.825297  870218 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0429 12:47:53.825327  870218 kubeadm.go:309] 

	I0429 12:47:53.825444  870218 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0429 12:47:53.825457  870218 kubeadm.go:309] 

	I0429 12:47:53.825521  870218 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0429 12:47:53.825634  870218 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0429 12:47:53.825715  870218 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0429 12:47:53.825748  870218 kubeadm.go:309] 

	I0429 12:47:53.825830  870218 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0429 12:47:53.825842  870218 kubeadm.go:309] 

	I0429 12:47:53.825919  870218 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0429 12:47:53.825928  870218 kubeadm.go:309] 

	I0429 12:47:53.826008  870218 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0429 12:47:53.826118  870218 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0429 12:47:53.826239  870218 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0429 12:47:53.826252  870218 kubeadm.go:309] 

	I0429 12:47:53.826371  870218 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0429 12:47:53.826475  870218 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0429 12:47:53.826494  870218 kubeadm.go:309] 

	I0429 12:47:53.826613  870218 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token oy0k5e.zul1f1ey7gnfr2ai \

	I0429 12:47:53.826769  870218 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 \

	I0429 12:47:53.826807  870218 kubeadm.go:309] 	--control-plane 

	I0429 12:47:53.826817  870218 kubeadm.go:309] 

	I0429 12:47:53.826927  870218 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0429 12:47:53.826938  870218 kubeadm.go:309] 

	I0429 12:47:53.827054  870218 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token oy0k5e.zul1f1ey7gnfr2ai \

	I0429 12:47:53.827204  870218 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 

	I0429 12:47:53.827540  870218 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0429 12:47:53.827637  870218 cni.go:84] Creating CNI manager for ""

	I0429 12:47:53.827661  870218 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0429 12:47:53.829635  870218 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0429 12:47:53.831034  870218 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0429 12:47:53.837177  870218 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.0/kubectl ...

	I0429 12:47:53.837201  870218 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0429 12:47:53.857011  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0429 12:47:54.316710  870218 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0429 12:47:54.316795  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:54.316822  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-212075 minikube.k8s.io/updated_at=2024_04_29T12_47_54_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332 minikube.k8s.io/name=ha-212075 minikube.k8s.io/primary=true

	I0429 12:47:54.345797  870218 ops.go:34] apiserver oom_adj: -16

	I0429 12:47:54.496882  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:54.997852  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:55.497076  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:55.997178  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:56.497134  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:56.997042  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:57.497933  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:57.997275  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:58.496967  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:58.997579  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:59.497467  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:59.996968  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:00.497065  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:00.996897  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:01.497143  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:01.997850  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:02.497748  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:02.997561  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:03.497638  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:03.997996  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:04.497993  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:04.997647  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:05.497664  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:05.996988  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:06.497690  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:06.997830  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:07.106754  870218 kubeadm.go:1107] duration metric: took 12.790030758s to wait for elevateKubeSystemPrivileges

	W0429 12:48:07.106816  870218 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0429 12:48:07.106828  870218 kubeadm.go:393] duration metric: took 24.446869371s to StartCluster

	I0429 12:48:07.106853  870218 settings.go:142] acquiring lock: {Name:mkfc2a12c970f9efb6ef840042bb7ab028a1a307 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:07.106931  870218 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:48:07.107757  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/kubeconfig: {Name:mkadb918f2b0432255c1cf69aa2465afc0e639c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:07.108054  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0429 12:48:07.108076  870218 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]

	I0429 12:48:07.108170  870218 addons.go:69] Setting storage-provisioner=true in profile "ha-212075"

	I0429 12:48:07.108059  870218 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:48:07.108227  870218 addons.go:234] Setting addon storage-provisioner=true in "ha-212075"

	I0429 12:48:07.108236  870218 start.go:240] waiting for startup goroutines ...

	I0429 12:48:07.108272  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:07.108274  870218 addons.go:69] Setting default-storageclass=true in profile "ha-212075"

	I0429 12:48:07.108298  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:07.108318  870218 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-212075"

	I0429 12:48:07.108698  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.108711  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.108741  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.108818  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.125835  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34041

	I0429 12:48:07.125855  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34713

	I0429 12:48:07.126384  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.126392  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.126889  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.126907  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.127043  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.127070  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.127240  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.127469  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.127687  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:07.127850  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.127884  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.130130  870218 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:48:07.130484  870218 kapi.go:59] client config for ha-212075: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt", KeyFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key", CAFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0429 12:48:07.131110  870218 cert_rotation.go:137] Starting client certificate rotation controller

	I0429 12:48:07.131444  870218 addons.go:234] Setting addon default-storageclass=true in "ha-212075"

	I0429 12:48:07.131495  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:07.131891  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.131942  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.145217  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33429

	I0429 12:48:07.145713  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.146291  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.146318  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.146674  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.146921  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:07.147889  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40861

	I0429 12:48:07.148424  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.148984  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.149009  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.149027  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:07.151195  870218 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0429 12:48:07.149400  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.151835  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.152779  870218 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0429 12:48:07.152793  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0429 12:48:07.152798  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.152812  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:07.156024  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.156453  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:07.156481  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.156627  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:07.156875  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:07.157054  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:07.157212  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:07.169582  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42165

	I0429 12:48:07.170085  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.170658  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.170689  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.171047  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.171293  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:07.172975  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:07.173320  870218 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0429 12:48:07.173343  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0429 12:48:07.173366  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:07.176220  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.176648  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:07.176680  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.176863  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:07.177079  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:07.177269  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:07.177438  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:07.266153  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0429 12:48:07.412582  870218 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0429 12:48:07.452705  870218 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0429 12:48:08.095864  870218 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0429 12:48:08.460264  870218 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.047632478s)

	I0429 12:48:08.460335  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460334  870218 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.007583898s)

	I0429 12:48:08.460382  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460397  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.460349  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.460782  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.460798  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.460807  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460814  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.460874  870218 main.go:141] libmachine: (ha-212075) DBG | Closing plugin on server side

	I0429 12:48:08.460931  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.460951  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.460968  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460979  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.461022  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.461036  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.461284  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.461303  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.461463  870218 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0429 12:48:08.461474  870218 round_trippers.go:469] Request Headers:

	I0429 12:48:08.461491  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:48:08.461497  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:48:08.472509  870218 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0429 12:48:08.473158  870218 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0429 12:48:08.473177  870218 round_trippers.go:469] Request Headers:

	I0429 12:48:08.473184  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:48:08.473189  870218 round_trippers.go:473]     Content-Type: application/json

	I0429 12:48:08.473191  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:48:08.476542  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:48:08.476725  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.476745  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.477033  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.477052  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.477060  870218 main.go:141] libmachine: (ha-212075) DBG | Closing plugin on server side

	I0429 12:48:08.479794  870218 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0429 12:48:08.481166  870218 addons.go:505] duration metric: took 1.373080963s for enable addons: enabled=[storage-provisioner default-storageclass]

	I0429 12:48:08.481216  870218 start.go:245] waiting for cluster config update ...

	I0429 12:48:08.481256  870218 start.go:254] writing updated cluster config ...

	I0429 12:48:08.482945  870218 out.go:177] 

	I0429 12:48:08.484429  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:08.484522  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:48:08.486369  870218 out.go:177] * Starting "ha-212075-m02" control-plane node in "ha-212075" cluster

	I0429 12:48:08.487634  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:48:08.487679  870218 cache.go:56] Caching tarball of preloaded images

	I0429 12:48:08.487783  870218 preload.go:173] Found /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0429 12:48:08.487798  870218 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0429 12:48:08.487893  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:48:08.488101  870218 start.go:360] acquireMachinesLock for ha-212075-m02: {Name:mk2ade588bdb49db467a1dc12f643b97a2b1f5bb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0429 12:48:08.488155  870218 start.go:364] duration metric: took 29.185µs to acquireMachinesLock for "ha-212075-m02"

	I0429 12:48:08.488180  870218 start.go:93] Provisioning new machine with config: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cert

Expiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:48:08.488293  870218 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0429 12:48:08.489965  870218 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0429 12:48:08.490069  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:08.490097  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:08.506743  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37965

	I0429 12:48:08.507216  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:08.507765  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:08.507789  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:08.508188  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:08.508403  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:08.508606  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:08.508820  870218 start.go:159] libmachine.API.Create for "ha-212075" (driver="kvm2")

	I0429 12:48:08.508849  870218 client.go:168] LocalClient.Create starting

	I0429 12:48:08.508889  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem

	I0429 12:48:08.508932  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:48:08.508969  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:48:08.509048  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem

	I0429 12:48:08.509075  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:48:08.509094  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:48:08.509130  870218 main.go:141] libmachine: Running pre-create checks...

	I0429 12:48:08.509143  870218 main.go:141] libmachine: (ha-212075-m02) Calling .PreCreateCheck

	I0429 12:48:08.509327  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetConfigRaw

	I0429 12:48:08.509720  870218 main.go:141] libmachine: Creating machine...

	I0429 12:48:08.509736  870218 main.go:141] libmachine: (ha-212075-m02) Calling .Create

	I0429 12:48:08.509878  870218 main.go:141] libmachine: (ha-212075-m02) Creating KVM machine...

	I0429 12:48:08.511329  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found existing default KVM network

	I0429 12:48:08.511504  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found existing private KVM network mk-ha-212075

	I0429 12:48:08.511675  870218 main.go:141] libmachine: (ha-212075-m02) Setting up store path in /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02 ...

	I0429 12:48:08.511701  870218 main.go:141] libmachine: (ha-212075-m02) Building disk image from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0429 12:48:08.511754  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.511637  870647 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:48:08.511870  870218 main.go:141] libmachine: (ha-212075-m02) Downloading /home/jenkins/minikube-integration/18773-847310/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0429 12:48:08.772309  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.772142  870647 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa...

	I0429 12:48:08.898179  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.898033  870647 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/ha-212075-m02.rawdisk...

	I0429 12:48:08.898251  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Writing magic tar header

	I0429 12:48:08.898270  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Writing SSH key tar header

	I0429 12:48:08.898287  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.898155  870647 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02 ...

	I0429 12:48:08.898330  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02

	I0429 12:48:08.898347  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines

	I0429 12:48:08.898361  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02 (perms=drwx------)

	I0429 12:48:08.898387  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines (perms=drwxr-xr-x)

	I0429 12:48:08.898401  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube (perms=drwxr-xr-x)

	I0429 12:48:08.898435  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310 (perms=drwxrwxr-x)

	I0429 12:48:08.898449  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:48:08.898463  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310

	I0429 12:48:08.898477  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0429 12:48:08.898494  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins

	I0429 12:48:08.898504  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home

	I0429 12:48:08.898517  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Skipping /home - not owner

	I0429 12:48:08.898531  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0429 12:48:08.898551  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0429 12:48:08.898567  870218 main.go:141] libmachine: (ha-212075-m02) Creating domain...

	I0429 12:48:08.899629  870218 main.go:141] libmachine: (ha-212075-m02) define libvirt domain using xml: 

	I0429 12:48:08.899656  870218 main.go:141] libmachine: (ha-212075-m02) <domain type='kvm'>

	I0429 12:48:08.899663  870218 main.go:141] libmachine: (ha-212075-m02)   <name>ha-212075-m02</name>

	I0429 12:48:08.899669  870218 main.go:141] libmachine: (ha-212075-m02)   <memory unit='MiB'>2200</memory>

	I0429 12:48:08.899677  870218 main.go:141] libmachine: (ha-212075-m02)   <vcpu>2</vcpu>

	I0429 12:48:08.899684  870218 main.go:141] libmachine: (ha-212075-m02)   <features>

	I0429 12:48:08.899692  870218 main.go:141] libmachine: (ha-212075-m02)     <acpi/>

	I0429 12:48:08.899699  870218 main.go:141] libmachine: (ha-212075-m02)     <apic/>

	I0429 12:48:08.899709  870218 main.go:141] libmachine: (ha-212075-m02)     <pae/>

	I0429 12:48:08.899714  870218 main.go:141] libmachine: (ha-212075-m02)     

	I0429 12:48:08.899733  870218 main.go:141] libmachine: (ha-212075-m02)   </features>

	I0429 12:48:08.899744  870218 main.go:141] libmachine: (ha-212075-m02)   <cpu mode='host-passthrough'>

	I0429 12:48:08.899749  870218 main.go:141] libmachine: (ha-212075-m02)   

	I0429 12:48:08.899763  870218 main.go:141] libmachine: (ha-212075-m02)   </cpu>

	I0429 12:48:08.899774  870218 main.go:141] libmachine: (ha-212075-m02)   <os>

	I0429 12:48:08.899785  870218 main.go:141] libmachine: (ha-212075-m02)     <type>hvm</type>

	I0429 12:48:08.899794  870218 main.go:141] libmachine: (ha-212075-m02)     <boot dev='cdrom'/>

	I0429 12:48:08.899805  870218 main.go:141] libmachine: (ha-212075-m02)     <boot dev='hd'/>

	I0429 12:48:08.899842  870218 main.go:141] libmachine: (ha-212075-m02)     <bootmenu enable='no'/>

	I0429 12:48:08.899866  870218 main.go:141] libmachine: (ha-212075-m02)   </os>

	I0429 12:48:08.899892  870218 main.go:141] libmachine: (ha-212075-m02)   <devices>

	I0429 12:48:08.899912  870218 main.go:141] libmachine: (ha-212075-m02)     <disk type='file' device='cdrom'>

	I0429 12:48:08.899930  870218 main.go:141] libmachine: (ha-212075-m02)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/boot2docker.iso'/>

	I0429 12:48:08.899941  870218 main.go:141] libmachine: (ha-212075-m02)       <target dev='hdc' bus='scsi'/>

	I0429 12:48:08.899950  870218 main.go:141] libmachine: (ha-212075-m02)       <readonly/>

	I0429 12:48:08.899958  870218 main.go:141] libmachine: (ha-212075-m02)     </disk>

	I0429 12:48:08.899964  870218 main.go:141] libmachine: (ha-212075-m02)     <disk type='file' device='disk'>

	I0429 12:48:08.899973  870218 main.go:141] libmachine: (ha-212075-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0429 12:48:08.899981  870218 main.go:141] libmachine: (ha-212075-m02)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/ha-212075-m02.rawdisk'/>

	I0429 12:48:08.899992  870218 main.go:141] libmachine: (ha-212075-m02)       <target dev='hda' bus='virtio'/>

	I0429 12:48:08.900009  870218 main.go:141] libmachine: (ha-212075-m02)     </disk>

	I0429 12:48:08.900025  870218 main.go:141] libmachine: (ha-212075-m02)     <interface type='network'>

	I0429 12:48:08.900040  870218 main.go:141] libmachine: (ha-212075-m02)       <source network='mk-ha-212075'/>

	I0429 12:48:08.900051  870218 main.go:141] libmachine: (ha-212075-m02)       <model type='virtio'/>

	I0429 12:48:08.900062  870218 main.go:141] libmachine: (ha-212075-m02)     </interface>

	I0429 12:48:08.900072  870218 main.go:141] libmachine: (ha-212075-m02)     <interface type='network'>

	I0429 12:48:08.900081  870218 main.go:141] libmachine: (ha-212075-m02)       <source network='default'/>

	I0429 12:48:08.900092  870218 main.go:141] libmachine: (ha-212075-m02)       <model type='virtio'/>

	I0429 12:48:08.900107  870218 main.go:141] libmachine: (ha-212075-m02)     </interface>

	I0429 12:48:08.900126  870218 main.go:141] libmachine: (ha-212075-m02)     <serial type='pty'>

	I0429 12:48:08.900139  870218 main.go:141] libmachine: (ha-212075-m02)       <target port='0'/>

	I0429 12:48:08.900149  870218 main.go:141] libmachine: (ha-212075-m02)     </serial>

	I0429 12:48:08.900173  870218 main.go:141] libmachine: (ha-212075-m02)     <console type='pty'>

	I0429 12:48:08.900184  870218 main.go:141] libmachine: (ha-212075-m02)       <target type='serial' port='0'/>

	I0429 12:48:08.900192  870218 main.go:141] libmachine: (ha-212075-m02)     </console>

	I0429 12:48:08.900203  870218 main.go:141] libmachine: (ha-212075-m02)     <rng model='virtio'>

	I0429 12:48:08.900216  870218 main.go:141] libmachine: (ha-212075-m02)       <backend model='random'>/dev/random</backend>

	I0429 12:48:08.900225  870218 main.go:141] libmachine: (ha-212075-m02)     </rng>

	I0429 12:48:08.900234  870218 main.go:141] libmachine: (ha-212075-m02)     

	I0429 12:48:08.900242  870218 main.go:141] libmachine: (ha-212075-m02)     

	I0429 12:48:08.900252  870218 main.go:141] libmachine: (ha-212075-m02)   </devices>

	I0429 12:48:08.900259  870218 main.go:141] libmachine: (ha-212075-m02) </domain>

	I0429 12:48:08.900268  870218 main.go:141] libmachine: (ha-212075-m02) 

	I0429 12:48:08.907946  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:a9:53:79 in network default

	I0429 12:48:08.908582  870218 main.go:141] libmachine: (ha-212075-m02) Ensuring networks are active...

	I0429 12:48:08.908607  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:08.909355  870218 main.go:141] libmachine: (ha-212075-m02) Ensuring network default is active

	I0429 12:48:08.909634  870218 main.go:141] libmachine: (ha-212075-m02) Ensuring network mk-ha-212075 is active

	I0429 12:48:08.910063  870218 main.go:141] libmachine: (ha-212075-m02) Getting domain xml...

	I0429 12:48:08.910889  870218 main.go:141] libmachine: (ha-212075-m02) Creating domain...

	I0429 12:48:10.185813  870218 main.go:141] libmachine: (ha-212075-m02) Waiting to get IP...

	I0429 12:48:10.186939  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:10.187509  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:10.187547  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:10.187468  870647 retry.go:31] will retry after 301.578397ms: waiting for machine to come up

	I0429 12:48:10.491341  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:10.491897  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:10.491932  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:10.491839  870647 retry.go:31] will retry after 321.98325ms: waiting for machine to come up

	I0429 12:48:10.815451  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:10.815808  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:10.815832  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:10.815763  870647 retry.go:31] will retry after 394.050947ms: waiting for machine to come up

	I0429 12:48:11.211473  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:11.211909  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:11.211942  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:11.211849  870647 retry.go:31] will retry after 430.51973ms: waiting for machine to come up

	I0429 12:48:11.644676  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:11.645219  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:11.645248  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:11.645148  870647 retry.go:31] will retry after 709.605764ms: waiting for machine to come up

	I0429 12:48:12.356069  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:12.356525  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:12.356593  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:12.356473  870647 retry.go:31] will retry after 890.075621ms: waiting for machine to come up

	I0429 12:48:13.248841  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:13.249370  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:13.249406  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:13.249304  870647 retry.go:31] will retry after 727.943001ms: waiting for machine to come up

	I0429 12:48:13.978718  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:13.979281  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:13.979316  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:13.979215  870647 retry.go:31] will retry after 945.901335ms: waiting for machine to come up

	I0429 12:48:14.926762  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:14.927398  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:14.927432  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:14.927328  870647 retry.go:31] will retry after 1.459605646s: waiting for machine to come up

	I0429 12:48:16.388522  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:16.388934  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:16.388959  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:16.388887  870647 retry.go:31] will retry after 1.569864244s: waiting for machine to come up

	I0429 12:48:17.960898  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:17.961469  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:17.961500  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:17.961424  870647 retry.go:31] will retry after 2.113218061s: waiting for machine to come up

	I0429 12:48:20.078292  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:20.078741  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:20.078768  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:20.078698  870647 retry.go:31] will retry after 2.352898738s: waiting for machine to come up

	I0429 12:48:22.434312  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:22.434768  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:22.434792  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:22.434720  870647 retry.go:31] will retry after 4.188987093s: waiting for machine to come up

	I0429 12:48:26.627589  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:26.628066  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:26.628098  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:26.628002  870647 retry.go:31] will retry after 4.959414999s: waiting for machine to come up

	I0429 12:48:31.590773  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.591277  870218 main.go:141] libmachine: (ha-212075-m02) Found IP for machine: 192.168.39.36

	I0429 12:48:31.591299  870218 main.go:141] libmachine: (ha-212075-m02) Reserving static IP address...

	I0429 12:48:31.591312  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has current primary IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.591748  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find host DHCP lease matching {name: "ha-212075-m02", mac: "52:54:00:46:f4:9a", ip: "192.168.39.36"} in network mk-ha-212075

	I0429 12:48:31.678248  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Getting to WaitForSSH function...

	I0429 12:48:31.678313  870218 main.go:141] libmachine: (ha-212075-m02) Reserved static IP address: 192.168.39.36

	I0429 12:48:31.678330  870218 main.go:141] libmachine: (ha-212075-m02) Waiting for SSH to be available...

	I0429 12:48:31.681502  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.682128  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:minikube Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:31.682159  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.682371  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Using SSH client type: external

	I0429 12:48:31.682397  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa (-rw-------)

	I0429 12:48:31.682431  870218 main.go:141] libmachine: (ha-212075-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.36 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 12:48:31.682456  870218 main.go:141] libmachine: (ha-212075-m02) DBG | About to run SSH command:

	I0429 12:48:31.682464  870218 main.go:141] libmachine: (ha-212075-m02) DBG | exit 0

	I0429 12:48:31.811773  870218 main.go:141] libmachine: (ha-212075-m02) DBG | SSH cmd err, output: <nil>: 

	I0429 12:48:31.812004  870218 main.go:141] libmachine: (ha-212075-m02) KVM machine creation complete!

	I0429 12:48:31.812373  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetConfigRaw

	I0429 12:48:31.812982  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:31.813232  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:31.813485  870218 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0429 12:48:31.813500  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:48:31.814808  870218 main.go:141] libmachine: Detecting operating system of created instance...

	I0429 12:48:31.814824  870218 main.go:141] libmachine: Waiting for SSH to be available...

	I0429 12:48:31.814830  870218 main.go:141] libmachine: Getting to WaitForSSH function...

	I0429 12:48:31.814836  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:31.817101  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.817490  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:31.817519  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.817650  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:31.817845  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.818046  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.818236  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:31.818444  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:31.818670  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:31.818681  870218 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0429 12:48:31.935100  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:48:31.935130  870218 main.go:141] libmachine: Detecting the provisioner...

	I0429 12:48:31.935138  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:31.938171  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.938493  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:31.938527  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.938645  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:31.938880  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.939058  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.939226  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:31.939407  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:31.939600  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:31.939613  870218 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0429 12:48:32.053082  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0429 12:48:32.053177  870218 main.go:141] libmachine: found compatible host: buildroot

	I0429 12:48:32.053189  870218 main.go:141] libmachine: Provisioning with buildroot...

	I0429 12:48:32.053198  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:32.053466  870218 buildroot.go:166] provisioning hostname "ha-212075-m02"

	I0429 12:48:32.053493  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:32.053731  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.056710  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.057187  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.057213  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.057373  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.057590  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.057787  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.057940  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.058097  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:32.058291  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:32.058303  870218 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-212075-m02 && echo "ha-212075-m02" | sudo tee /etc/hostname

	I0429 12:48:32.186743  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-212075-m02

	I0429 12:48:32.186780  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.190004  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.190426  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.190458  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.190737  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.190924  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.191144  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.191355  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.191580  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:32.191774  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:32.191799  870218 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-212075-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-212075-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-212075-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0429 12:48:32.313526  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:48:32.313572  870218 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18773-847310/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-847310/.minikube}

	I0429 12:48:32.313594  870218 buildroot.go:174] setting up certificates

	I0429 12:48:32.313607  870218 provision.go:84] configureAuth start

	I0429 12:48:32.313644  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:32.314022  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:32.316977  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.317366  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.317400  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.317566  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.319834  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.320185  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.320221  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.320393  870218 provision.go:143] copyHostCerts

	I0429 12:48:32.320430  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:48:32.320465  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem, removing ...

	I0429 12:48:32.320475  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:48:32.320540  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem (1679 bytes)

	I0429 12:48:32.320633  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:48:32.320657  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem, removing ...

	I0429 12:48:32.320664  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:48:32.320689  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem (1078 bytes)

	I0429 12:48:32.320743  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:48:32.320761  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem, removing ...

	I0429 12:48:32.320767  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:48:32.320792  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem (1123 bytes)

	I0429 12:48:32.320890  870218 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem org=jenkins.ha-212075-m02 san=[127.0.0.1 192.168.39.36 ha-212075-m02 localhost minikube]

	I0429 12:48:32.428710  870218 provision.go:177] copyRemoteCerts

	I0429 12:48:32.428786  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0429 12:48:32.428817  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.431477  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.431790  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.431816  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.431990  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.432223  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.432417  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.432560  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:32.523038  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0429 12:48:32.523114  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0429 12:48:32.552778  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0429 12:48:32.552860  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0429 12:48:32.582395  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0429 12:48:32.582487  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0429 12:48:32.611276  870218 provision.go:87] duration metric: took 297.652353ms to configureAuth

	I0429 12:48:32.611312  870218 buildroot.go:189] setting minikube options for container-runtime

	I0429 12:48:32.611552  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:32.611642  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.614288  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.614655  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.614690  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.614928  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.615179  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.615442  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.615591  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.615741  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:32.615994  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:32.616016  870218 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0429 12:48:32.889700  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0429 12:48:32.889741  870218 main.go:141] libmachine: Checking connection to Docker...

	I0429 12:48:32.889754  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetURL

	I0429 12:48:32.891136  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Using libvirt version 6000000

	I0429 12:48:32.893428  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.893833  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.893868  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.894083  870218 main.go:141] libmachine: Docker is up and running!

	I0429 12:48:32.894098  870218 main.go:141] libmachine: Reticulating splines...

	I0429 12:48:32.894106  870218 client.go:171] duration metric: took 24.3852485s to LocalClient.Create

	I0429 12:48:32.894135  870218 start.go:167] duration metric: took 24.385317751s to libmachine.API.Create "ha-212075"

	I0429 12:48:32.894148  870218 start.go:293] postStartSetup for "ha-212075-m02" (driver="kvm2")

	I0429 12:48:32.894162  870218 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0429 12:48:32.894212  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:32.894482  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0429 12:48:32.894509  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.896782  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.897183  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.897213  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.897359  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.897544  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.897690  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.897796  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:32.982542  870218 ssh_runner.go:195] Run: cat /etc/os-release

	I0429 12:48:32.987133  870218 info.go:137] Remote host: Buildroot 2023.02.9

	I0429 12:48:32.987166  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/addons for local assets ...

	I0429 12:48:32.987242  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/files for local assets ...

	I0429 12:48:32.987334  870218 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> 8546602.pem in /etc/ssl/certs

	I0429 12:48:32.987350  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /etc/ssl/certs/8546602.pem

	I0429 12:48:32.987493  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0429 12:48:32.997640  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:48:33.023959  870218 start.go:296] duration metric: took 129.789656ms for postStartSetup

	I0429 12:48:33.024034  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetConfigRaw

	I0429 12:48:33.024677  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:33.027566  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.028047  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.028090  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.028348  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:48:33.028616  870218 start.go:128] duration metric: took 24.540303032s to createHost

	I0429 12:48:33.028651  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:33.031168  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.031576  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.031604  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.031827  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:33.032054  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.032225  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.032390  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:33.032628  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:33.032815  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:33.032826  870218 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0429 12:48:33.145647  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714394913.118554750

	I0429 12:48:33.145686  870218 fix.go:216] guest clock: 1714394913.118554750

	I0429 12:48:33.145722  870218 fix.go:229] Guest: 2024-04-29 12:48:33.11855475 +0000 UTC Remote: 2024-04-29 12:48:33.028632996 +0000 UTC m=+82.403785948 (delta=89.921754ms)

	I0429 12:48:33.145751  870218 fix.go:200] guest clock delta is within tolerance: 89.921754ms

	I0429 12:48:33.145760  870218 start.go:83] releasing machines lock for "ha-212075-m02", held for 24.657592144s

	I0429 12:48:33.145790  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.146156  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:33.149182  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.149826  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.149921  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.152272  870218 out.go:177] * Found network options:

	I0429 12:48:33.153616  870218 out.go:177]   - NO_PROXY=192.168.39.97

	W0429 12:48:33.154781  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:48:33.154814  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.155526  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.155717  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.155839  870218 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0429 12:48:33.155888  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	W0429 12:48:33.155947  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:48:33.156040  870218 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0429 12:48:33.156068  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:33.159109  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159175  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159607  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.159639  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159705  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.159739  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159843  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:33.160130  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:33.160233  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.160299  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.160394  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:33.160462  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:33.160543  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:33.160577  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:33.408285  870218 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0429 12:48:33.415387  870218 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0429 12:48:33.415464  870218 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0429 12:48:33.433502  870218 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0429 12:48:33.433530  870218 start.go:494] detecting cgroup driver to use...

	I0429 12:48:33.433612  870218 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0429 12:48:33.450404  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0429 12:48:33.466440  870218 docker.go:217] disabling cri-docker service (if available) ...

	I0429 12:48:33.466506  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0429 12:48:33.482112  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0429 12:48:33.497775  870218 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0429 12:48:33.618172  870218 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0429 12:48:33.775113  870218 docker.go:233] disabling docker service ...

	I0429 12:48:33.775228  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0429 12:48:33.791054  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0429 12:48:33.805551  870218 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0429 12:48:33.929373  870218 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0429 12:48:34.046045  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0429 12:48:34.062693  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0429 12:48:34.082723  870218 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0429 12:48:34.082828  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.095496  870218 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0429 12:48:34.095585  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.107376  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.119146  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.130938  870218 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0429 12:48:34.143454  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.155583  870218 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.174540  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.188124  870218 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0429 12:48:34.200241  870218 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0429 12:48:34.200313  870218 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0429 12:48:34.215862  870218 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0429 12:48:34.226798  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:48:34.345854  870218 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0429 12:48:34.493199  870218 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0429 12:48:34.493282  870218 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0429 12:48:34.498665  870218 start.go:562] Will wait 60s for crictl version

	I0429 12:48:34.498737  870218 ssh_runner.go:195] Run: which crictl

	I0429 12:48:34.502609  870218 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0429 12:48:34.546513  870218 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0429 12:48:34.546611  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:48:34.577592  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:48:34.610836  870218 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0429 12:48:34.612460  870218 out.go:177]   - env NO_PROXY=192.168.39.97

	I0429 12:48:34.614047  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:34.617088  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:34.617431  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:34.617464  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:34.617681  870218 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0429 12:48:34.622595  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:48:34.637467  870218 mustload.go:65] Loading cluster: ha-212075

	I0429 12:48:34.637709  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:34.638083  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:34.638119  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:34.655335  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38495

	I0429 12:48:34.655921  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:34.656505  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:34.656533  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:34.656949  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:34.657168  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:34.658862  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:34.659208  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:34.659241  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:34.676178  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39665

	I0429 12:48:34.676652  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:34.677199  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:34.677225  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:34.677649  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:34.677907  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:34.678108  870218 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075 for IP: 192.168.39.36

	I0429 12:48:34.678120  870218 certs.go:194] generating shared ca certs ...

	I0429 12:48:34.678137  870218 certs.go:226] acquiring lock for ca certs: {Name:mk6be02e49d8ee7e457b7d9b7cd478c5e883ea66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:34.678279  870218 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key

	I0429 12:48:34.678315  870218 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key

	I0429 12:48:34.678324  870218 certs.go:256] generating profile certs ...

	I0429 12:48:34.678399  870218 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key

	I0429 12:48:34.678425  870218 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885

	I0429 12:48:34.678440  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.97 192.168.39.36 192.168.39.254]

	I0429 12:48:34.805493  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885 ...

	I0429 12:48:34.805534  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885: {Name:mkd1806caee1a077a46115403308bba9c5b89af9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:34.805721  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885 ...

	I0429 12:48:34.805735  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885: {Name:mk269ebb85b90f5fc58a4363fce8b015ee69584d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:34.805806  870218 certs.go:381] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt

	I0429 12:48:34.805933  870218 certs.go:385] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key

	I0429 12:48:34.806072  870218 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key

	I0429 12:48:34.806091  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0429 12:48:34.806103  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0429 12:48:34.806117  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0429 12:48:34.806130  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0429 12:48:34.806140  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0429 12:48:34.806150  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0429 12:48:34.806159  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0429 12:48:34.806171  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0429 12:48:34.806219  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem (1338 bytes)

	W0429 12:48:34.806252  870218 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660_empty.pem, impossibly tiny 0 bytes

	I0429 12:48:34.806262  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem (1679 bytes)

	I0429 12:48:34.806284  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem (1078 bytes)

	I0429 12:48:34.806309  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem (1123 bytes)

	I0429 12:48:34.806339  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem (1679 bytes)

	I0429 12:48:34.806399  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:48:34.806444  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:34.806466  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem -> /usr/share/ca-certificates/854660.pem

	I0429 12:48:34.806484  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /usr/share/ca-certificates/8546602.pem

	I0429 12:48:34.806530  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:34.809733  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:34.810136  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:34.810161  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:34.810406  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:34.810632  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:34.810800  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:34.810968  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:34.887807  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0429 12:48:34.893360  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0429 12:48:34.905730  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0429 12:48:34.910714  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)

	I0429 12:48:34.925811  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0429 12:48:34.930751  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0429 12:48:34.942482  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0429 12:48:34.947167  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0429 12:48:34.959068  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0429 12:48:34.964374  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0429 12:48:34.977275  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0429 12:48:34.986440  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0429 12:48:35.002753  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0429 12:48:35.033535  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0429 12:48:35.060599  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0429 12:48:35.086939  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0429 12:48:35.113656  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0429 12:48:35.140419  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0429 12:48:35.167085  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0429 12:48:35.193420  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0429 12:48:35.218968  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0429 12:48:35.244325  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem --> /usr/share/ca-certificates/854660.pem (1338 bytes)

	I0429 12:48:35.269718  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /usr/share/ca-certificates/8546602.pem (1708 bytes)

	I0429 12:48:35.295519  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0429 12:48:35.314438  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)

	I0429 12:48:35.333492  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0429 12:48:35.351305  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0429 12:48:35.368872  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0429 12:48:35.386640  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0429 12:48:35.404506  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0429 12:48:35.422626  870218 ssh_runner.go:195] Run: openssl version

	I0429 12:48:35.429174  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8546602.pem && ln -fs /usr/share/ca-certificates/8546602.pem /etc/ssl/certs/8546602.pem"

	I0429 12:48:35.441867  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8546602.pem

	I0429 12:48:35.446719  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 12:39 /usr/share/ca-certificates/8546602.pem

	I0429 12:48:35.446818  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8546602.pem

	I0429 12:48:35.454462  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8546602.pem /etc/ssl/certs/3ec20f2e.0"

	I0429 12:48:35.466704  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0429 12:48:35.479054  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:35.484682  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:59 /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:35.484764  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:35.490502  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0429 12:48:35.502670  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/854660.pem && ln -fs /usr/share/ca-certificates/854660.pem /etc/ssl/certs/854660.pem"

	I0429 12:48:35.514732  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/854660.pem

	I0429 12:48:35.519580  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 12:39 /usr/share/ca-certificates/854660.pem

	I0429 12:48:35.519657  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/854660.pem

	I0429 12:48:35.525715  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/854660.pem /etc/ssl/certs/51391683.0"

	I0429 12:48:35.537965  870218 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0429 12:48:35.542342  870218 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0429 12:48:35.542400  870218 kubeadm.go:928] updating node {m02 192.168.39.36 8443 v1.30.0 crio true true} ...

	I0429 12:48:35.542490  870218 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-212075-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.36

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0429 12:48:35.542526  870218 kube-vip.go:111] generating kube-vip config ...

	I0429 12:48:35.542581  870218 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0429 12:48:35.561058  870218 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0429 12:48:35.561143  870218 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0429 12:48:35.561210  870218 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0429 12:48:35.574246  870218 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0429 12:48:35.574321  870218 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0429 12:48:35.585778  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0429 12:48:35.585815  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:48:35.585899  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:48:35.585897  870218 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm

	I0429 12:48:35.585912  870218 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet

	I0429 12:48:35.590788  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0429 12:48:35.590829  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0429 12:48:36.224127  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:48:36.224220  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:48:36.231982  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0429 12:48:36.232023  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0429 12:48:36.568380  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:48:36.585896  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:48:36.586003  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:48:36.590713  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0429 12:48:36.590749  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0429 12:48:37.056796  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0429 12:48:37.067649  870218 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0429 12:48:37.088488  870218 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0429 12:48:37.108016  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0429 12:48:37.127116  870218 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0429 12:48:37.131646  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:48:37.146577  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:48:37.271454  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:48:37.288942  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:37.289340  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:37.289389  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:37.305131  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36571

	I0429 12:48:37.305662  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:37.306176  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:37.306198  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:37.306568  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:37.306815  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:37.306984  870218 start.go:316] joinCluster: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:

26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 12:48:37.307089  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0429 12:48:37.307111  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:37.310630  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:37.311149  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:37.311190  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:37.311387  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:37.311590  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:37.311753  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:37.311911  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:37.495514  870218 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:48:37.495571  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token s07sl2.kup7dzd4wu3ttqwx --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m02 --control-plane --apiserver-advertise-address=192.168.39.36 --apiserver-bind-port=8443"

	I0429 12:49:02.049323  870218 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token s07sl2.kup7dzd4wu3ttqwx --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m02 --control-plane --apiserver-advertise-address=192.168.39.36 --apiserver-bind-port=8443": (24.553721774s)

	I0429 12:49:02.049397  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0429 12:49:02.558233  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-212075-m02 minikube.k8s.io/updated_at=2024_04_29T12_49_02_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332 minikube.k8s.io/name=ha-212075 minikube.k8s.io/primary=false

	I0429 12:49:02.732186  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-212075-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0429 12:49:02.854666  870218 start.go:318] duration metric: took 25.547674937s to joinCluster

	I0429 12:49:02.854762  870218 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:49:02.856131  870218 out.go:177] * Verifying Kubernetes components...

	I0429 12:49:02.855106  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:02.857470  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:49:03.067090  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:49:03.085215  870218 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:49:03.085546  870218 kapi.go:59] client config for ha-212075: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt", KeyFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key", CAFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0429 12:49:03.085629  870218 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.97:8443

	I0429 12:49:03.085948  870218 node_ready.go:35] waiting up to 6m0s for node "ha-212075-m02" to be "Ready" ...

	I0429 12:49:03.086041  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:03.086049  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:03.086057  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:03.086062  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:03.096961  870218 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0429 12:49:03.586849  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:03.586877  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:03.586887  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:03.586894  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:03.590813  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:04.086875  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:04.086906  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:04.086922  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:04.086929  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:04.118136  870218 round_trippers.go:574] Response Status: 200 OK in 31 milliseconds

	I0429 12:49:04.586198  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:04.586239  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:04.586248  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:04.586253  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:04.590710  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:05.087118  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:05.087150  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:05.087158  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:05.087162  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:05.090865  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:05.091510  870218 node_ready.go:53] node "ha-212075-m02" has status "Ready":"False"

	I0429 12:49:05.586466  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:05.586495  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:05.586506  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:05.586511  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:05.591095  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:06.087044  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:06.087077  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:06.087093  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:06.087099  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:06.091377  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:06.587078  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:06.587107  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:06.587116  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:06.587121  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:06.592788  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:07.086787  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:07.086820  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:07.086831  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:07.086839  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:07.091631  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:07.092318  870218 node_ready.go:53] node "ha-212075-m02" has status "Ready":"False"

	I0429 12:49:07.586426  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:07.586461  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:07.586474  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:07.586481  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:07.593188  870218 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 12:49:08.087222  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:08.087249  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.087260  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.087265  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.219961  870218 round_trippers.go:574] Response Status: 200 OK in 132 milliseconds

	I0429 12:49:08.220604  870218 node_ready.go:49] node "ha-212075-m02" has status "Ready":"True"

	I0429 12:49:08.220632  870218 node_ready.go:38] duration metric: took 5.134660973s for node "ha-212075-m02" to be "Ready" ...

	I0429 12:49:08.220646  870218 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:49:08.220738  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:08.220753  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.220764  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.220773  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.229060  870218 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 12:49:08.235147  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.235258  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-c2t8g

	I0429 12:49:08.235267  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.235275  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.235281  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.314925  870218 round_trippers.go:574] Response Status: 200 OK in 79 milliseconds

	I0429 12:49:08.315803  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:08.315828  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.315840  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.315847  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.329212  870218 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0429 12:49:08.329863  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:08.329897  870218 pod_ready.go:81] duration metric: took 94.712953ms for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.329913  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.330038  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-x299s

	I0429 12:49:08.330053  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.330064  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.330072  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.333533  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.334362  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:08.334381  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.334391  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.334398  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.338012  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.338971  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:08.338995  870218 pod_ready.go:81] duration metric: took 9.067885ms for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.339012  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.339105  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075

	I0429 12:49:08.339117  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.339128  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.339137  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.342835  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.343473  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:08.343496  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.343507  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.343516  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.349400  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:08.349955  870218 pod_ready.go:92] pod "etcd-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:08.349979  870218 pod_ready.go:81] duration metric: took 10.955166ms for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.349992  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.350072  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:08.350082  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.350093  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.350099  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.353467  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.354125  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:08.354146  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.354156  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.354163  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.357021  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:08.850289  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:08.850319  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.850331  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.850336  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.854284  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.854924  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:08.854948  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.854958  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.854963  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.858066  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:09.351005  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:09.351035  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.351057  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.351065  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.354889  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:09.356025  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:09.356044  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.356052  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.356057  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.359159  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:09.850927  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:09.850957  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.850970  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.850983  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.856731  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:09.857966  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:09.857984  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.857992  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.857998  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.860636  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:10.350922  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:10.350956  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.350966  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.350971  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.355448  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:10.356559  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:10.356578  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.356587  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.356591  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.360394  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:10.361486  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:10.850899  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:10.850929  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.850944  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.850949  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.855382  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:10.856870  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:10.856902  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.856914  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.856920  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.861517  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:11.350799  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:11.350827  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.350834  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.350838  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.354605  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:11.355335  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:11.355353  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.355378  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.355383  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.359577  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:11.851128  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:11.851157  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.851168  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.851173  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.855182  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:11.856109  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:11.856128  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.856138  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.856143  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.859010  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:12.350392  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:12.350424  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.350432  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.350436  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.354740  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:12.355746  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:12.355765  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.355773  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.355777  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.358545  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:12.850371  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:12.850402  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.850412  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.850418  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.854752  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:12.855683  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:12.855700  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.855711  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.855718  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.858834  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:12.859529  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:13.351114  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:13.351145  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.351153  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.351156  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.355082  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:13.356231  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:13.356252  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.356259  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.356264  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.359839  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:13.850437  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:13.850465  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.850473  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.850477  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.855157  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:13.855992  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:13.856011  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.856018  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.856022  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.859036  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:14.351293  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:14.351330  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.351340  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.351345  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.356455  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:14.357250  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:14.357269  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.357277  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.357282  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.361121  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:14.850961  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:14.851003  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.851016  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.851022  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.855394  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:14.856176  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:14.856195  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.856202  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.856205  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.859738  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:14.860328  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:15.350798  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:15.350830  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.350841  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.350845  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.355817  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:15.357189  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:15.357221  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.357230  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.357246  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.361330  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:15.850942  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:15.850977  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.850986  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.850989  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.854870  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:15.855657  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:15.855678  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.855686  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.855690  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.859126  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:16.351154  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:16.351183  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.351191  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.351196  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.359437  870218 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 12:49:16.360301  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:16.360324  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.360336  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.360342  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.363465  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:16.850422  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:16.850456  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.850466  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.850471  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.855565  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:16.856378  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:16.856396  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.856404  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.856409  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.860272  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:16.860861  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:17.350900  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:17.350927  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.350935  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.350938  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.355909  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:17.356733  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:17.356756  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.356767  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.356773  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.360272  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:17.850305  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:17.850332  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.850340  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.850345  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.854785  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:17.855453  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:17.855469  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.855477  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.855482  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.858541  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.350427  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:18.350455  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.350468  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.350474  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.354383  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.354996  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.355013  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.355021  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.355025  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.358793  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.851129  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:18.851157  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.851166  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.851171  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.855430  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:18.856095  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.856112  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.856120  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.856123  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.859800  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.860384  870218 pod_ready.go:92] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.860405  870218 pod_ready.go:81] duration metric: took 10.5104068s for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.860424  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.860487  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075

	I0429 12:49:18.860495  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.860502  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.860507  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.863876  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.864907  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:18.864922  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.864930  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.864933  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.868515  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.869138  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.869156  870218 pod_ready.go:81] duration metric: took 8.723811ms for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.869166  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.869238  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075-m02

	I0429 12:49:18.869246  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.869254  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.869261  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.872567  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.873514  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.873527  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.873535  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.873543  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.876640  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.877214  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.877232  870218 pod_ready.go:81] duration metric: took 8.058402ms for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.877242  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.877307  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075

	I0429 12:49:18.877316  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.877322  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.877328  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.880468  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.881203  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:18.881224  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.881235  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.881241  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.884107  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:18.885148  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.885169  870218 pod_ready.go:81] duration metric: took 7.919576ms for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.885180  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.885305  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m02

	I0429 12:49:18.885316  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.885323  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.885328  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.888193  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:18.888830  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.888845  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.888856  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.888861  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.892058  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.892610  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.892627  870218 pod_ready.go:81] duration metric: took 7.442078ms for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.892638  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.052102  870218 request.go:629] Waited for 159.379221ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:49:19.052177  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:49:19.052184  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.052194  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.052199  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.061885  870218 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0429 12:49:19.252140  870218 request.go:629] Waited for 189.369987ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:19.252224  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:19.252232  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.252243  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.252261  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.255881  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:19.256791  870218 pod_ready.go:92] pod "kube-proxy-ncdsk" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:19.256814  870218 pod_ready.go:81] duration metric: took 364.169187ms for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.256826  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.451933  870218 request.go:629] Waited for 195.014453ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:49:19.452030  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:49:19.452042  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.452054  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.452062  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.455910  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:19.652261  870218 request.go:629] Waited for 195.417524ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:19.652340  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:19.652348  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.652359  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.652364  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.656950  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:19.657658  870218 pod_ready.go:92] pod "kube-proxy-sfmhh" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:19.657680  870218 pod_ready.go:81] duration metric: took 400.848571ms for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.657691  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.851979  870218 request.go:629] Waited for 194.202023ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:49:19.852092  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:49:19.852100  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.852111  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.852117  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.856054  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:20.051273  870218 request.go:629] Waited for 194.323385ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:20.051405  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:20.051419  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.051427  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.051431  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.055030  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:20.055579  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:20.055603  870218 pod_ready.go:81] duration metric: took 397.905703ms for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:20.055614  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:20.251711  870218 request.go:629] Waited for 196.011102ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:49:20.251809  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:49:20.251817  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.251838  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.251857  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.256067  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:20.451164  870218 request.go:629] Waited for 194.30553ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:20.451272  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:20.451280  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.451291  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.451297  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.454603  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:20.455129  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:20.455160  870218 pod_ready.go:81] duration metric: took 399.537636ms for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:20.455176  870218 pod_ready.go:38] duration metric: took 12.234512578s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:49:20.455196  870218 api_server.go:52] waiting for apiserver process to appear ...

	I0429 12:49:20.455270  870218 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:49:20.472016  870218 api_server.go:72] duration metric: took 17.617201161s to wait for apiserver process to appear ...

	I0429 12:49:20.472049  870218 api_server.go:88] waiting for apiserver healthz status ...

	I0429 12:49:20.472071  870218 api_server.go:253] Checking apiserver healthz at https://192.168.39.97:8443/healthz ...

	I0429 12:49:20.478128  870218 api_server.go:279] https://192.168.39.97:8443/healthz returned 200:

	ok

	I0429 12:49:20.478206  870218 round_trippers.go:463] GET https://192.168.39.97:8443/version

	I0429 12:49:20.478214  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.478222  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.478229  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.479205  870218 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0429 12:49:20.479326  870218 api_server.go:141] control plane version: v1.30.0

	I0429 12:49:20.479348  870218 api_server.go:131] duration metric: took 7.292177ms to wait for apiserver health ...

	I0429 12:49:20.479376  870218 system_pods.go:43] waiting for kube-system pods to appear ...

	I0429 12:49:20.651833  870218 request.go:629] Waited for 172.3703ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:20.651916  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:20.651921  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.651930  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.651933  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.658972  870218 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 12:49:20.663967  870218 system_pods.go:59] 17 kube-system pods found

	I0429 12:49:20.664028  870218 system_pods.go:61] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:49:20.664035  870218 system_pods.go:61] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:49:20.664039  870218 system_pods.go:61] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:49:20.664043  870218 system_pods.go:61] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:49:20.664046  870218 system_pods.go:61] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:49:20.664049  870218 system_pods.go:61] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:49:20.664052  870218 system_pods.go:61] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:49:20.664058  870218 system_pods.go:61] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:49:20.664061  870218 system_pods.go:61] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:49:20.664066  870218 system_pods.go:61] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:49:20.664069  870218 system_pods.go:61] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:49:20.664074  870218 system_pods.go:61] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:49:20.664078  870218 system_pods.go:61] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:49:20.664082  870218 system_pods.go:61] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:49:20.664087  870218 system_pods.go:61] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:49:20.664090  870218 system_pods.go:61] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:49:20.664092  870218 system_pods.go:61] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:49:20.664099  870218 system_pods.go:74] duration metric: took 184.712298ms to wait for pod list to return data ...

	I0429 12:49:20.664110  870218 default_sa.go:34] waiting for default service account to be created ...

	I0429 12:49:20.851865  870218 request.go:629] Waited for 187.634894ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:49:20.851947  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:49:20.851952  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.851960  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.851965  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.856481  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:20.856703  870218 default_sa.go:45] found service account: "default"

	I0429 12:49:20.856718  870218 default_sa.go:55] duration metric: took 192.601184ms for default service account to be created ...

	I0429 12:49:20.856727  870218 system_pods.go:116] waiting for k8s-apps to be running ...

	I0429 12:49:21.052256  870218 request.go:629] Waited for 195.417866ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:21.052333  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:21.052351  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:21.052361  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:21.052366  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:21.057947  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:21.062642  870218 system_pods.go:86] 17 kube-system pods found

	I0429 12:49:21.062687  870218 system_pods.go:89] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:49:21.062696  870218 system_pods.go:89] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:49:21.062703  870218 system_pods.go:89] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:49:21.062708  870218 system_pods.go:89] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:49:21.062714  870218 system_pods.go:89] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:49:21.062720  870218 system_pods.go:89] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:49:21.062727  870218 system_pods.go:89] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:49:21.062733  870218 system_pods.go:89] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:49:21.062739  870218 system_pods.go:89] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:49:21.062746  870218 system_pods.go:89] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:49:21.062757  870218 system_pods.go:89] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:49:21.062765  870218 system_pods.go:89] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:49:21.062774  870218 system_pods.go:89] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:49:21.062782  870218 system_pods.go:89] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:49:21.062792  870218 system_pods.go:89] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:49:21.062800  870218 system_pods.go:89] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:49:21.062806  870218 system_pods.go:89] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:49:21.062820  870218 system_pods.go:126] duration metric: took 206.083067ms to wait for k8s-apps to be running ...

	I0429 12:49:21.062833  870218 system_svc.go:44] waiting for kubelet service to be running ....

	I0429 12:49:21.062894  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:49:21.080250  870218 system_svc.go:56] duration metric: took 17.405204ms WaitForService to wait for kubelet

	I0429 12:49:21.080292  870218 kubeadm.go:576] duration metric: took 18.225480527s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 12:49:21.080313  870218 node_conditions.go:102] verifying NodePressure condition ...

	I0429 12:49:21.251755  870218 request.go:629] Waited for 171.363431ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes

	I0429 12:49:21.251820  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes

	I0429 12:49:21.251825  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:21.251832  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:21.251837  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:21.258283  870218 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 12:49:21.259370  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:49:21.259409  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:49:21.259433  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:49:21.259439  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:49:21.259446  870218 node_conditions.go:105] duration metric: took 179.126951ms to run NodePressure ...

	I0429 12:49:21.259466  870218 start.go:240] waiting for startup goroutines ...

	I0429 12:49:21.259550  870218 start.go:254] writing updated cluster config ...

	I0429 12:49:21.261846  870218 out.go:177] 

	I0429 12:49:21.263452  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:21.263575  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:49:21.265353  870218 out.go:177] * Starting "ha-212075-m03" control-plane node in "ha-212075" cluster

	I0429 12:49:21.266472  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:49:21.266506  870218 cache.go:56] Caching tarball of preloaded images

	I0429 12:49:21.266623  870218 preload.go:173] Found /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0429 12:49:21.266635  870218 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0429 12:49:21.266802  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:49:21.267040  870218 start.go:360] acquireMachinesLock for ha-212075-m03: {Name:mk2ade588bdb49db467a1dc12f643b97a2b1f5bb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0429 12:49:21.267097  870218 start.go:364] duration metric: took 32.398µs to acquireMachinesLock for "ha-212075-m03"

	I0429 12:49:21.267118  870218 start.go:93] Provisioning new machine with config: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dn

s:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimiz

ations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:49:21.267234  870218 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0429 12:49:21.268814  870218 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0429 12:49:21.268990  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:21.269033  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:21.286412  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43727

	I0429 12:49:21.286903  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:21.287420  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:21.287439  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:21.287775  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:21.288007  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:21.288192  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:21.288372  870218 start.go:159] libmachine.API.Create for "ha-212075" (driver="kvm2")

	I0429 12:49:21.288401  870218 client.go:168] LocalClient.Create starting

	I0429 12:49:21.288434  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem

	I0429 12:49:21.288469  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:49:21.288485  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:49:21.288542  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem

	I0429 12:49:21.288560  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:49:21.288570  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:49:21.288584  870218 main.go:141] libmachine: Running pre-create checks...

	I0429 12:49:21.288592  870218 main.go:141] libmachine: (ha-212075-m03) Calling .PreCreateCheck

	I0429 12:49:21.288811  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetConfigRaw

	I0429 12:49:21.289218  870218 main.go:141] libmachine: Creating machine...

	I0429 12:49:21.289234  870218 main.go:141] libmachine: (ha-212075-m03) Calling .Create

	I0429 12:49:21.289387  870218 main.go:141] libmachine: (ha-212075-m03) Creating KVM machine...

	I0429 12:49:21.291003  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found existing default KVM network

	I0429 12:49:21.291207  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found existing private KVM network mk-ha-212075

	I0429 12:49:21.291323  870218 main.go:141] libmachine: (ha-212075-m03) Setting up store path in /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03 ...

	I0429 12:49:21.291379  870218 main.go:141] libmachine: (ha-212075-m03) Building disk image from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0429 12:49:21.291474  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.291312  871030 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:49:21.291566  870218 main.go:141] libmachine: (ha-212075-m03) Downloading /home/jenkins/minikube-integration/18773-847310/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0429 12:49:21.553727  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.553607  871030 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa...

	I0429 12:49:21.655477  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.655312  871030 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/ha-212075-m03.rawdisk...

	I0429 12:49:21.655512  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Writing magic tar header

	I0429 12:49:21.655527  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Writing SSH key tar header

	I0429 12:49:21.655537  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.655481  871030 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03 ...

	I0429 12:49:21.655661  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03

	I0429 12:49:21.655697  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03 (perms=drwx------)

	I0429 12:49:21.655710  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines

	I0429 12:49:21.655734  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:49:21.655747  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310

	I0429 12:49:21.655763  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0429 12:49:21.655775  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins

	I0429 12:49:21.655790  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home

	I0429 12:49:21.655852  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Skipping /home - not owner

	I0429 12:49:21.655872  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines (perms=drwxr-xr-x)

	I0429 12:49:21.655886  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube (perms=drwxr-xr-x)

	I0429 12:49:21.655898  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310 (perms=drwxrwxr-x)

	I0429 12:49:21.655912  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0429 12:49:21.655924  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0429 12:49:21.655938  870218 main.go:141] libmachine: (ha-212075-m03) Creating domain...

	I0429 12:49:21.656952  870218 main.go:141] libmachine: (ha-212075-m03) define libvirt domain using xml: 

	I0429 12:49:21.656983  870218 main.go:141] libmachine: (ha-212075-m03) <domain type='kvm'>

	I0429 12:49:21.656994  870218 main.go:141] libmachine: (ha-212075-m03)   <name>ha-212075-m03</name>

	I0429 12:49:21.657006  870218 main.go:141] libmachine: (ha-212075-m03)   <memory unit='MiB'>2200</memory>

	I0429 12:49:21.657019  870218 main.go:141] libmachine: (ha-212075-m03)   <vcpu>2</vcpu>

	I0429 12:49:21.657028  870218 main.go:141] libmachine: (ha-212075-m03)   <features>

	I0429 12:49:21.657034  870218 main.go:141] libmachine: (ha-212075-m03)     <acpi/>

	I0429 12:49:21.657039  870218 main.go:141] libmachine: (ha-212075-m03)     <apic/>

	I0429 12:49:21.657044  870218 main.go:141] libmachine: (ha-212075-m03)     <pae/>

	I0429 12:49:21.657051  870218 main.go:141] libmachine: (ha-212075-m03)     

	I0429 12:49:21.657056  870218 main.go:141] libmachine: (ha-212075-m03)   </features>

	I0429 12:49:21.657061  870218 main.go:141] libmachine: (ha-212075-m03)   <cpu mode='host-passthrough'>

	I0429 12:49:21.657067  870218 main.go:141] libmachine: (ha-212075-m03)   

	I0429 12:49:21.657074  870218 main.go:141] libmachine: (ha-212075-m03)   </cpu>

	I0429 12:49:21.657079  870218 main.go:141] libmachine: (ha-212075-m03)   <os>

	I0429 12:49:21.657089  870218 main.go:141] libmachine: (ha-212075-m03)     <type>hvm</type>

	I0429 12:49:21.657129  870218 main.go:141] libmachine: (ha-212075-m03)     <boot dev='cdrom'/>

	I0429 12:49:21.657156  870218 main.go:141] libmachine: (ha-212075-m03)     <boot dev='hd'/>

	I0429 12:49:21.657169  870218 main.go:141] libmachine: (ha-212075-m03)     <bootmenu enable='no'/>

	I0429 12:49:21.657180  870218 main.go:141] libmachine: (ha-212075-m03)   </os>

	I0429 12:49:21.657189  870218 main.go:141] libmachine: (ha-212075-m03)   <devices>

	I0429 12:49:21.657203  870218 main.go:141] libmachine: (ha-212075-m03)     <disk type='file' device='cdrom'>

	I0429 12:49:21.657216  870218 main.go:141] libmachine: (ha-212075-m03)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/boot2docker.iso'/>

	I0429 12:49:21.657227  870218 main.go:141] libmachine: (ha-212075-m03)       <target dev='hdc' bus='scsi'/>

	I0429 12:49:21.657257  870218 main.go:141] libmachine: (ha-212075-m03)       <readonly/>

	I0429 12:49:21.657282  870218 main.go:141] libmachine: (ha-212075-m03)     </disk>

	I0429 12:49:21.657296  870218 main.go:141] libmachine: (ha-212075-m03)     <disk type='file' device='disk'>

	I0429 12:49:21.657306  870218 main.go:141] libmachine: (ha-212075-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0429 12:49:21.657320  870218 main.go:141] libmachine: (ha-212075-m03)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/ha-212075-m03.rawdisk'/>

	I0429 12:49:21.657333  870218 main.go:141] libmachine: (ha-212075-m03)       <target dev='hda' bus='virtio'/>

	I0429 12:49:21.657343  870218 main.go:141] libmachine: (ha-212075-m03)     </disk>

	I0429 12:49:21.657358  870218 main.go:141] libmachine: (ha-212075-m03)     <interface type='network'>

	I0429 12:49:21.657370  870218 main.go:141] libmachine: (ha-212075-m03)       <source network='mk-ha-212075'/>

	I0429 12:49:21.657382  870218 main.go:141] libmachine: (ha-212075-m03)       <model type='virtio'/>

	I0429 12:49:21.657395  870218 main.go:141] libmachine: (ha-212075-m03)     </interface>

	I0429 12:49:21.657403  870218 main.go:141] libmachine: (ha-212075-m03)     <interface type='network'>

	I0429 12:49:21.657410  870218 main.go:141] libmachine: (ha-212075-m03)       <source network='default'/>

	I0429 12:49:21.657425  870218 main.go:141] libmachine: (ha-212075-m03)       <model type='virtio'/>

	I0429 12:49:21.657438  870218 main.go:141] libmachine: (ha-212075-m03)     </interface>

	I0429 12:49:21.657446  870218 main.go:141] libmachine: (ha-212075-m03)     <serial type='pty'>

	I0429 12:49:21.657458  870218 main.go:141] libmachine: (ha-212075-m03)       <target port='0'/>

	I0429 12:49:21.657468  870218 main.go:141] libmachine: (ha-212075-m03)     </serial>

	I0429 12:49:21.657477  870218 main.go:141] libmachine: (ha-212075-m03)     <console type='pty'>

	I0429 12:49:21.657492  870218 main.go:141] libmachine: (ha-212075-m03)       <target type='serial' port='0'/>

	I0429 12:49:21.657504  870218 main.go:141] libmachine: (ha-212075-m03)     </console>

	I0429 12:49:21.657514  870218 main.go:141] libmachine: (ha-212075-m03)     <rng model='virtio'>

	I0429 12:49:21.657526  870218 main.go:141] libmachine: (ha-212075-m03)       <backend model='random'>/dev/random</backend>

	I0429 12:49:21.657536  870218 main.go:141] libmachine: (ha-212075-m03)     </rng>

	I0429 12:49:21.657548  870218 main.go:141] libmachine: (ha-212075-m03)     

	I0429 12:49:21.657555  870218 main.go:141] libmachine: (ha-212075-m03)     

	I0429 12:49:21.657562  870218 main.go:141] libmachine: (ha-212075-m03)   </devices>

	I0429 12:49:21.657571  870218 main.go:141] libmachine: (ha-212075-m03) </domain>

	I0429 12:49:21.657592  870218 main.go:141] libmachine: (ha-212075-m03) 

	I0429 12:49:21.666856  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:f8:63:70 in network default

	I0429 12:49:21.667717  870218 main.go:141] libmachine: (ha-212075-m03) Ensuring networks are active...

	I0429 12:49:21.667743  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:21.668658  870218 main.go:141] libmachine: (ha-212075-m03) Ensuring network default is active

	I0429 12:49:21.669085  870218 main.go:141] libmachine: (ha-212075-m03) Ensuring network mk-ha-212075 is active

	I0429 12:49:21.669490  870218 main.go:141] libmachine: (ha-212075-m03) Getting domain xml...

	I0429 12:49:21.670407  870218 main.go:141] libmachine: (ha-212075-m03) Creating domain...

	I0429 12:49:22.960796  870218 main.go:141] libmachine: (ha-212075-m03) Waiting to get IP...

	I0429 12:49:22.961597  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:22.962057  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:22.962099  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:22.962046  871030 retry.go:31] will retry after 275.195421ms: waiting for machine to come up

	I0429 12:49:23.238662  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:23.239199  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:23.239240  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:23.239147  871030 retry.go:31] will retry after 254.361022ms: waiting for machine to come up

	I0429 12:49:23.495797  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:23.496358  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:23.496391  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:23.496305  871030 retry.go:31] will retry after 399.111276ms: waiting for machine to come up

	I0429 12:49:23.897726  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:23.898280  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:23.898315  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:23.898236  871030 retry.go:31] will retry after 423.835443ms: waiting for machine to come up

	I0429 12:49:24.324377  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:24.324945  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:24.324974  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:24.324899  871030 retry.go:31] will retry after 676.971457ms: waiting for machine to come up

	I0429 12:49:25.003929  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:25.004292  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:25.004315  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:25.004262  871030 retry.go:31] will retry after 923.473252ms: waiting for machine to come up

	I0429 12:49:25.928825  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:25.929398  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:25.929436  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:25.929332  871030 retry.go:31] will retry after 855.800309ms: waiting for machine to come up

	I0429 12:49:26.786759  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:26.787218  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:26.787248  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:26.787181  871030 retry.go:31] will retry after 999.873188ms: waiting for machine to come up

	I0429 12:49:27.788564  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:27.789010  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:27.789035  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:27.788950  871030 retry.go:31] will retry after 1.830294576s: waiting for machine to come up

	I0429 12:49:29.622339  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:29.622964  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:29.623001  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:29.622895  871030 retry.go:31] will retry after 2.277621565s: waiting for machine to come up

	I0429 12:49:31.901933  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:31.902475  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:31.902524  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:31.902398  871030 retry.go:31] will retry after 2.203385625s: waiting for machine to come up

	I0429 12:49:34.108550  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:34.108982  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:34.109014  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:34.108936  871030 retry.go:31] will retry after 3.624223076s: waiting for machine to come up

	I0429 12:49:37.735007  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:37.735616  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:37.735646  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:37.735568  871030 retry.go:31] will retry after 4.166668795s: waiting for machine to come up

	I0429 12:49:41.903602  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:41.904123  870218 main.go:141] libmachine: (ha-212075-m03) Found IP for machine: 192.168.39.109

	I0429 12:49:41.904142  870218 main.go:141] libmachine: (ha-212075-m03) Reserving static IP address...

	I0429 12:49:41.904152  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has current primary IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:41.904544  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find host DHCP lease matching {name: "ha-212075-m03", mac: "52:54:00:1c:04:a1", ip: "192.168.39.109"} in network mk-ha-212075

	I0429 12:49:41.999071  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Getting to WaitForSSH function...

	I0429 12:49:41.999113  870218 main.go:141] libmachine: (ha-212075-m03) Reserved static IP address: 192.168.39.109

	I0429 12:49:41.999129  870218 main.go:141] libmachine: (ha-212075-m03) Waiting for SSH to be available...

	I0429 12:49:42.001885  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.002602  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.002632  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.002653  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Using SSH client type: external

	I0429 12:49:42.002666  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa (-rw-------)

	I0429 12:49:42.002696  870218 main.go:141] libmachine: (ha-212075-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.109 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 12:49:42.002710  870218 main.go:141] libmachine: (ha-212075-m03) DBG | About to run SSH command:

	I0429 12:49:42.002748  870218 main.go:141] libmachine: (ha-212075-m03) DBG | exit 0

	I0429 12:49:42.132018  870218 main.go:141] libmachine: (ha-212075-m03) DBG | SSH cmd err, output: <nil>: 

	I0429 12:49:42.132286  870218 main.go:141] libmachine: (ha-212075-m03) KVM machine creation complete!

	I0429 12:49:42.132639  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetConfigRaw

	I0429 12:49:42.133225  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:42.133438  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:42.133643  870218 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0429 12:49:42.133665  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:49:42.135130  870218 main.go:141] libmachine: Detecting operating system of created instance...

	I0429 12:49:42.135148  870218 main.go:141] libmachine: Waiting for SSH to be available...

	I0429 12:49:42.135157  870218 main.go:141] libmachine: Getting to WaitForSSH function...

	I0429 12:49:42.135168  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.137902  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.138260  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.138291  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.138462  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.138672  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.138886  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.139066  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.139259  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.139548  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.139562  870218 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0429 12:49:42.251331  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:49:42.251394  870218 main.go:141] libmachine: Detecting the provisioner...

	I0429 12:49:42.251407  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.255739  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.256325  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.256371  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.256822  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.257086  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.257291  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.257464  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.257701  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.257939  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.257959  870218 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0429 12:49:42.372811  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0429 12:49:42.372885  870218 main.go:141] libmachine: found compatible host: buildroot

	I0429 12:49:42.372892  870218 main.go:141] libmachine: Provisioning with buildroot...

	I0429 12:49:42.372902  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:42.373263  870218 buildroot.go:166] provisioning hostname "ha-212075-m03"

	I0429 12:49:42.373296  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:42.373540  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.376574  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.377111  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.377148  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.377277  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.377493  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.377667  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.377828  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.378048  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.378311  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.378330  870218 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-212075-m03 && echo "ha-212075-m03" | sudo tee /etc/hostname

	I0429 12:49:42.504636  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-212075-m03

	I0429 12:49:42.504679  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.507608  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.508004  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.508030  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.508303  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.508548  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.508754  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.508886  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.509117  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.509339  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.509357  870218 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-212075-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-212075-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-212075-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0429 12:49:42.626792  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:49:42.626829  870218 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18773-847310/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-847310/.minikube}

	I0429 12:49:42.626849  870218 buildroot.go:174] setting up certificates

	I0429 12:49:42.626863  870218 provision.go:84] configureAuth start

	I0429 12:49:42.626876  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:42.627259  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:42.630150  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.630519  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.630552  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.630703  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.633425  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.633770  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.633798  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.633925  870218 provision.go:143] copyHostCerts

	I0429 12:49:42.633964  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:49:42.634010  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem, removing ...

	I0429 12:49:42.634023  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:49:42.634119  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem (1078 bytes)

	I0429 12:49:42.634237  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:49:42.634263  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem, removing ...

	I0429 12:49:42.634273  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:49:42.634318  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem (1123 bytes)

	I0429 12:49:42.634403  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:49:42.634426  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem, removing ...

	I0429 12:49:42.634434  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:49:42.634467  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem (1679 bytes)

	I0429 12:49:42.634540  870218 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem org=jenkins.ha-212075-m03 san=[127.0.0.1 192.168.39.109 ha-212075-m03 localhost minikube]

	I0429 12:49:42.737197  870218 provision.go:177] copyRemoteCerts

	I0429 12:49:42.737263  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0429 12:49:42.737297  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.740003  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.740382  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.740442  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.740606  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.740806  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.740978  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.741155  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:42.827122  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0429 12:49:42.827206  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0429 12:49:42.855209  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0429 12:49:42.855317  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0429 12:49:42.883770  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0429 12:49:42.883851  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0429 12:49:42.911410  870218 provision.go:87] duration metric: took 284.528347ms to configureAuth

	I0429 12:49:42.911452  870218 buildroot.go:189] setting minikube options for container-runtime

	I0429 12:49:42.911733  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:42.911834  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.914793  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.915175  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.915208  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.915408  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.915653  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.915839  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.915991  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.916165  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.916385  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.916411  870218 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0429 12:49:43.217344  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0429 12:49:43.217385  870218 main.go:141] libmachine: Checking connection to Docker...

	I0429 12:49:43.217396  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetURL

	I0429 12:49:43.219000  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Using libvirt version 6000000

	I0429 12:49:43.221697  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.222061  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.222087  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.222270  870218 main.go:141] libmachine: Docker is up and running!

	I0429 12:49:43.222283  870218 main.go:141] libmachine: Reticulating splines...

	I0429 12:49:43.222291  870218 client.go:171] duration metric: took 21.933879944s to LocalClient.Create

	I0429 12:49:43.222314  870218 start.go:167] duration metric: took 21.933944364s to libmachine.API.Create "ha-212075"

	I0429 12:49:43.222324  870218 start.go:293] postStartSetup for "ha-212075-m03" (driver="kvm2")

	I0429 12:49:43.222335  870218 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0429 12:49:43.222370  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.222650  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0429 12:49:43.222690  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:43.225352  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.225819  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.225855  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.226068  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.226288  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.226485  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.226624  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:43.316706  870218 ssh_runner.go:195] Run: cat /etc/os-release

	I0429 12:49:43.321843  870218 info.go:137] Remote host: Buildroot 2023.02.9

	I0429 12:49:43.321882  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/addons for local assets ...

	I0429 12:49:43.321994  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/files for local assets ...

	I0429 12:49:43.322091  870218 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> 8546602.pem in /etc/ssl/certs

	I0429 12:49:43.322104  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /etc/ssl/certs/8546602.pem

	I0429 12:49:43.322368  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0429 12:49:43.334078  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:49:43.361992  870218 start.go:296] duration metric: took 139.649645ms for postStartSetup

	I0429 12:49:43.362063  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetConfigRaw

	I0429 12:49:43.362790  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:43.365832  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.366363  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.366399  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.366832  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:49:43.367146  870218 start.go:128] duration metric: took 22.099896004s to createHost

	I0429 12:49:43.367183  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:43.369765  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.370219  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.370248  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.370419  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.370666  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.370874  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.371071  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.371236  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:43.371460  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:43.371478  870218 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0429 12:49:43.485175  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714394983.453178524

	I0429 12:49:43.485209  870218 fix.go:216] guest clock: 1714394983.453178524

	I0429 12:49:43.485228  870218 fix.go:229] Guest: 2024-04-29 12:49:43.453178524 +0000 UTC Remote: 2024-04-29 12:49:43.367166051 +0000 UTC m=+152.742319003 (delta=86.012473ms)

	I0429 12:49:43.485253  870218 fix.go:200] guest clock delta is within tolerance: 86.012473ms

	I0429 12:49:43.485260  870218 start.go:83] releasing machines lock for "ha-212075-m03", held for 22.218152522s

	I0429 12:49:43.485292  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.485628  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:43.488595  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.489047  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.489074  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.491763  870218 out.go:177] * Found network options:

	I0429 12:49:43.493406  870218 out.go:177]   - NO_PROXY=192.168.39.97,192.168.39.36

	W0429 12:49:43.494652  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	W0429 12:49:43.494677  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:49:43.494698  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.495627  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.495861  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.496005  870218 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0429 12:49:43.496064  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	W0429 12:49:43.496177  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	W0429 12:49:43.496205  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:49:43.496282  870218 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0429 12:49:43.496308  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:43.499425  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.499745  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.499847  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.499903  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.500060  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.500281  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.500316  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.500332  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.500490  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.500615  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.500728  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.500799  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:43.500895  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.501079  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:43.745296  870218 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0429 12:49:43.753042  870218 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0429 12:49:43.753146  870218 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0429 12:49:43.771662  870218 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0429 12:49:43.771702  870218 start.go:494] detecting cgroup driver to use...

	I0429 12:49:43.771785  870218 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0429 12:49:43.789253  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0429 12:49:43.805629  870218 docker.go:217] disabling cri-docker service (if available) ...

	I0429 12:49:43.805716  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0429 12:49:43.823411  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0429 12:49:43.839119  870218 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0429 12:49:43.965205  870218 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0429 12:49:44.144532  870218 docker.go:233] disabling docker service ...

	I0429 12:49:44.144615  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0429 12:49:44.161598  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0429 12:49:44.176924  870218 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0429 12:49:44.318518  870218 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0429 12:49:44.444464  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0429 12:49:44.460146  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0429 12:49:44.482406  870218 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0429 12:49:44.482480  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.495415  870218 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0429 12:49:44.495495  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.507625  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.520065  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.532758  870218 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0429 12:49:44.545179  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.557185  870218 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.577205  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.590527  870218 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0429 12:49:44.601541  870218 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0429 12:49:44.601614  870218 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0429 12:49:44.618752  870218 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0429 12:49:44.630649  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:49:44.760043  870218 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0429 12:49:44.908104  870218 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0429 12:49:44.908203  870218 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0429 12:49:44.913590  870218 start.go:562] Will wait 60s for crictl version

	I0429 12:49:44.913671  870218 ssh_runner.go:195] Run: which crictl

	I0429 12:49:44.917832  870218 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0429 12:49:44.967004  870218 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0429 12:49:44.967123  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:49:45.000292  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:49:45.033598  870218 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0429 12:49:45.034927  870218 out.go:177]   - env NO_PROXY=192.168.39.97

	I0429 12:49:45.036448  870218 out.go:177]   - env NO_PROXY=192.168.39.97,192.168.39.36

	I0429 12:49:45.037641  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:45.040460  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:45.040872  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:45.040897  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:45.041102  870218 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0429 12:49:45.045938  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:49:45.060030  870218 mustload.go:65] Loading cluster: ha-212075

	I0429 12:49:45.060296  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:45.060651  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:45.060702  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:45.076464  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38675

	I0429 12:49:45.076966  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:45.077478  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:45.077508  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:45.077859  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:45.078069  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:49:45.079901  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:49:45.080243  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:45.080285  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:45.096699  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43045

	I0429 12:49:45.097237  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:45.097836  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:45.097862  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:45.098219  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:45.098405  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:49:45.098548  870218 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075 for IP: 192.168.39.109

	I0429 12:49:45.098562  870218 certs.go:194] generating shared ca certs ...

	I0429 12:49:45.098585  870218 certs.go:226] acquiring lock for ca certs: {Name:mk6be02e49d8ee7e457b7d9b7cd478c5e883ea66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:49:45.098756  870218 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key

	I0429 12:49:45.098808  870218 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key

	I0429 12:49:45.098823  870218 certs.go:256] generating profile certs ...

	I0429 12:49:45.098924  870218 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key

	I0429 12:49:45.098980  870218 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a

	I0429 12:49:45.099003  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.97 192.168.39.36 192.168.39.109 192.168.39.254]

	I0429 12:49:45.305371  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a ...

	I0429 12:49:45.305425  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a: {Name:mk17ce06665377b1ef8d805c47fa76e8dc7207f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:49:45.305633  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a ...

	I0429 12:49:45.305648  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a: {Name:mk93b7c74bfe26fde2277c8d3d88ed9da0ad319b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:49:45.305724  870218 certs.go:381] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt

	I0429 12:49:45.305871  870218 certs.go:385] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key

	I0429 12:49:45.306065  870218 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key

	I0429 12:49:45.306084  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0429 12:49:45.306097  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0429 12:49:45.306107  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0429 12:49:45.306122  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0429 12:49:45.306135  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0429 12:49:45.306148  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0429 12:49:45.306159  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0429 12:49:45.306177  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0429 12:49:45.306231  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem (1338 bytes)

	W0429 12:49:45.306261  870218 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660_empty.pem, impossibly tiny 0 bytes

	I0429 12:49:45.306271  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem (1679 bytes)

	I0429 12:49:45.306291  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem (1078 bytes)

	I0429 12:49:45.306311  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem (1123 bytes)

	I0429 12:49:45.306339  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem (1679 bytes)

	I0429 12:49:45.306382  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:49:45.306422  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem -> /usr/share/ca-certificates/854660.pem

	I0429 12:49:45.306443  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /usr/share/ca-certificates/8546602.pem

	I0429 12:49:45.306461  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:45.306505  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:49:45.310065  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:45.310591  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:49:45.310624  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:45.310800  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:49:45.311020  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:49:45.311175  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:49:45.311404  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:49:45.391809  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0429 12:49:45.398724  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0429 12:49:45.413103  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0429 12:49:45.418467  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)

	I0429 12:49:45.432802  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0429 12:49:45.440754  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0429 12:49:45.455596  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0429 12:49:45.461211  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0429 12:49:45.474952  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0429 12:49:45.480353  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0429 12:49:45.494613  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0429 12:49:45.500103  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0429 12:49:45.514344  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0429 12:49:45.543413  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0429 12:49:45.571376  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0429 12:49:45.599504  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0429 12:49:45.626755  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0429 12:49:45.654437  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0429 12:49:45.683324  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0429 12:49:45.711211  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0429 12:49:45.741014  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem --> /usr/share/ca-certificates/854660.pem (1338 bytes)

	I0429 12:49:45.771670  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /usr/share/ca-certificates/8546602.pem (1708 bytes)

	I0429 12:49:45.799792  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0429 12:49:45.827179  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0429 12:49:45.846410  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)

	I0429 12:49:45.865742  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0429 12:49:45.884880  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0429 12:49:45.906579  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0429 12:49:45.934587  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0429 12:49:45.954505  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0429 12:49:45.975997  870218 ssh_runner.go:195] Run: openssl version

	I0429 12:49:45.982992  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/854660.pem && ln -fs /usr/share/ca-certificates/854660.pem /etc/ssl/certs/854660.pem"

	I0429 12:49:45.997527  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/854660.pem

	I0429 12:49:46.003152  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 12:39 /usr/share/ca-certificates/854660.pem

	I0429 12:49:46.003236  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/854660.pem

	I0429 12:49:46.010012  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/854660.pem /etc/ssl/certs/51391683.0"

	I0429 12:49:46.023112  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8546602.pem && ln -fs /usr/share/ca-certificates/8546602.pem /etc/ssl/certs/8546602.pem"

	I0429 12:49:46.036215  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8546602.pem

	I0429 12:49:46.041157  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 12:39 /usr/share/ca-certificates/8546602.pem

	I0429 12:49:46.041267  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8546602.pem

	I0429 12:49:46.047620  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8546602.pem /etc/ssl/certs/3ec20f2e.0"

	I0429 12:49:46.060305  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0429 12:49:46.073926  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:46.079569  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:59 /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:46.079679  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:46.086524  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0429 12:49:46.099843  870218 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0429 12:49:46.105249  870218 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0429 12:49:46.105323  870218 kubeadm.go:928] updating node {m03 192.168.39.109 8443 v1.30.0 crio true true} ...

	I0429 12:49:46.105422  870218 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-212075-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.109

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0429 12:49:46.105448  870218 kube-vip.go:111] generating kube-vip config ...

	I0429 12:49:46.105491  870218 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0429 12:49:46.128538  870218 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0429 12:49:46.128670  870218 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0429 12:49:46.128781  870218 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0429 12:49:46.141116  870218 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0429 12:49:46.141207  870218 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0429 12:49:46.154231  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256

	I0429 12:49:46.154250  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256

	I0429 12:49:46.154278  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:49:46.154231  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0429 12:49:46.154301  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:49:46.154310  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:49:46.154344  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:49:46.154399  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:49:46.167622  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0429 12:49:46.167674  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0429 12:49:46.183740  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:49:46.183810  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0429 12:49:46.183852  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0429 12:49:46.183861  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:49:46.248362  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0429 12:49:46.248422  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0429 12:49:47.245635  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0429 12:49:47.257815  870218 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0429 12:49:47.279835  870218 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0429 12:49:47.302241  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0429 12:49:47.321197  870218 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0429 12:49:47.325960  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:49:47.340454  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:49:47.476126  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:49:47.495980  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:49:47.496376  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:47.496420  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:47.513164  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36255

	I0429 12:49:47.513691  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:47.514330  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:47.514356  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:47.514754  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:47.514985  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:49:47.515150  870218 start.go:316] joinCluster: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false in

spektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fal

se DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 12:49:47.515340  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0429 12:49:47.515385  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:49:47.518988  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:47.519544  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:49:47.519582  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:47.519819  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:49:47.520072  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:49:47.520249  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:49:47.520432  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:49:47.723515  870218 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:49:47.723578  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token vnojfi.4shmv2la5ipmuekk --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m03 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443"

	I0429 12:50:11.558514  870218 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token vnojfi.4shmv2la5ipmuekk --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m03 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443": (23.834907661s)

	I0429 12:50:11.558556  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0429 12:50:12.191163  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-212075-m03 minikube.k8s.io/updated_at=2024_04_29T12_50_12_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332 minikube.k8s.io/name=ha-212075 minikube.k8s.io/primary=false

	I0429 12:50:12.332310  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-212075-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0429 12:50:12.457983  870218 start.go:318] duration metric: took 24.942805115s to joinCluster

	I0429 12:50:12.458080  870218 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:50:12.459647  870218 out.go:177] * Verifying Kubernetes components...

	I0429 12:50:12.458462  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:50:12.460883  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:50:12.786218  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:50:12.827610  870218 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:50:12.827947  870218 kapi.go:59] client config for ha-212075: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt", KeyFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key", CAFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0429 12:50:12.828022  870218 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.97:8443

	I0429 12:50:12.828333  870218 node_ready.go:35] waiting up to 6m0s for node "ha-212075-m03" to be "Ready" ...

	I0429 12:50:12.828437  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:12.828446  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:12.828457  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:12.828466  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:12.832030  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:13.328972  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:13.329002  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:13.329012  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:13.329016  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:13.333488  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:13.829280  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:13.829310  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:13.829317  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:13.829321  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:13.833464  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:14.328604  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:14.328634  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:14.328647  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:14.328654  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:14.332954  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:14.829170  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:14.829194  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:14.829202  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:14.829206  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:14.833857  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:14.834791  870218 node_ready.go:53] node "ha-212075-m03" has status "Ready":"False"

	I0429 12:50:15.329188  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:15.329215  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:15.329224  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:15.329228  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:15.333208  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:15.829111  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:15.829145  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:15.829156  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:15.829162  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:15.833305  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:16.328929  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:16.328964  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:16.328977  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:16.328983  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:16.332860  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:16.828885  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:16.828914  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:16.828923  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:16.828928  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:16.832858  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:17.328914  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:17.328949  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:17.328960  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:17.328966  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:17.333213  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:17.334349  870218 node_ready.go:53] node "ha-212075-m03" has status "Ready":"False"

	I0429 12:50:17.828574  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:17.828607  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:17.828618  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:17.828622  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:17.833207  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:18.329374  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:18.329402  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.329410  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.329415  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.333316  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.828563  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:18.828591  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.828600  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.828603  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.833296  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:18.833938  870218 node_ready.go:49] node "ha-212075-m03" has status "Ready":"True"

	I0429 12:50:18.833966  870218 node_ready.go:38] duration metric: took 6.005614001s for node "ha-212075-m03" to be "Ready" ...

	I0429 12:50:18.833976  870218 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:50:18.834052  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:18.834061  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.834069  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.834076  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.848836  870218 round_trippers.go:574] Response Status: 200 OK in 14 milliseconds

	I0429 12:50:18.858243  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.858371  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-c2t8g

	I0429 12:50:18.858382  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.858395  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.858405  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.861615  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.862314  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:18.862334  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.862342  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.862347  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.865782  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.866457  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.866479  870218 pod_ready.go:81] duration metric: took 8.200804ms for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.866490  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.866552  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-x299s

	I0429 12:50:18.866560  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.866567  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.866572  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.870040  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.870670  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:18.870686  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.870696  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.870702  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.874007  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.874553  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.874575  870218 pod_ready.go:81] duration metric: took 8.079218ms for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.874586  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.874655  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075

	I0429 12:50:18.874665  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.874674  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.874680  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.878665  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.879434  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:18.879460  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.879471  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.879478  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.882752  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.883423  870218 pod_ready.go:92] pod "etcd-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.883447  870218 pod_ready.go:81] duration metric: took 8.854916ms for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.883459  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.883533  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:50:18.883540  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.883548  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.883553  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.886433  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:50:18.887117  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:18.887135  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.887143  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.887147  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.889866  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:50:18.890552  870218 pod_ready.go:92] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.890577  870218 pod_ready.go:81] duration metric: took 7.108063ms for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.890591  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:19.028989  870218 request.go:629] Waited for 138.314405ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.029067  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.029072  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.029080  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.029085  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.032924  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.229133  870218 request.go:629] Waited for 195.395298ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.229202  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.229207  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.229217  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.229220  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.232853  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.428983  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.429028  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.429039  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.429044  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.432974  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.629442  870218 request.go:629] Waited for 195.37277ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.629530  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.629538  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.629547  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.629554  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.633456  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.891393  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.891419  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.891429  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.891433  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.895758  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:20.028865  870218 request.go:629] Waited for 132.326326ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.028930  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.028936  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.028944  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.028948  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.032892  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.390899  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:20.390924  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.390932  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.390936  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.394598  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.428843  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.428894  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.428908  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.428916  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.432578  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.891566  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:20.891605  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.891617  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.891624  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.895968  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:20.896842  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.896866  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.896880  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.896885  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.900749  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.901250  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:21.391390  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:21.391422  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.391432  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.391437  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.395486  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:21.396301  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:21.396323  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.396333  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.396337  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.399629  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:21.891709  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:21.891737  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.891746  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.891751  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.895525  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:21.896515  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:21.896534  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.896544  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.896549  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.899591  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:22.391086  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:22.391120  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.391129  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.391134  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.395272  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:22.396260  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:22.396280  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.396292  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.396298  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.399934  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:22.891706  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:22.891741  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.891754  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.891762  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.895857  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:22.896485  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:22.896507  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.896518  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.896524  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.899783  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:23.391764  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:23.391802  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.391813  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.391819  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.396591  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:23.397678  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:23.397697  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.397706  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.397712  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.401022  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:23.401638  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:23.891473  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:23.891518  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.891527  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.891531  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.895998  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:23.897166  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:23.897188  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.897198  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.897203  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.900834  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.391767  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:24.391793  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.391801  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.391806  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.395683  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.396364  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:24.396382  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.396390  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.396394  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.399833  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.890825  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:24.890853  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.890862  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.890866  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.894777  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.895773  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:24.895795  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.895803  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.895807  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.899690  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.391837  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:25.391877  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.391890  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.391897  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.395911  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.396638  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:25.396658  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.396667  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.396672  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.400113  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.890897  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:25.890925  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.890933  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.890937  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.894971  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:25.895752  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:25.895776  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.895786  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.895792  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.899327  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.900011  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:26.391728  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:26.391755  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.391766  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.391771  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.395868  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:26.396629  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:26.396652  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.396659  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.396662  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.399977  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:26.890872  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:26.890906  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.890916  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.890921  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.894973  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:26.895971  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:26.895993  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.896002  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.896005  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.899197  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:27.390790  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:27.390819  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.390828  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.390832  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.395080  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:27.396304  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:27.396327  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.396340  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.396345  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.399685  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:27.891328  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:27.891383  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.891396  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.891408  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.895963  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:27.896759  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:27.896777  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.896785  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.896789  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.900307  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:27.900827  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:28.391176  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:28.391206  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.391214  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.391219  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.395304  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:28.396189  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:28.396216  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.396228  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.396234  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.399510  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.891313  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:28.891343  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.891351  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.891368  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.896027  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:28.897004  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:28.897024  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.897033  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.897037  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.900096  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.900611  870218 pod_ready.go:92] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.900634  870218 pod_ready.go:81] duration metric: took 10.01003378s for pod "etcd-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.900658  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.900736  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075

	I0429 12:50:28.900748  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.900759  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.900772  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.904062  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.905012  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:28.905033  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.905041  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.905046  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.914390  870218 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0429 12:50:28.915162  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.915184  870218 pod_ready.go:81] duration metric: took 14.517505ms for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.915206  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.915288  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075-m02

	I0429 12:50:28.915299  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.915310  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.915316  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.918801  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.919480  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:28.919499  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.919511  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.919518  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.925028  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:50:28.925481  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.925502  870218 pod_ready.go:81] duration metric: took 10.2876ms for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.925512  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.925600  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075-m03

	I0429 12:50:28.925609  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.925617  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.925622  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.930192  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:28.930899  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:28.930923  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.930934  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.930939  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.936104  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:50:28.936664  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.936690  870218 pod_ready.go:81] duration metric: took 11.171571ms for pod "kube-apiserver-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.936706  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.936798  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075

	I0429 12:50:28.936813  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.936821  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.936825  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.945481  870218 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 12:50:28.946622  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:28.946652  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.946664  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.946671  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.950691  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.951321  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.951353  870218 pod_ready.go:81] duration metric: took 14.638423ms for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.951391  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.091822  870218 request.go:629] Waited for 140.318624ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m02

	I0429 12:50:29.091900  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m02

	I0429 12:50:29.091906  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.091914  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.091922  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.096036  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:29.292235  870218 request.go:629] Waited for 195.433606ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:29.292308  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:29.292313  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.292320  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.292327  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.296173  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:29.296828  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:29.296855  870218 pod_ready.go:81] duration metric: took 345.456965ms for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.296868  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.491886  870218 request.go:629] Waited for 194.903497ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m03

	I0429 12:50:29.491968  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m03

	I0429 12:50:29.491976  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.491987  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.491995  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.497776  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:50:29.691599  870218 request.go:629] Waited for 192.371637ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:29.691712  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:29.691717  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.691726  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.691731  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.695802  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:29.696538  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:29.696564  870218 pod_ready.go:81] duration metric: took 399.690214ms for pod "kube-controller-manager-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.696579  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-c27wn" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.892095  870218 request.go:629] Waited for 195.391435ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-c27wn

	I0429 12:50:29.892181  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-c27wn

	I0429 12:50:29.892188  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.892199  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.892207  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.896134  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:30.092329  870218 request.go:629] Waited for 195.502679ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:30.092433  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:30.092441  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.092452  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.092459  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.096200  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:30.096729  870218 pod_ready.go:92] pod "kube-proxy-c27wn" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:30.096753  870218 pod_ready.go:81] duration metric: took 400.166366ms for pod "kube-proxy-c27wn" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.096765  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.291287  870218 request.go:629] Waited for 194.439552ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:50:30.291447  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:50:30.291461  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.291474  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.291485  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.297628  870218 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 12:50:30.492144  870218 request.go:629] Waited for 193.412376ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:30.492229  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:30.492248  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.492260  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.492268  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.496334  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:30.496860  870218 pod_ready.go:92] pod "kube-proxy-ncdsk" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:30.496885  870218 pod_ready.go:81] duration metric: took 400.112924ms for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.496899  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.691664  870218 request.go:629] Waited for 194.681632ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:50:30.692181  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:50:30.692198  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.692210  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.692215  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.696295  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:30.891291  870218 request.go:629] Waited for 194.303719ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:30.891444  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:30.891459  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.891470  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.891477  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.895385  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:30.896331  870218 pod_ready.go:92] pod "kube-proxy-sfmhh" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:30.896364  870218 pod_ready.go:81] duration metric: took 399.456713ms for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.896378  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.092314  870218 request.go:629] Waited for 195.838169ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:50:31.092382  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:50:31.092387  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.092395  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.092403  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.096642  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:31.291736  870218 request.go:629] Waited for 194.40661ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:31.291832  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:31.291839  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.291847  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.291853  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.295531  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:31.296465  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:31.296496  870218 pod_ready.go:81] duration metric: took 400.108799ms for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.296513  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.491925  870218 request.go:629] Waited for 195.318095ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:50:31.491999  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:50:31.492008  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.492016  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.492029  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.496031  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:31.692069  870218 request.go:629] Waited for 195.409831ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:31.692136  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:31.692141  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.692149  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.692154  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.696368  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:31.697106  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:31.697129  870218 pod_ready.go:81] duration metric: took 400.605212ms for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.697143  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.891352  870218 request.go:629] Waited for 194.092342ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m03

	I0429 12:50:31.891478  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m03

	I0429 12:50:31.891491  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.891503  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.891512  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.895522  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:32.091710  870218 request.go:629] Waited for 195.413817ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:32.091787  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:32.091792  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.091801  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.091806  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.095880  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:32.096637  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:32.096661  870218 pod_ready.go:81] duration metric: took 399.509578ms for pod "kube-scheduler-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:32.096673  870218 pod_ready.go:38] duration metric: took 13.262684539s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:50:32.096690  870218 api_server.go:52] waiting for apiserver process to appear ...

	I0429 12:50:32.096751  870218 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:50:32.117800  870218 api_server.go:72] duration metric: took 19.659670409s to wait for apiserver process to appear ...

	I0429 12:50:32.117840  870218 api_server.go:88] waiting for apiserver healthz status ...

	I0429 12:50:32.117869  870218 api_server.go:253] Checking apiserver healthz at https://192.168.39.97:8443/healthz ...

	I0429 12:50:32.123543  870218 api_server.go:279] https://192.168.39.97:8443/healthz returned 200:

	ok

	I0429 12:50:32.123629  870218 round_trippers.go:463] GET https://192.168.39.97:8443/version

	I0429 12:50:32.123638  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.123645  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.123653  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.124638  870218 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0429 12:50:32.124714  870218 api_server.go:141] control plane version: v1.30.0

	I0429 12:50:32.124735  870218 api_server.go:131] duration metric: took 6.886333ms to wait for apiserver health ...

	I0429 12:50:32.124744  870218 system_pods.go:43] waiting for kube-system pods to appear ...

	I0429 12:50:32.292129  870218 request.go:629] Waited for 167.303987ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.292211  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.292216  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.292224  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.292230  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.299499  870218 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 12:50:32.306492  870218 system_pods.go:59] 24 kube-system pods found

	I0429 12:50:32.306546  870218 system_pods.go:61] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:50:32.306553  870218 system_pods.go:61] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:50:32.306559  870218 system_pods.go:61] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:50:32.306564  870218 system_pods.go:61] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:50:32.306569  870218 system_pods.go:61] "etcd-ha-212075-m03" [92f8e094-a516-4426-a1c5-5f92d2022603] Running

	I0429 12:50:32.306575  870218 system_pods.go:61] "kindnet-2d8zp" [43b594a8-818d-423a-80f3-ad2b5dc79785] Running

	I0429 12:50:32.306579  870218 system_pods.go:61] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:50:32.306584  870218 system_pods.go:61] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:50:32.306591  870218 system_pods.go:61] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:50:32.306596  870218 system_pods.go:61] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:50:32.306600  870218 system_pods.go:61] "kube-apiserver-ha-212075-m03" [7484f88d-78bb-486c-9bc7-71c2a779083b] Running

	I0429 12:50:32.306605  870218 system_pods.go:61] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:50:32.306611  870218 system_pods.go:61] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:50:32.306620  870218 system_pods.go:61] "kube-controller-manager-ha-212075-m03" [94aae029-f109-447d-8080-4f41c99b4dbb] Running

	I0429 12:50:32.306626  870218 system_pods.go:61] "kube-proxy-c27wn" [c45c40a2-2b5d-495f-862a-9e54d6fd6a69] Running

	I0429 12:50:32.306634  870218 system_pods.go:61] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:50:32.306639  870218 system_pods.go:61] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:50:32.306647  870218 system_pods.go:61] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:50:32.306652  870218 system_pods.go:61] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:50:32.306660  870218 system_pods.go:61] "kube-scheduler-ha-212075-m03" [0029c03a-f2cd-4964-a1f9-71127fc72819] Running

	I0429 12:50:32.306665  870218 system_pods.go:61] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:50:32.306674  870218 system_pods.go:61] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:50:32.306678  870218 system_pods.go:61] "kube-vip-ha-212075-m03" [68d29842-0ac7-4c12-a12c-546a42040bb2] Running

	I0429 12:50:32.306685  870218 system_pods.go:61] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:50:32.306694  870218 system_pods.go:74] duration metric: took 181.939437ms to wait for pod list to return data ...

	I0429 12:50:32.306709  870218 default_sa.go:34] waiting for default service account to be created ...

	I0429 12:50:32.491873  870218 request.go:629] Waited for 185.06023ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:50:32.491951  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:50:32.491957  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.491964  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.491970  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.496044  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:32.496184  870218 default_sa.go:45] found service account: "default"

	I0429 12:50:32.496202  870218 default_sa.go:55] duration metric: took 189.48187ms for default service account to be created ...

	I0429 12:50:32.496212  870218 system_pods.go:116] waiting for k8s-apps to be running ...

	I0429 12:50:32.692200  870218 request.go:629] Waited for 195.908867ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.692277  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.692285  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.692298  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.692309  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.700260  870218 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 12:50:32.707846  870218 system_pods.go:86] 24 kube-system pods found

	I0429 12:50:32.707891  870218 system_pods.go:89] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:50:32.707906  870218 system_pods.go:89] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:50:32.707913  870218 system_pods.go:89] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:50:32.707920  870218 system_pods.go:89] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:50:32.707927  870218 system_pods.go:89] "etcd-ha-212075-m03" [92f8e094-a516-4426-a1c5-5f92d2022603] Running

	I0429 12:50:32.707934  870218 system_pods.go:89] "kindnet-2d8zp" [43b594a8-818d-423a-80f3-ad2b5dc79785] Running

	I0429 12:50:32.707943  870218 system_pods.go:89] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:50:32.707953  870218 system_pods.go:89] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:50:32.707960  870218 system_pods.go:89] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:50:32.707970  870218 system_pods.go:89] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:50:32.707977  870218 system_pods.go:89] "kube-apiserver-ha-212075-m03" [7484f88d-78bb-486c-9bc7-71c2a779083b] Running

	I0429 12:50:32.707984  870218 system_pods.go:89] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:50:32.707997  870218 system_pods.go:89] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:50:32.708007  870218 system_pods.go:89] "kube-controller-manager-ha-212075-m03" [94aae029-f109-447d-8080-4f41c99b4dbb] Running

	I0429 12:50:32.708014  870218 system_pods.go:89] "kube-proxy-c27wn" [c45c40a2-2b5d-495f-862a-9e54d6fd6a69] Running

	I0429 12:50:32.708023  870218 system_pods.go:89] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:50:32.708037  870218 system_pods.go:89] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:50:32.708043  870218 system_pods.go:89] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:50:32.708049  870218 system_pods.go:89] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:50:32.708055  870218 system_pods.go:89] "kube-scheduler-ha-212075-m03" [0029c03a-f2cd-4964-a1f9-71127fc72819] Running

	I0429 12:50:32.708062  870218 system_pods.go:89] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:50:32.708071  870218 system_pods.go:89] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:50:32.708077  870218 system_pods.go:89] "kube-vip-ha-212075-m03" [68d29842-0ac7-4c12-a12c-546a42040bb2] Running

	I0429 12:50:32.708087  870218 system_pods.go:89] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:50:32.708096  870218 system_pods.go:126] duration metric: took 211.875538ms to wait for k8s-apps to be running ...

	I0429 12:50:32.708108  870218 system_svc.go:44] waiting for kubelet service to be running ....

	I0429 12:50:32.708158  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:50:32.729023  870218 system_svc.go:56] duration metric: took 20.905519ms WaitForService to wait for kubelet

	I0429 12:50:32.729060  870218 kubeadm.go:576] duration metric: took 20.270939588s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 12:50:32.729082  870218 node_conditions.go:102] verifying NodePressure condition ...

	I0429 12:50:32.891459  870218 request.go:629] Waited for 162.285599ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes

	I0429 12:50:32.891529  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes

	I0429 12:50:32.891542  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.891550  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.891556  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.895591  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:32.896692  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:50:32.896723  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:50:32.896738  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:50:32.896743  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:50:32.896748  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:50:32.896752  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:50:32.896757  870218 node_conditions.go:105] duration metric: took 167.669117ms to run NodePressure ...

	I0429 12:50:32.896775  870218 start.go:240] waiting for startup goroutines ...

	I0429 12:50:32.896808  870218 start.go:254] writing updated cluster config ...

	I0429 12:50:32.897223  870218 ssh_runner.go:195] Run: rm -f paused

	I0429 12:50:32.955697  870218 start.go:600] kubectl: 1.30.0, cluster: 1.30.0 (minor skew: 0)

	I0429 12:50:32.958387  870218 out.go:177] * Done! kubectl is now configured to use "ha-212075" cluster and "default" namespace by default

	==> CRI-O <==

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.428404012Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395244428378484,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=cdf9f5f0-1872-453a-b843-b1a89c6e8a1d name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.429025092Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=037687d1-52c8-483a-9f32-19811fe3d08a name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.429089790Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=037687d1-52c8-483a-9f32-19811fe3d08a name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.429330687Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=037687d1-52c8-483a-9f32-19811fe3d08a name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.473939901Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=cfd173d5-5b44-44d9-a7d6-8446249da2e1 name=/runtime.v1.RuntimeService/Version

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.474047188Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=cfd173d5-5b44-44d9-a7d6-8446249da2e1 name=/runtime.v1.RuntimeService/Version

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.475548063Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=cf7916bc-3786-475c-a961-b5f23b1cb128 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.476141506Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395244476113056,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=cf7916bc-3786-475c-a961-b5f23b1cb128 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.476942710Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=ea8ef6bc-df90-49c1-b96a-127e84cb4cac name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.477020283Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=ea8ef6bc-df90-49c1-b96a-127e84cb4cac name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.477259287Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=ea8ef6bc-df90-49c1-b96a-127e84cb4cac name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.517733035Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=35bddc26-5847-439d-9630-8e3946439fbb name=/runtime.v1.RuntimeService/Version

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.517809098Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=35bddc26-5847-439d-9630-8e3946439fbb name=/runtime.v1.RuntimeService/Version

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.519149178Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=5819a106-ffa0-4297-b4e6-f607697f3990 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.519597994Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395244519573279,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=5819a106-ffa0-4297-b4e6-f607697f3990 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.520153327Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=a734fb19-2ab9-4ef8-9a79-5fb51b5161a4 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.520229355Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=a734fb19-2ab9-4ef8-9a79-5fb51b5161a4 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.520515885Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=a734fb19-2ab9-4ef8-9a79-5fb51b5161a4 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.561514037Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=21cc57d4-5cdf-49f1-817d-2207a1190ac2 name=/runtime.v1.RuntimeService/Version

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.561614768Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=21cc57d4-5cdf-49f1-817d-2207a1190ac2 name=/runtime.v1.RuntimeService/Version

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.563510448Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=5dbb8700-dd6b-4851-8e15-1712a7500fee name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.564235290Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395244564205931,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=5dbb8700-dd6b-4851-8e15-1712a7500fee name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.564924511Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=fd5e2c8d-d324-4f48-89cd-d449d8426998 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.565008451Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=fd5e2c8d-d324-4f48-89cd-d449d8426998 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:54:04 ha-212075 crio[678]: time="2024-04-29 12:54:04.565308146Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=fd5e2c8d-d324-4f48-89cd-d449d8426998 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	6079fd69c4d07       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   377fa41dd93a5       busybox-fc5497c4f-rcq9m

	8923eb9969f74       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      5 minutes ago       Running             coredns                   0                   e0bec542cd689       coredns-7db6d8ff4d-c2t8g

	a7bedc2be5698       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      5 minutes ago       Running             coredns                   0                   cb2c23b3b3b1c       coredns-7db6d8ff4d-x299s

	7101dd3def458       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      5 minutes ago       Running             storage-provisioner       0                   77a1ef53b73e0       storage-provisioner

	85ad5484c2e54       4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5                                      5 minutes ago       Running             kindnet-cni               0                   8f85b8a4ba604       kindnet-vnw75

	ae027e60b2a1e       a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b                                      5 minutes ago       Running             kube-proxy                0                   84bca27dac841       kube-proxy-ncdsk

	0c3dc33eb6d5d       ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a     6 minutes ago       Running             kube-vip                  0                   13efcdd103317       kube-vip-ha-212075

	220538e592762       259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced                                      6 minutes ago       Running             kube-scheduler            0                   258b9f1c2d733       kube-scheduler-ha-212075

	382081d5ba19b       c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b                                      6 minutes ago       Running             kube-controller-manager   0                   87588649b2c79       kube-controller-manager-ha-212075

	e9f8269450f85       c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0                                      6 minutes ago       Running             kube-apiserver            0                   f21fd4330dda0       kube-apiserver-ha-212075

	6ba91c742f08c       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      6 minutes ago       Running             etcd                      0                   814df27c007a6       etcd-ha-212075

	==> coredns [8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad] <==

	[INFO] 10.244.1.2:38828 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000298968s

	[INFO] 10.244.1.2:58272 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000274219s

	[INFO] 10.244.1.2:41537 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000154361s

	[INFO] 10.244.1.2:51430 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000167101s

	[INFO] 10.244.0.4:39294 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002366491s

	[INFO] 10.244.0.4:47691 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000095562s

	[INFO] 10.244.0.4:49991 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000146136s

	[INFO] 10.244.0.4:45880 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000133788s

	[INFO] 10.244.2.2:40297 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00017628s

	[INFO] 10.244.2.2:44282 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001974026s

	[INFO] 10.244.2.2:48058 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000199321s

	[INFO] 10.244.2.2:50097 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000220995s

	[INFO] 10.244.2.2:60877 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000132114s

	[INFO] 10.244.2.2:38824 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000114121s

	[INFO] 10.244.1.2:60691 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000192262s

	[INFO] 10.244.1.2:51664 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000123427s

	[INFO] 10.244.1.2:57326 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000156295s

	[INFO] 10.244.0.4:51093 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000105493s

	[INFO] 10.244.0.4:39454 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000248959s

	[INFO] 10.244.2.2:56559 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00010789s

	[INFO] 10.244.1.2:57860 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144445s

	[INFO] 10.244.1.2:40470 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000145332s

	[INFO] 10.244.0.4:35067 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000124783s

	[INFO] 10.244.2.2:47889 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000150138s

	[INFO] 10.244.2.2:60310 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000091159s

	==> coredns [a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6] <==

	[INFO] 10.244.2.2:49673 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.00011362s

	[INFO] 10.244.2.2:52287 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001865115s

	[INFO] 10.244.1.2:45655 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.028655691s

	[INFO] 10.244.1.2:34986 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000171925s

	[INFO] 10.244.1.2:48145 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003370523s

	[INFO] 10.244.1.2:43604 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000158954s

	[INFO] 10.244.0.4:58453 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000127934s

	[INFO] 10.244.0.4:52484 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001277738s

	[INFO] 10.244.0.4:47770 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000128102s

	[INFO] 10.244.0.4:53060 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000103039s

	[INFO] 10.244.2.2:55991 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001854135s

	[INFO] 10.244.2.2:33533 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090157s

	[INFO] 10.244.1.2:52893 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090867s

	[INFO] 10.244.0.4:54479 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000102901s

	[INFO] 10.244.0.4:53525 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000359828s

	[INFO] 10.244.2.2:57755 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000264423s

	[INFO] 10.244.2.2:47852 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000118616s

	[INFO] 10.244.2.2:38289 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000112347s

	[INFO] 10.244.1.2:55092 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000184788s

	[INFO] 10.244.1.2:52235 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000146353s

	[INFO] 10.244.0.4:55598 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000137209s

	[INFO] 10.244.0.4:54649 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000121493s

	[INFO] 10.244.0.4:50694 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000136791s

	[INFO] 10.244.2.2:49177 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000104896s

	[INFO] 10.244.2.2:41037 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000088839s

	==> describe nodes <==

	Name:               ha-212075

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_04_29T12_47_54_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:47:50 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:54:00 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:47:49 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:47:49 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:47:49 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:48:09 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.97

	  Hostname:    ha-212075

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 eefe9cc034f74464a919edd5f6b61c2b

	  System UUID:                eefe9cc0-34f7-4464-a919-edd5f6b61c2b

	  Boot ID:                    20b6e47d-4696-4b2a-ba7c-62e73184f5c7

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-rcq9m              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m31s

	  kube-system                 coredns-7db6d8ff4d-c2t8g             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     5m57s

	  kube-system                 coredns-7db6d8ff4d-x299s             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     5m57s

	  kube-system                 etcd-ha-212075                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m11s

	  kube-system                 kindnet-vnw75                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      5m58s

	  kube-system                 kube-apiserver-ha-212075             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m11s

	  kube-system                 kube-controller-manager-ha-212075    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m11s

	  kube-system                 kube-proxy-ncdsk                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m58s

	  kube-system                 kube-scheduler-ha-212075             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m13s

	  kube-system                 kube-vip-ha-212075                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m13s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m56s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m56s                  kube-proxy       

	  Normal  Starting                 6m19s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientPID     6m18s (x7 over 6m18s)  kubelet          Node ha-212075 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  6m18s (x8 over 6m18s)  kubelet          Node ha-212075 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m18s (x8 over 6m18s)  kubelet          Node ha-212075 status is now: NodeHasNoDiskPressure

	  Normal  NodeAllocatableEnforced  6m18s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 6m11s                  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m11s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m11s                  kubelet          Node ha-212075 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m11s                  kubelet          Node ha-212075 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m11s                  kubelet          Node ha-212075 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           5m58s                  node-controller  Node ha-212075 event: Registered Node ha-212075 in Controller

	  Normal  NodeReady                5m55s                  kubelet          Node ha-212075 status is now: NodeReady

	  Normal  RegisteredNode           4m47s                  node-controller  Node ha-212075 event: Registered Node ha-212075 in Controller

	  Normal  RegisteredNode           3m37s                  node-controller  Node ha-212075 event: Registered Node ha-212075 in Controller

	Name:               ha-212075-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T12_49_02_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:48:58 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:51:42 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.36

	  Hostname:    ha-212075-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 088c5f79339047d6aaf2c88397c97942

	  System UUID:                088c5f79-3390-47d6-aaf2-c88397c97942

	  Boot ID:                    26514912-b71e-458e-b679-e7e1ba2580cb

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-9q8rf                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m31s

	  kube-system                 etcd-ha-212075-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         5m5s

	  kube-system                 kindnet-sx2zd                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      5m6s

	  kube-system                 kube-apiserver-ha-212075-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m5s

	  kube-system                 kube-controller-manager-ha-212075-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m5s

	  kube-system                 kube-proxy-sfmhh                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m6s

	  kube-system                 kube-scheduler-ha-212075-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m5s

	  kube-system                 kube-vip-ha-212075-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m2s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 5m1s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  5m6s (x8 over 5m6s)  kubelet          Node ha-212075-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m6s (x8 over 5m6s)  kubelet          Node ha-212075-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m6s (x7 over 5m6s)  kubelet          Node ha-212075-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  5m6s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           5m3s                 node-controller  Node ha-212075-m02 event: Registered Node ha-212075-m02 in Controller

	  Normal  RegisteredNode           4m47s                node-controller  Node ha-212075-m02 event: Registered Node ha-212075-m02 in Controller

	  Normal  RegisteredNode           3m37s                node-controller  Node ha-212075-m02 event: Registered Node ha-212075-m02 in Controller

	  Normal  NodeNotReady             102s                 node-controller  Node ha-212075-m02 status is now: NodeNotReady

	Name:               ha-212075-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T12_50_12_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:50:08 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:54:03 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:08 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:08 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:08 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:18 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.109

	  Hostname:    ha-212075-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 535ef7f0e3c949a7801d0ab8f3e70b91

	  System UUID:                535ef7f0-e3c9-49a7-801d-0ab8f3e70b91

	  Boot ID:                    bc34a15b-f8d2-49d7-ac30-f44e734d2ed5

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-xw452                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m32s

	  kube-system                 etcd-ha-212075-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         3m55s

	  kube-system                 kindnet-2d8zp                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m57s

	  kube-system                 kube-apiserver-ha-212075-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m55s

	  kube-system                 kube-controller-manager-ha-212075-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m55s

	  kube-system                 kube-proxy-c27wn                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m57s

	  kube-system                 kube-scheduler-ha-212075-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m55s

	  kube-system                 kube-vip-ha-212075-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m52s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m51s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  3m57s (x8 over 3m57s)  kubelet          Node ha-212075-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m57s (x8 over 3m57s)  kubelet          Node ha-212075-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m57s (x7 over 3m57s)  kubelet          Node ha-212075-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m57s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m54s                  node-controller  Node ha-212075-m03 event: Registered Node ha-212075-m03 in Controller

	  Normal  RegisteredNode           3m53s                  node-controller  Node ha-212075-m03 event: Registered Node ha-212075-m03 in Controller

	  Normal  RegisteredNode           3m38s                  node-controller  Node ha-212075-m03 event: Registered Node ha-212075-m03 in Controller

	Name:               ha-212075-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T12_51_13_0700

	                    minikube.k8s.io/version=v1.33.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:51:12 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:53:56 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:12 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:12 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:12 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:21 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.139

	  Hostname:    ha-212075-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 ee58aa83584b463285f294fa28d19e05

	  System UUID:                ee58aa83-584b-4632-85f2-94fa28d19e05

	  Boot ID:                    05003e8a-1683-4cb9-9ad4-cb1e00255e69

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-d6tbw       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      2m53s

	  kube-system                 kube-proxy-bnbr8    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m53s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 2m47s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  2m53s (x3 over 2m53s)  kubelet          Node ha-212075-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m53s (x3 over 2m53s)  kubelet          Node ha-212075-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m53s (x3 over 2m53s)  kubelet          Node ha-212075-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m53s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m49s                  node-controller  Node ha-212075-m04 event: Registered Node ha-212075-m04 in Controller

	  Normal  RegisteredNode           2m48s                  node-controller  Node ha-212075-m04 event: Registered Node ha-212075-m04 in Controller

	  Normal  RegisteredNode           2m48s                  node-controller  Node ha-212075-m04 event: Registered Node ha-212075-m04 in Controller

	  Normal  NodeReady                2m44s                  kubelet          Node ha-212075-m04 status is now: NodeReady

	==> dmesg <==

	[Apr29 12:47] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.053063] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.042417] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.595489] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.659216] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.658122] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +9.473754] systemd-fstab-generator[595]: Ignoring "noauto" option for root device

	[  +0.066120] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.063959] systemd-fstab-generator[607]: Ignoring "noauto" option for root device

	[  +0.171013] systemd-fstab-generator[621]: Ignoring "noauto" option for root device

	[  +0.136787] systemd-fstab-generator[633]: Ignoring "noauto" option for root device

	[  +0.290881] systemd-fstab-generator[662]: Ignoring "noauto" option for root device

	[  +4.567542] systemd-fstab-generator[761]: Ignoring "noauto" option for root device

	[  +0.067175] kauditd_printk_skb: 130 callbacks suppressed

	[  +3.833264] systemd-fstab-generator[939]: Ignoring "noauto" option for root device

	[  +1.214053] kauditd_printk_skb: 57 callbacks suppressed

	[  +6.340857] systemd-fstab-generator[1355]: Ignoring "noauto" option for root device

	[  +0.082766] kauditd_printk_skb: 40 callbacks suppressed

	[Apr29 12:48] kauditd_printk_skb: 21 callbacks suppressed

	[  +5.082460] kauditd_printk_skb: 72 callbacks suppressed

	==> etcd [6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab] <==

	{"level":"warn","ts":"2024-04-29T12:54:04.871229Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.881378Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.887524Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.906744Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.925334Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.93828Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.945191Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.950366Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.954881Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.964282Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.972269Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.980524Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.987198Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:04.993295Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.004632Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.01196Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.01999Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.025747Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.030742Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.037415Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.044091Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.046923Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.047971Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.062775Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:54:05.064447Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 12:54:05 up 6 min,  0 users,  load average: 0.26, 0.24, 0.12

	Linux ha-212075 5.10.207 #1 SMP Mon Apr 22 03:02:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df] <==

	I0429 12:53:29.576577       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	I0429 12:53:39.583531       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0429 12:53:39.583869       1 main.go:227] handling current node

	I0429 12:53:39.583934       1 main.go:223] Handling node with IPs: map[192.168.39.36:{}]

	I0429 12:53:39.583960       1 main.go:250] Node ha-212075-m02 has CIDR [10.244.1.0/24] 

	I0429 12:53:39.584097       1 main.go:223] Handling node with IPs: map[192.168.39.109:{}]

	I0429 12:53:39.584117       1 main.go:250] Node ha-212075-m03 has CIDR [10.244.2.0/24] 

	I0429 12:53:39.584174       1 main.go:223] Handling node with IPs: map[192.168.39.139:{}]

	I0429 12:53:39.584193       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	I0429 12:53:49.598580       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0429 12:53:49.598778       1 main.go:227] handling current node

	I0429 12:53:49.598817       1 main.go:223] Handling node with IPs: map[192.168.39.36:{}]

	I0429 12:53:49.598840       1 main.go:250] Node ha-212075-m02 has CIDR [10.244.1.0/24] 

	I0429 12:53:49.599056       1 main.go:223] Handling node with IPs: map[192.168.39.109:{}]

	I0429 12:53:49.599087       1 main.go:250] Node ha-212075-m03 has CIDR [10.244.2.0/24] 

	I0429 12:53:49.599153       1 main.go:223] Handling node with IPs: map[192.168.39.139:{}]

	I0429 12:53:49.599172       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	I0429 12:53:59.611389       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0429 12:53:59.611435       1 main.go:227] handling current node

	I0429 12:53:59.611446       1 main.go:223] Handling node with IPs: map[192.168.39.36:{}]

	I0429 12:53:59.611452       1 main.go:250] Node ha-212075-m02 has CIDR [10.244.1.0/24] 

	I0429 12:53:59.611582       1 main.go:223] Handling node with IPs: map[192.168.39.109:{}]

	I0429 12:53:59.611607       1 main.go:250] Node ha-212075-m03 has CIDR [10.244.2.0/24] 

	I0429 12:53:59.611702       1 main.go:223] Handling node with IPs: map[192.168.39.139:{}]

	I0429 12:53:59.611726       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16] <==

	I0429 12:47:52.206856       1 controller.go:615] quota admission added evaluator for: endpoints

	I0429 12:47:52.212802       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0429 12:47:53.195190       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0429 12:47:53.272240       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0429 12:47:53.319588       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0429 12:47:53.336489       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0429 12:48:06.889872       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0429 12:48:06.889872       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0429 12:48:07.345600       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E0429 12:50:37.199894       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50238: use of closed network connection

	E0429 12:50:37.422099       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50256: use of closed network connection

	E0429 12:50:37.642894       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50274: use of closed network connection

	E0429 12:50:37.900488       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50288: use of closed network connection

	E0429 12:50:38.116582       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50304: use of closed network connection

	E0429 12:50:38.344331       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50320: use of closed network connection

	E0429 12:50:38.560181       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50328: use of closed network connection

	E0429 12:50:38.773132       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50354: use of closed network connection

	E0429 12:50:39.005884       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50368: use of closed network connection

	E0429 12:50:39.389303       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50394: use of closed network connection

	E0429 12:50:39.600752       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50404: use of closed network connection

	E0429 12:50:39.815611       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50424: use of closed network connection

	E0429 12:50:40.035011       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50440: use of closed network connection

	E0429 12:50:40.245499       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50462: use of closed network connection

	E0429 12:50:40.457578       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50492: use of closed network connection

	W0429 12:51:52.205330       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.109 192.168.39.97]

	==> kube-controller-manager [382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d] <==

	I0429 12:49:01.445000       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-212075-m02"

	I0429 12:50:08.617501       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-212075-m03\" does not exist"

	I0429 12:50:08.663917       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-212075-m03" podCIDRs=["10.244.2.0/24"]

	I0429 12:50:11.474203       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-212075-m03"

	I0429 12:50:34.047890       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="132.017808ms"

	I0429 12:50:34.146964       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="98.922663ms"

	I0429 12:50:34.376985       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="229.814363ms"

	E0429 12:50:34.377038       1 replica_set.go:557] sync "default/busybox-fc5497c4f" failed with Operation cannot be fulfilled on replicasets.apps "busybox-fc5497c4f": the object has been modified; please apply your changes to the latest version and try again

	I0429 12:50:34.377201       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="55.971µs"

	I0429 12:50:34.384897       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="81.618µs"

	I0429 12:50:35.869494       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="17.517378ms"

	I0429 12:50:35.869952       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="98.254µs"

	I0429 12:50:36.030792       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="44.135927ms"

	I0429 12:50:36.030945       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="73.996µs"

	I0429 12:50:36.451336       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="20.394422ms"

	I0429 12:50:36.451462       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="60.817µs"

	I0429 12:51:12.921789       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-212075-m04\" does not exist"

	I0429 12:51:12.964704       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-212075-m04" podCIDRs=["10.244.3.0/24"]

	I0429 12:51:16.503129       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-212075-m04"

	I0429 12:51:21.706750       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-212075-m04"

	I0429 12:52:22.540869       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-212075-m04"

	I0429 12:52:22.611915       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="12.169574ms"

	I0429 12:52:22.612104       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="42.399µs"

	I0429 12:52:22.663107       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="23.847549ms"

	I0429 12:52:22.663624       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="54.292µs"

	==> kube-proxy [ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d] <==

	I0429 12:48:07.949311       1 server_linux.go:69] "Using iptables proxy"

	I0429 12:48:07.970912       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.97"]

	I0429 12:48:08.111869       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0429 12:48:08.111971       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0429 12:48:08.112000       1 server_linux.go:165] "Using iptables Proxier"

	I0429 12:48:08.119057       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0429 12:48:08.119347       1 server.go:872] "Version info" version="v1.30.0"

	I0429 12:48:08.119376       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0429 12:48:08.121414       1 config.go:192] "Starting service config controller"

	I0429 12:48:08.121424       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0429 12:48:08.121444       1 config.go:101] "Starting endpoint slice config controller"

	I0429 12:48:08.121447       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0429 12:48:08.121966       1 config.go:319] "Starting node config controller"

	I0429 12:48:08.121973       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0429 12:48:08.222195       1 shared_informer.go:320] Caches are synced for node config

	I0429 12:48:08.222222       1 shared_informer.go:320] Caches are synced for service config

	I0429 12:48:08.222241       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf] <==

	W0429 12:47:51.705755       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0429 12:47:51.705803       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0429 12:47:51.705952       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0429 12:47:51.705995       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0429 12:47:51.762409       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0429 12:47:51.762955       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0429 12:47:51.831035       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0429 12:47:51.831222       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	I0429 12:47:54.028994       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0429 12:50:33.990786       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-xw452\": pod busybox-fc5497c4f-xw452 is already assigned to node \"ha-212075-m03\"" plugin="DefaultBinder" pod="default/busybox-fc5497c4f-xw452" node="ha-212075-m03"

	E0429 12:50:33.992233       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod f23383ad-d9ed-46ed-9327-d850179b2822(default/busybox-fc5497c4f-xw452) wasn't assumed so cannot be forgotten" pod="default/busybox-fc5497c4f-xw452"

	E0429 12:50:33.996630       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-xw452\": pod busybox-fc5497c4f-xw452 is already assigned to node \"ha-212075-m03\"" pod="default/busybox-fc5497c4f-xw452"

	I0429 12:50:33.997434       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-fc5497c4f-xw452" node="ha-212075-m03"

	E0429 12:51:13.049010       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-d6tbw\": pod kindnet-d6tbw is already assigned to node \"ha-212075-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-d6tbw" node="ha-212075-m04"

	E0429 12:51:13.049114       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 7effb27d-adcf-42ce-9c98-d1cb8db7fd04(kube-system/kindnet-d6tbw) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-d6tbw"

	E0429 12:51:13.049139       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-d6tbw\": pod kindnet-d6tbw is already assigned to node \"ha-212075-m04\"" pod="kube-system/kindnet-d6tbw"

	I0429 12:51:13.049158       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-d6tbw" node="ha-212075-m04"

	E0429 12:51:13.049476       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-bnbr8\": pod kube-proxy-bnbr8 is already assigned to node \"ha-212075-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-bnbr8" node="ha-212075-m04"

	E0429 12:51:13.049643       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 16945b1d-2d33-4a95-b9ad-03d0665b74e8(kube-system/kube-proxy-bnbr8) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-bnbr8"

	E0429 12:51:13.049799       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-bnbr8\": pod kube-proxy-bnbr8 is already assigned to node \"ha-212075-m04\"" pod="kube-system/kube-proxy-bnbr8"

	I0429 12:51:13.049931       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-bnbr8" node="ha-212075-m04"

	E0429 12:51:13.198840       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-9qm85\": pod kindnet-9qm85 is already assigned to node \"ha-212075-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-9qm85" node="ha-212075-m04"

	E0429 12:51:13.199120       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod f060a9cf-2fcb-4ef4-8991-954beeaa1614(kube-system/kindnet-9qm85) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-9qm85"

	E0429 12:51:13.199784       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-9qm85\": pod kindnet-9qm85 is already assigned to node \"ha-212075-m04\"" pod="kube-system/kindnet-9qm85"

	I0429 12:51:13.199829       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-9qm85" node="ha-212075-m04"

	==> kubelet <==

	Apr 29 12:49:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:49:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:50:34 ha-212075 kubelet[1362]: I0429 12:50:34.030270    1362 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=146.030038179 podStartE2EDuration="2m26.030038179s" podCreationTimestamp="2024-04-29 12:48:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-04-29 12:48:11.438371254 +0000 UTC m=+18.425865530" watchObservedRunningTime="2024-04-29 12:50:34.030038179 +0000 UTC m=+161.017532456"

	Apr 29 12:50:34 ha-212075 kubelet[1362]: I0429 12:50:34.032309    1362 topology_manager.go:215] "Topology Admit Handler" podUID="de803f70-5f57-4282-af1e-47845231d712" podNamespace="default" podName="busybox-fc5497c4f-rcq9m"

	Apr 29 12:50:34 ha-212075 kubelet[1362]: I0429 12:50:34.077142    1362 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjh9c\" (UniqueName: \"kubernetes.io/projected/de803f70-5f57-4282-af1e-47845231d712-kube-api-access-xjh9c\") pod \"busybox-fc5497c4f-rcq9m\" (UID: \"de803f70-5f57-4282-af1e-47845231d712\") " pod="default/busybox-fc5497c4f-rcq9m"

	Apr 29 12:50:53 ha-212075 kubelet[1362]: E0429 12:50:53.153020    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:50:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:50:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:50:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:50:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:51:53 ha-212075 kubelet[1362]: E0429 12:51:53.156281    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:51:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:51:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:51:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:51:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:52:53 ha-212075 kubelet[1362]: E0429 12:52:53.152345    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:52:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:52:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:52:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:52:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:53:53 ha-212075 kubelet[1362]: E0429 12:53:53.152414    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:53:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:53:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:53:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:53:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-212075 -n ha-212075

helpers_test.go:261: (dbg) Run:  kubectl --context ha-212075 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (142.47s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 node start m02 -v=7 --alsologtostderr

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 3 (3.194694524s)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:54:09.837126  875022 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:54:09.837731  875022 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:09.837785  875022 out.go:304] Setting ErrFile to fd 2...

	I0429 12:54:09.837803  875022 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:09.838286  875022 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:54:09.838726  875022 out.go:298] Setting JSON to false

	I0429 12:54:09.838792  875022 mustload.go:65] Loading cluster: ha-212075

	I0429 12:54:09.838911  875022 notify.go:220] Checking for updates...

	I0429 12:54:09.839589  875022 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:54:09.839613  875022 status.go:255] checking status of ha-212075 ...

	I0429 12:54:09.840029  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:09.840077  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:09.859968  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37323

	I0429 12:54:09.860471  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:09.861296  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:09.861332  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:09.861801  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:09.862057  875022 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:54:09.863915  875022 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:54:09.863946  875022 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:09.864291  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:09.864346  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:09.880685  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34457

	I0429 12:54:09.881255  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:09.881815  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:09.881844  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:09.882243  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:09.882474  875022 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:54:09.886069  875022 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:09.886543  875022 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:09.886583  875022 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:09.886730  875022 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:09.887060  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:09.887117  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:09.904213  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35827

	I0429 12:54:09.904764  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:09.905319  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:09.905336  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:09.905646  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:09.905952  875022 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:54:09.906332  875022 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:09.906372  875022 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:54:09.909700  875022 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:09.910206  875022 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:09.910258  875022 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:09.910459  875022 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:54:09.910683  875022 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:54:09.910889  875022 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:54:09.911107  875022 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:54:10.000062  875022 ssh_runner.go:195] Run: systemctl --version

	I0429 12:54:10.007293  875022 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:10.026731  875022 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:10.026765  875022 api_server.go:166] Checking apiserver status ...

	I0429 12:54:10.026809  875022 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:10.043704  875022 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:54:10.055384  875022 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:10.055450  875022 ssh_runner.go:195] Run: ls

	I0429 12:54:10.060508  875022 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:10.067255  875022 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:10.067291  875022 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:54:10.067303  875022 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:10.067325  875022 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:54:10.067695  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:10.067742  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:10.083811  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44959

	I0429 12:54:10.084387  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:10.084921  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:10.084944  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:10.085303  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:10.085524  875022 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:54:10.087200  875022 status.go:330] ha-212075-m02 host status = "Running" (err=<nil>)

	I0429 12:54:10.087220  875022 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:10.087573  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:10.087618  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:10.103397  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44217

	I0429 12:54:10.103918  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:10.104458  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:10.104486  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:10.104786  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:10.105102  875022 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:54:10.108063  875022 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:10.108523  875022 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:10.108548  875022 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:10.108758  875022 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:10.109078  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:10.109119  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:10.124897  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35835

	I0429 12:54:10.125364  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:10.125878  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:10.125919  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:10.126326  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:10.126550  875022 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:54:10.126755  875022 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:10.126782  875022 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:54:10.129515  875022 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:10.130077  875022 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:10.130111  875022 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:10.130241  875022 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:54:10.130440  875022 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:54:10.130620  875022 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:54:10.130799  875022 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	W0429 12:54:12.591721  875022 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:12.591834  875022 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	E0429 12:54:12.591860  875022 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:12.591869  875022 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 12:54:12.591899  875022 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:12.591906  875022 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:12.592233  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:12.592284  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:12.610773  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42679

	I0429 12:54:12.611382  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:12.612009  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:12.612042  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:12.612367  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:12.612540  875022 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:12.614221  875022 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:12.614269  875022 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:12.614610  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:12.614662  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:12.630879  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46731

	I0429 12:54:12.631422  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:12.631997  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:12.632021  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:12.632360  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:12.632604  875022 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:12.635687  875022 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:12.636093  875022 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:12.636124  875022 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:12.636276  875022 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:12.636647  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:12.636717  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:12.652895  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39825

	I0429 12:54:12.653392  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:12.653978  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:12.654006  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:12.654364  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:12.654577  875022 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:12.654782  875022 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:12.654807  875022 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:12.657887  875022 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:12.658371  875022 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:12.658411  875022 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:12.658720  875022 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:12.658934  875022 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:12.659082  875022 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:12.659209  875022 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:12.743803  875022 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:12.761206  875022 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:12.761266  875022 api_server.go:166] Checking apiserver status ...

	I0429 12:54:12.761312  875022 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:12.777926  875022 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:12.790292  875022 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:12.790366  875022 ssh_runner.go:195] Run: ls

	I0429 12:54:12.795857  875022 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:12.800529  875022 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:12.800564  875022 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:12.800573  875022 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:12.800590  875022 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:12.800927  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:12.801014  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:12.820508  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39121

	I0429 12:54:12.820988  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:12.821513  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:12.821551  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:12.821927  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:12.822180  875022 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:12.824245  875022 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:12.824266  875022 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:12.824564  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:12.824604  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:12.840709  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46685

	I0429 12:54:12.841175  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:12.841677  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:12.841700  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:12.842032  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:12.842247  875022 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:12.845291  875022 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:12.845725  875022 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:12.845761  875022 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:12.846017  875022 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:12.846325  875022 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:12.846366  875022 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:12.862258  875022 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42457

	I0429 12:54:12.862746  875022 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:12.863291  875022 main.go:141] libmachine: Using API Version  1

	I0429 12:54:12.863322  875022 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:12.863667  875022 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:12.863878  875022 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:12.864090  875022 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:12.864117  875022 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:12.867121  875022 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:12.867564  875022 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:12.867609  875022 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:12.867841  875022 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:12.868039  875022 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:12.868210  875022 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:12.868360  875022 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:12.951637  875022 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:12.970306  875022 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 3 (5.187018884s)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:54:13.987275  875122 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:54:13.987602  875122 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:13.987613  875122 out.go:304] Setting ErrFile to fd 2...

	I0429 12:54:13.987618  875122 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:13.987850  875122 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:54:13.988075  875122 out.go:298] Setting JSON to false

	I0429 12:54:13.988108  875122 mustload.go:65] Loading cluster: ha-212075

	I0429 12:54:13.988233  875122 notify.go:220] Checking for updates...

	I0429 12:54:13.988723  875122 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:54:13.988750  875122 status.go:255] checking status of ha-212075 ...

	I0429 12:54:13.989255  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:13.989322  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:14.010328  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34497

	I0429 12:54:14.010860  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:14.011626  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:14.011657  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:14.012220  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:14.012542  875122 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:54:14.014493  875122 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:54:14.014518  875122 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:14.015002  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:14.015066  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:14.031887  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36763

	I0429 12:54:14.032447  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:14.033013  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:14.033047  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:14.033351  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:14.033536  875122 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:54:14.037079  875122 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:14.037646  875122 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:14.037685  875122 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:14.037824  875122 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:14.038146  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:14.038186  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:14.054130  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37171

	I0429 12:54:14.054579  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:14.055097  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:14.055120  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:14.055494  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:14.055699  875122 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:54:14.055899  875122 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:14.055924  875122 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:54:14.059293  875122 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:14.059793  875122 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:14.059825  875122 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:14.060038  875122 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:54:14.060302  875122 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:54:14.060482  875122 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:54:14.060641  875122 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:54:14.151768  875122 ssh_runner.go:195] Run: systemctl --version

	I0429 12:54:14.159112  875122 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:14.175597  875122 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:14.175633  875122 api_server.go:166] Checking apiserver status ...

	I0429 12:54:14.175673  875122 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:14.194972  875122 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:54:14.208584  875122 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:14.208655  875122 ssh_runner.go:195] Run: ls

	I0429 12:54:14.213908  875122 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:14.218637  875122 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:14.218668  875122 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:54:14.218680  875122 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:14.218699  875122 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:54:14.219015  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:14.219057  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:14.236477  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36713

	I0429 12:54:14.237042  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:14.237544  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:14.237567  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:14.237942  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:14.238149  875122 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:54:14.239936  875122 status.go:330] ha-212075-m02 host status = "Running" (err=<nil>)

	I0429 12:54:14.239968  875122 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:14.240321  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:14.240381  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:14.257479  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37863

	I0429 12:54:14.257975  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:14.258524  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:14.258548  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:14.258871  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:14.259121  875122 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:54:14.262217  875122 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:14.262579  875122 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:14.262620  875122 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:14.262849  875122 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:14.263151  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:14.263195  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:14.279352  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38031

	I0429 12:54:14.279828  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:14.280386  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:14.280417  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:14.280793  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:14.281412  875122 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:54:14.281629  875122 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:14.281653  875122 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:54:14.284362  875122 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:14.284847  875122 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:14.284879  875122 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:14.285058  875122 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:54:14.285284  875122 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:54:14.285458  875122 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:54:14.285638  875122 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	W0429 12:54:15.663761  875122 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:15.663853  875122 retry.go:31] will retry after 146.632531ms: dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:18.735728  875122 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:18.735847  875122 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	E0429 12:54:18.735874  875122 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:18.735886  875122 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 12:54:18.735938  875122 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:18.735951  875122 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:18.736297  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:18.736356  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:18.753821  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44463

	I0429 12:54:18.754318  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:18.754912  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:18.754948  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:18.755320  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:18.755541  875122 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:18.757197  875122 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:18.757217  875122 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:18.757595  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:18.757649  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:18.773450  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35463

	I0429 12:54:18.773980  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:18.774609  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:18.774637  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:18.774964  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:18.775174  875122 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:18.778147  875122 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:18.778562  875122 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:18.778592  875122 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:18.778765  875122 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:18.779160  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:18.779221  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:18.795536  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42333

	I0429 12:54:18.796018  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:18.796662  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:18.796693  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:18.797004  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:18.797212  875122 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:18.797428  875122 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:18.797457  875122 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:18.800377  875122 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:18.800840  875122 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:18.800871  875122 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:18.801056  875122 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:18.801209  875122 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:18.801318  875122 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:18.801496  875122 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:18.888658  875122 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:18.906504  875122 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:18.906549  875122 api_server.go:166] Checking apiserver status ...

	I0429 12:54:18.906595  875122 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:18.922931  875122 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:18.933617  875122 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:18.933713  875122 ssh_runner.go:195] Run: ls

	I0429 12:54:18.939085  875122 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:18.944252  875122 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:18.944289  875122 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:18.944300  875122 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:18.944318  875122 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:18.944750  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:18.944804  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:18.961430  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36541

	I0429 12:54:18.961928  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:18.962495  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:18.962531  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:18.962914  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:18.963095  875122 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:18.964815  875122 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:18.964845  875122 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:18.965169  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:18.965253  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:18.982164  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41553

	I0429 12:54:18.982588  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:18.983129  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:18.983153  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:18.983487  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:18.983688  875122 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:18.986493  875122 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:18.986909  875122 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:18.986932  875122 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:18.987118  875122 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:18.987567  875122 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:18.987672  875122 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:19.005843  875122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40551

	I0429 12:54:19.006415  875122 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:19.006998  875122 main.go:141] libmachine: Using API Version  1

	I0429 12:54:19.007039  875122 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:19.007413  875122 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:19.007631  875122 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:19.007938  875122 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:19.007970  875122 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:19.010885  875122 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:19.011334  875122 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:19.011402  875122 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:19.011579  875122 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:19.011794  875122 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:19.011991  875122 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:19.012146  875122 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:19.091904  875122 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:19.109106  875122 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 3 (4.700362779s)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:54:20.851281  875224 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:54:20.851570  875224 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:20.851579  875224 out.go:304] Setting ErrFile to fd 2...

	I0429 12:54:20.851583  875224 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:20.851790  875224 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:54:20.852008  875224 out.go:298] Setting JSON to false

	I0429 12:54:20.852039  875224 mustload.go:65] Loading cluster: ha-212075

	I0429 12:54:20.852110  875224 notify.go:220] Checking for updates...

	I0429 12:54:20.852457  875224 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:54:20.852473  875224 status.go:255] checking status of ha-212075 ...

	I0429 12:54:20.852863  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:20.852921  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:20.871472  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42331

	I0429 12:54:20.871986  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:20.872754  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:20.872788  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:20.873157  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:20.873385  875224 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:54:20.875216  875224 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:54:20.875235  875224 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:20.875565  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:20.875607  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:20.892911  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35167

	I0429 12:54:20.893369  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:20.893963  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:20.893999  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:20.894353  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:20.894589  875224 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:54:20.897878  875224 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:20.898404  875224 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:20.898431  875224 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:20.898611  875224 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:20.898918  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:20.898979  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:20.915548  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40703

	I0429 12:54:20.916201  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:20.916767  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:20.916790  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:20.917262  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:20.917542  875224 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:54:20.917782  875224 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:20.917816  875224 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:54:20.920760  875224 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:20.921169  875224 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:20.921200  875224 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:20.921384  875224 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:54:20.921603  875224 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:54:20.921781  875224 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:54:20.921941  875224 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:54:21.016143  875224 ssh_runner.go:195] Run: systemctl --version

	I0429 12:54:21.022943  875224 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:21.039242  875224 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:21.039275  875224 api_server.go:166] Checking apiserver status ...

	I0429 12:54:21.039314  875224 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:21.057527  875224 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:54:21.069057  875224 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:21.069120  875224 ssh_runner.go:195] Run: ls

	I0429 12:54:21.075516  875224 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:21.080184  875224 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:21.080217  875224 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:54:21.080233  875224 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:21.080257  875224 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:54:21.080559  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:21.080586  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:21.097570  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44955

	I0429 12:54:21.098135  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:21.098626  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:21.098650  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:21.098968  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:21.099180  875224 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:54:21.100776  875224 status.go:330] ha-212075-m02 host status = "Running" (err=<nil>)

	I0429 12:54:21.100796  875224 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:21.101086  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:21.101116  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:21.118200  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41647

	I0429 12:54:21.118724  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:21.119239  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:21.119266  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:21.119615  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:21.119779  875224 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:54:21.122572  875224 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:21.123071  875224 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:21.123098  875224 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:21.123260  875224 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:21.123612  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:21.123663  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:21.139895  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44957

	I0429 12:54:21.140408  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:21.140886  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:21.140911  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:21.141262  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:21.141466  875224 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:54:21.141712  875224 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:21.141737  875224 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:54:21.144681  875224 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:21.145123  875224 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:21.145148  875224 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:21.145427  875224 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:54:21.145658  875224 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:54:21.145838  875224 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:54:21.146015  875224 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	W0429 12:54:21.807720  875224 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:21.807778  875224 retry.go:31] will retry after 245.704374ms: dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:25.103632  875224 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:25.103783  875224 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	E0429 12:54:25.103808  875224 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:25.103816  875224 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 12:54:25.103851  875224 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:25.103866  875224 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:25.104211  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:25.104264  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:25.120461  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33987

	I0429 12:54:25.121009  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:25.121541  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:25.121560  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:25.121999  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:25.122272  875224 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:25.124035  875224 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:25.124056  875224 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:25.124358  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:25.124409  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:25.141551  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46099

	I0429 12:54:25.142059  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:25.142544  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:25.142569  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:25.142904  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:25.143135  875224 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:25.146350  875224 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:25.146788  875224 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:25.146824  875224 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:25.147041  875224 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:25.147423  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:25.147480  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:25.164746  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32929

	I0429 12:54:25.165229  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:25.165842  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:25.165874  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:25.166245  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:25.166455  875224 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:25.166686  875224 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:25.166719  875224 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:25.170023  875224 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:25.170480  875224 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:25.170510  875224 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:25.170671  875224 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:25.170891  875224 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:25.171070  875224 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:25.171258  875224 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:25.256994  875224 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:25.275228  875224 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:25.275267  875224 api_server.go:166] Checking apiserver status ...

	I0429 12:54:25.275318  875224 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:25.292094  875224 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:25.305778  875224 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:25.305853  875224 ssh_runner.go:195] Run: ls

	I0429 12:54:25.312961  875224 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:25.319208  875224 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:25.319246  875224 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:25.319256  875224 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:25.319275  875224 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:25.319702  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:25.319758  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:25.336883  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40027

	I0429 12:54:25.337409  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:25.337927  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:25.337954  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:25.338326  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:25.338537  875224 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:25.340475  875224 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:25.340505  875224 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:25.340869  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:25.340925  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:25.357251  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41963

	I0429 12:54:25.357815  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:25.358465  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:25.358496  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:25.358850  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:25.359070  875224 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:25.362427  875224 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:25.362999  875224 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:25.363031  875224 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:25.363275  875224 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:25.363623  875224 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:25.363654  875224 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:25.381059  875224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40569

	I0429 12:54:25.381536  875224 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:25.382184  875224 main.go:141] libmachine: Using API Version  1

	I0429 12:54:25.382210  875224 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:25.382589  875224 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:25.382851  875224 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:25.383106  875224 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:25.383137  875224 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:25.386525  875224 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:25.386945  875224 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:25.386978  875224 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:25.387186  875224 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:25.387436  875224 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:25.387617  875224 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:25.387762  875224 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:25.469160  875224 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:25.487402  875224 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 3 (3.794844459s)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:54:28.090132  875340 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:54:28.090436  875340 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:28.090447  875340 out.go:304] Setting ErrFile to fd 2...

	I0429 12:54:28.090452  875340 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:28.090676  875340 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:54:28.090879  875340 out.go:298] Setting JSON to false

	I0429 12:54:28.090910  875340 mustload.go:65] Loading cluster: ha-212075

	I0429 12:54:28.090974  875340 notify.go:220] Checking for updates...

	I0429 12:54:28.092209  875340 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:54:28.092258  875340 status.go:255] checking status of ha-212075 ...

	I0429 12:54:28.093185  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:28.093261  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:28.109723  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42823

	I0429 12:54:28.110344  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:28.111071  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:28.111098  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:28.111619  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:28.111927  875340 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:54:28.113867  875340 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:54:28.113889  875340 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:28.114303  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:28.114357  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:28.130488  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38661

	I0429 12:54:28.131037  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:28.131677  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:28.131716  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:28.132044  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:28.132227  875340 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:54:28.135415  875340 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:28.135774  875340 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:28.135803  875340 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:28.135964  875340 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:28.136298  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:28.136340  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:28.153076  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42521

	I0429 12:54:28.153572  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:28.154132  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:28.154164  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:28.154534  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:28.154756  875340 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:54:28.155000  875340 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:28.155046  875340 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:54:28.158001  875340 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:28.158456  875340 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:28.158489  875340 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:28.158682  875340 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:54:28.158873  875340 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:54:28.159044  875340 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:54:28.159169  875340 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:54:28.243953  875340 ssh_runner.go:195] Run: systemctl --version

	I0429 12:54:28.250994  875340 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:28.267971  875340 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:28.268007  875340 api_server.go:166] Checking apiserver status ...

	I0429 12:54:28.268046  875340 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:28.284396  875340 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:54:28.295725  875340 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:28.295788  875340 ssh_runner.go:195] Run: ls

	I0429 12:54:28.301527  875340 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:28.307949  875340 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:28.307987  875340 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:54:28.308001  875340 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:28.308024  875340 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:54:28.308341  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:28.308398  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:28.325622  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34273

	I0429 12:54:28.326127  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:28.326705  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:28.326751  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:28.327175  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:28.327491  875340 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:54:28.329574  875340 status.go:330] ha-212075-m02 host status = "Running" (err=<nil>)

	I0429 12:54:28.329598  875340 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:28.329895  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:28.329935  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:28.346363  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43685

	I0429 12:54:28.346918  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:28.347494  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:28.347522  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:28.347881  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:28.348144  875340 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:54:28.351291  875340 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:28.351821  875340 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:28.351847  875340 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:28.352040  875340 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:28.352406  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:28.352447  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:28.368442  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39553

	I0429 12:54:28.369016  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:28.369631  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:28.369659  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:28.369988  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:28.370184  875340 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:54:28.370378  875340 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:28.370401  875340 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:54:28.373701  875340 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:28.374155  875340 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:28.374185  875340 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:28.374350  875340 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:54:28.374525  875340 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:54:28.374681  875340 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:54:28.374824  875340 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	W0429 12:54:31.439668  875340 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:31.439778  875340 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	E0429 12:54:31.439802  875340 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:31.439818  875340 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 12:54:31.439844  875340 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:31.439852  875340 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:31.440361  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:31.440426  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:31.457090  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38519

	I0429 12:54:31.457592  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:31.458098  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:31.458122  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:31.458468  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:31.458664  875340 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:31.460390  875340 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:31.460417  875340 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:31.460824  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:31.460880  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:31.477571  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37137

	I0429 12:54:31.478022  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:31.478588  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:31.478630  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:31.478980  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:31.479216  875340 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:31.482469  875340 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:31.482987  875340 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:31.483019  875340 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:31.483152  875340 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:31.483502  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:31.483543  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:31.499224  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40271

	I0429 12:54:31.499712  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:31.500305  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:31.500330  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:31.500736  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:31.500996  875340 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:31.501226  875340 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:31.501253  875340 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:31.504364  875340 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:31.504873  875340 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:31.504918  875340 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:31.505124  875340 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:31.505365  875340 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:31.505554  875340 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:31.505727  875340 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:31.588109  875340 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:31.605381  875340 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:31.605417  875340 api_server.go:166] Checking apiserver status ...

	I0429 12:54:31.605460  875340 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:31.621799  875340 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:31.633311  875340 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:31.633417  875340 ssh_runner.go:195] Run: ls

	I0429 12:54:31.639617  875340 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:31.647105  875340 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:31.647138  875340 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:31.647148  875340 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:31.647166  875340 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:31.647545  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:31.647595  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:31.666121  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42037

	I0429 12:54:31.666639  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:31.667190  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:31.667216  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:31.667613  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:31.667822  875340 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:31.669608  875340 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:31.669632  875340 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:31.670095  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:31.670142  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:31.689415  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42935

	I0429 12:54:31.689981  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:31.690542  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:31.690567  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:31.690925  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:31.691195  875340 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:31.694587  875340 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:31.695143  875340 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:31.695187  875340 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:31.695458  875340 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:31.695778  875340 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:31.695827  875340 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:31.711802  875340 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36591

	I0429 12:54:31.712254  875340 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:31.712796  875340 main.go:141] libmachine: Using API Version  1

	I0429 12:54:31.712820  875340 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:31.713170  875340 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:31.713366  875340 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:31.713571  875340 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:31.713592  875340 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:31.717472  875340 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:31.718050  875340 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:31.718100  875340 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:31.718333  875340 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:31.718592  875340 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:31.718781  875340 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:31.718957  875340 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:31.804133  875340 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:31.821225  875340 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 3 (3.79639692s)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:54:35.030101  875440 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:54:35.030749  875440 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:35.030773  875440 out.go:304] Setting ErrFile to fd 2...

	I0429 12:54:35.030781  875440 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:35.031273  875440 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:54:35.031704  875440 out.go:298] Setting JSON to false

	I0429 12:54:35.031754  875440 mustload.go:65] Loading cluster: ha-212075

	I0429 12:54:35.031817  875440 notify.go:220] Checking for updates...

	I0429 12:54:35.032523  875440 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:54:35.032546  875440 status.go:255] checking status of ha-212075 ...

	I0429 12:54:35.032954  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:35.033019  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:35.053630  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38545

	I0429 12:54:35.054248  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:35.054952  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:35.054989  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:35.055455  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:35.055693  875440 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:54:35.057408  875440 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:54:35.057431  875440 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:35.057867  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:35.057920  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:35.076059  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39139

	I0429 12:54:35.076610  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:35.077342  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:35.077391  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:35.077807  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:35.078160  875440 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:54:35.081183  875440 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:35.081763  875440 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:35.081795  875440 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:35.082134  875440 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:35.082497  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:35.082542  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:35.100276  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36825

	I0429 12:54:35.100728  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:35.101239  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:35.101272  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:35.101593  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:35.101830  875440 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:54:35.102025  875440 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:35.102051  875440 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:54:35.105080  875440 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:35.105544  875440 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:35.105575  875440 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:35.105790  875440 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:54:35.106043  875440 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:54:35.106180  875440 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:54:35.106312  875440 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:54:35.196912  875440 ssh_runner.go:195] Run: systemctl --version

	I0429 12:54:35.204207  875440 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:35.222492  875440 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:35.222533  875440 api_server.go:166] Checking apiserver status ...

	I0429 12:54:35.222574  875440 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:35.238878  875440 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:54:35.250977  875440 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:35.251043  875440 ssh_runner.go:195] Run: ls

	I0429 12:54:35.256230  875440 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:35.266235  875440 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:35.266273  875440 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:54:35.266291  875440 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:35.266316  875440 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:54:35.266764  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:35.266816  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:35.282807  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35005

	I0429 12:54:35.283308  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:35.283845  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:35.283869  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:35.284171  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:35.284366  875440 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:54:35.286132  875440 status.go:330] ha-212075-m02 host status = "Running" (err=<nil>)

	I0429 12:54:35.286155  875440 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:35.286470  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:35.286528  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:35.303956  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39439

	I0429 12:54:35.304495  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:35.305092  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:35.305128  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:35.305532  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:35.305760  875440 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:54:35.308962  875440 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:35.309614  875440 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:35.309644  875440 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:35.309838  875440 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:35.310162  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:35.310210  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:35.326737  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45009

	I0429 12:54:35.327281  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:35.327825  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:35.327848  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:35.328172  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:35.328370  875440 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:54:35.328558  875440 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:35.328581  875440 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:54:35.331502  875440 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:35.332114  875440 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:35.332167  875440 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:35.332232  875440 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:54:35.332438  875440 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:54:35.332615  875440 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:54:35.332760  875440 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	W0429 12:54:38.383642  875440 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:38.383784  875440 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	E0429 12:54:38.383808  875440 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:38.383833  875440 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 12:54:38.383861  875440 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:38.383873  875440 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:38.384212  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:38.384266  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:38.401402  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44859

	I0429 12:54:38.401945  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:38.402522  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:38.402553  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:38.402925  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:38.403191  875440 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:38.405200  875440 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:38.405221  875440 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:38.405663  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:38.405719  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:38.422799  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40987

	I0429 12:54:38.423275  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:38.423805  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:38.423831  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:38.424167  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:38.424415  875440 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:38.427434  875440 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:38.427923  875440 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:38.427954  875440 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:38.428099  875440 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:38.428714  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:38.428780  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:38.446138  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32821

	I0429 12:54:38.446659  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:38.447307  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:38.447338  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:38.447714  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:38.447924  875440 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:38.448119  875440 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:38.448141  875440 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:38.451454  875440 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:38.451941  875440 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:38.451974  875440 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:38.452189  875440 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:38.452423  875440 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:38.452607  875440 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:38.452803  875440 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:38.535951  875440 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:38.554252  875440 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:38.554294  875440 api_server.go:166] Checking apiserver status ...

	I0429 12:54:38.554343  875440 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:38.572588  875440 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:38.585676  875440 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:38.585778  875440 ssh_runner.go:195] Run: ls

	I0429 12:54:38.592132  875440 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:38.597048  875440 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:38.597087  875440 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:38.597101  875440 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:38.597141  875440 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:38.597579  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:38.597627  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:38.615776  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33123

	I0429 12:54:38.616333  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:38.617003  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:38.617035  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:38.617445  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:38.617681  875440 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:38.619425  875440 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:38.619444  875440 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:38.619796  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:38.619868  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:38.637193  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44701

	I0429 12:54:38.637803  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:38.638408  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:38.638440  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:38.638867  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:38.639101  875440 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:38.642414  875440 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:38.642941  875440 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:38.642981  875440 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:38.643263  875440 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:38.643729  875440 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:38.643861  875440 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:38.660177  875440 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37227

	I0429 12:54:38.660625  875440 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:38.661171  875440 main.go:141] libmachine: Using API Version  1

	I0429 12:54:38.661197  875440 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:38.661535  875440 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:38.661739  875440 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:38.661920  875440 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:38.661938  875440 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:38.665333  875440 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:38.665715  875440 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:38.665760  875440 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:38.665925  875440 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:38.666158  875440 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:38.666324  875440 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:38.666466  875440 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:38.749146  875440 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:38.766118  875440 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 3 (3.804728301s)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:54:43.700446  875557 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:54:43.700652  875557 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:43.700662  875557 out.go:304] Setting ErrFile to fd 2...

	I0429 12:54:43.700668  875557 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:43.700976  875557 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:54:43.701249  875557 out.go:298] Setting JSON to false

	I0429 12:54:43.701288  875557 mustload.go:65] Loading cluster: ha-212075

	I0429 12:54:43.701408  875557 notify.go:220] Checking for updates...

	I0429 12:54:43.701831  875557 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:54:43.701850  875557 status.go:255] checking status of ha-212075 ...

	I0429 12:54:43.702443  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:43.702531  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:43.720893  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36735

	I0429 12:54:43.721481  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:43.722049  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:43.722081  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:43.722518  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:43.722721  875557 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:54:43.724515  875557 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:54:43.724536  875557 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:43.724987  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:43.725051  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:43.743577  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33407

	I0429 12:54:43.744062  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:43.744616  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:43.744650  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:43.744998  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:43.745186  875557 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:54:43.748358  875557 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:43.748829  875557 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:43.748864  875557 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:43.749030  875557 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:43.749504  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:43.749570  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:43.766267  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33365

	I0429 12:54:43.766827  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:43.767522  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:43.767549  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:43.767866  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:43.768063  875557 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:54:43.768307  875557 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:43.768349  875557 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:54:43.771606  875557 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:43.772112  875557 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:43.772142  875557 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:43.772487  875557 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:54:43.772769  875557 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:54:43.772960  875557 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:54:43.773129  875557 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:54:43.872299  875557 ssh_runner.go:195] Run: systemctl --version

	I0429 12:54:43.879271  875557 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:43.896216  875557 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:43.896249  875557 api_server.go:166] Checking apiserver status ...

	I0429 12:54:43.896287  875557 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:43.912832  875557 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:54:43.924294  875557 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:43.924366  875557 ssh_runner.go:195] Run: ls

	I0429 12:54:43.929766  875557 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:43.938353  875557 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:43.938394  875557 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:54:43.938407  875557 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:43.938428  875557 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:54:43.938788  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:43.938846  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:43.955116  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46553

	I0429 12:54:43.955694  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:43.956288  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:43.956318  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:43.956730  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:43.956938  875557 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:54:43.958842  875557 status.go:330] ha-212075-m02 host status = "Running" (err=<nil>)

	I0429 12:54:43.958870  875557 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:43.959222  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:43.959267  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:43.975292  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46795

	I0429 12:54:43.975879  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:43.976435  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:43.976465  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:43.976852  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:43.977071  875557 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:54:43.980296  875557 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:43.980774  875557 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:43.980804  875557 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:43.981010  875557 host.go:66] Checking if "ha-212075-m02" exists ...

	I0429 12:54:43.981335  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:43.981379  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:43.997974  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38739

	I0429 12:54:43.998551  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:43.999137  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:43.999164  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:43.999583  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:43.999866  875557 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:54:44.000067  875557 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:44.000094  875557 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:54:44.003403  875557 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:44.003854  875557 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:54:44.003895  875557 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:54:44.004063  875557 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:54:44.004288  875557 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:54:44.004442  875557 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:54:44.004567  875557 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	W0429 12:54:47.055635  875557 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.36:22: connect: no route to host

	W0429 12:54:47.055762  875557 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	E0429 12:54:47.055779  875557 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:47.055790  875557 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 12:54:47.055810  875557 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.36:22: connect: no route to host

	I0429 12:54:47.055818  875557 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:47.056139  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:47.056185  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:47.072494  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36359

	I0429 12:54:47.073074  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:47.073667  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:47.073696  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:47.074057  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:47.074250  875557 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:47.076444  875557 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:47.076473  875557 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:47.076885  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:47.076947  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:47.093197  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36991

	I0429 12:54:47.093844  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:47.094362  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:47.094389  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:47.094715  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:47.094930  875557 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:47.098509  875557 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:47.099154  875557 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:47.099192  875557 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:47.099408  875557 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:47.099756  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:47.099801  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:47.118681  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43553

	I0429 12:54:47.119226  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:47.119843  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:47.119869  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:47.120289  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:47.120534  875557 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:47.120781  875557 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:47.120808  875557 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:47.124493  875557 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:47.124982  875557 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:47.125012  875557 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:47.125175  875557 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:47.125392  875557 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:47.125582  875557 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:47.125728  875557 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:47.212421  875557 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:47.231089  875557 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:47.231123  875557 api_server.go:166] Checking apiserver status ...

	I0429 12:54:47.231157  875557 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:47.248447  875557 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:47.262056  875557 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:47.262129  875557 ssh_runner.go:195] Run: ls

	I0429 12:54:47.267878  875557 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:47.274220  875557 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:47.274257  875557 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:47.274271  875557 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:47.274295  875557 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:47.274626  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:47.274680  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:47.291485  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45577

	I0429 12:54:47.292005  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:47.292580  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:47.292612  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:47.292960  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:47.293213  875557 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:47.295068  875557 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:47.295088  875557 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:47.295399  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:47.295447  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:47.311437  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41501

	I0429 12:54:47.311966  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:47.312478  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:47.312503  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:47.312850  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:47.313065  875557 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:47.316906  875557 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:47.317368  875557 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:47.317411  875557 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:47.317578  875557 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:47.317980  875557 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:47.318047  875557 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:47.334248  875557 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44747

	I0429 12:54:47.334695  875557 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:47.335233  875557 main.go:141] libmachine: Using API Version  1

	I0429 12:54:47.335262  875557 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:47.335713  875557 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:47.335952  875557 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:47.336153  875557 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:47.336174  875557 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:47.339834  875557 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:47.340383  875557 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:47.340584  875557 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:47.340662  875557 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:47.340809  875557 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:47.340983  875557 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:47.341118  875557 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:47.424010  875557 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:47.440607  875557 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 7 (689.417946ms)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:54:55.003051  875695 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:54:55.003351  875695 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:55.003378  875695 out.go:304] Setting ErrFile to fd 2...

	I0429 12:54:55.003385  875695 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:54:55.003590  875695 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:54:55.003797  875695 out.go:298] Setting JSON to false

	I0429 12:54:55.003832  875695 mustload.go:65] Loading cluster: ha-212075

	I0429 12:54:55.003982  875695 notify.go:220] Checking for updates...

	I0429 12:54:55.004432  875695 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:54:55.004454  875695 status.go:255] checking status of ha-212075 ...

	I0429 12:54:55.004941  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.005011  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.022581  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34201

	I0429 12:54:55.023163  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.023857  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.023884  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.024416  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.024675  875695 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:54:55.026461  875695 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:54:55.026486  875695 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:55.026920  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.026986  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.043508  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45415

	I0429 12:54:55.044028  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.044524  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.044549  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.044902  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.045111  875695 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:54:55.048074  875695 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:55.048491  875695 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:55.048519  875695 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:55.048732  875695 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:54:55.049045  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.049084  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.064784  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32821

	I0429 12:54:55.065175  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.065657  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.065681  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.066051  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.066283  875695 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:54:55.066504  875695 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:55.066532  875695 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:54:55.070075  875695 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:55.070600  875695 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:54:55.070645  875695 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:54:55.070822  875695 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:54:55.071061  875695 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:54:55.071279  875695 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:54:55.071488  875695 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:54:55.165641  875695 ssh_runner.go:195] Run: systemctl --version

	I0429 12:54:55.176628  875695 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:55.194684  875695 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:55.194728  875695 api_server.go:166] Checking apiserver status ...

	I0429 12:54:55.194772  875695 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:55.209965  875695 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:54:55.221184  875695 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:55.221262  875695 ssh_runner.go:195] Run: ls

	I0429 12:54:55.226493  875695 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:55.232722  875695 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:55.232758  875695 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:54:55.232773  875695 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:55.232796  875695 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:54:55.233116  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.233152  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.250094  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42427

	I0429 12:54:55.250575  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.251141  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.251172  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.251570  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.251776  875695 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:54:55.253683  875695 status.go:330] ha-212075-m02 host status = "Stopped" (err=<nil>)

	I0429 12:54:55.253706  875695 status.go:343] host is not running, skipping remaining checks

	I0429 12:54:55.253715  875695 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:55.253742  875695 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:54:55.254189  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.254247  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.270276  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43091

	I0429 12:54:55.270848  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.271468  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.271495  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.271814  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.272008  875695 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:54:55.273871  875695 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:54:55.273893  875695 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:55.274194  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.274219  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.291300  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39631

	I0429 12:54:55.291797  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.292292  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.292313  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.292619  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.292827  875695 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:54:55.295778  875695 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:55.296288  875695 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:55.296323  875695 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:55.296446  875695 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:54:55.296776  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.296830  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.316168  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36513

	I0429 12:54:55.316630  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.317285  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.317317  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.317693  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.317909  875695 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:54:55.318143  875695 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:55.318165  875695 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:54:55.321339  875695 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:55.321734  875695 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:54:55.321764  875695 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:54:55.322022  875695 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:54:55.322239  875695 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:54:55.322418  875695 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:54:55.322532  875695 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:54:55.408072  875695 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:55.426448  875695 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:54:55.426487  875695 api_server.go:166] Checking apiserver status ...

	I0429 12:54:55.426526  875695 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:54:55.442042  875695 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:54:55.453233  875695 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:54:55.453324  875695 ssh_runner.go:195] Run: ls

	I0429 12:54:55.458609  875695 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:54:55.463179  875695 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:54:55.463216  875695 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:54:55.463237  875695 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:54:55.463263  875695 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:54:55.463645  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.463704  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.480762  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45051

	I0429 12:54:55.481285  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.481776  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.481800  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.482141  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.482344  875695 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:54:55.484280  875695 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:54:55.484306  875695 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:55.484659  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.484704  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.500741  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46661

	I0429 12:54:55.501235  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.501812  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.501833  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.502149  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.502414  875695 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:54:55.505498  875695 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:55.506027  875695 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:55.506063  875695 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:55.506245  875695 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:54:55.506683  875695 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:54:55.506718  875695 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:54:55.523383  875695 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46443

	I0429 12:54:55.523872  875695 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:54:55.524375  875695 main.go:141] libmachine: Using API Version  1

	I0429 12:54:55.524405  875695 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:54:55.524748  875695 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:54:55.524977  875695 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:54:55.525202  875695 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:54:55.525229  875695 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:54:55.528224  875695 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:55.528669  875695 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:54:55.528705  875695 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:54:55.528857  875695 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:54:55.529042  875695 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:54:55.529200  875695 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:54:55.529337  875695 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:54:55.611446  875695 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:54:55.627207  875695 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr: exit status 7 (689.406211ms)

-- stdout --

	ha-212075

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-212075-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-212075-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 12:55:01.906098  875784 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:55:01.906252  875784 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:55:01.906262  875784 out.go:304] Setting ErrFile to fd 2...

	I0429 12:55:01.906266  875784 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:55:01.906489  875784 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:55:01.906758  875784 out.go:298] Setting JSON to false

	I0429 12:55:01.906790  875784 mustload.go:65] Loading cluster: ha-212075

	I0429 12:55:01.906920  875784 notify.go:220] Checking for updates...

	I0429 12:55:01.907298  875784 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:55:01.907317  875784 status.go:255] checking status of ha-212075 ...

	I0429 12:55:01.907783  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:01.907849  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:01.927071  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34291

	I0429 12:55:01.927760  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:01.928457  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:01.928487  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:01.928850  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:01.929054  875784 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:55:01.931335  875784 status.go:330] ha-212075 host status = "Running" (err=<nil>)

	I0429 12:55:01.931381  875784 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:55:01.931798  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:01.931874  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:01.950263  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46023

	I0429 12:55:01.950763  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:01.951565  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:01.951597  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:01.952052  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:01.952296  875784 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:55:01.955713  875784 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:55:01.956142  875784 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:55:01.956176  875784 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:55:01.956449  875784 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:55:01.956775  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:01.956833  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:01.973924  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44425

	I0429 12:55:01.974467  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:01.975076  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:01.975107  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:01.975481  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:01.975691  875784 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:55:01.975925  875784 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:55:01.975978  875784 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:55:01.979094  875784 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:55:01.979559  875784 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:55:01.979595  875784 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:55:01.979768  875784 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:55:01.979971  875784 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:55:01.980137  875784 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:55:01.980345  875784 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:55:02.068735  875784 ssh_runner.go:195] Run: systemctl --version

	I0429 12:55:02.079048  875784 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:55:02.096565  875784 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:55:02.096601  875784 api_server.go:166] Checking apiserver status ...

	I0429 12:55:02.096640  875784 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:55:02.112968  875784 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup

	W0429 12:55:02.125606  875784 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1177/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:55:02.125686  875784 ssh_runner.go:195] Run: ls

	I0429 12:55:02.130571  875784 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:55:02.135855  875784 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:55:02.135890  875784 status.go:422] ha-212075 apiserver status = Running (err=<nil>)

	I0429 12:55:02.135901  875784 status.go:257] ha-212075 status: &{Name:ha-212075 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:55:02.135923  875784 status.go:255] checking status of ha-212075-m02 ...

	I0429 12:55:02.136250  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:02.136279  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:02.153026  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45833

	I0429 12:55:02.153631  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:02.154204  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:02.154236  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:02.154569  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:02.154779  875784 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:55:02.156681  875784 status.go:330] ha-212075-m02 host status = "Stopped" (err=<nil>)

	I0429 12:55:02.156701  875784 status.go:343] host is not running, skipping remaining checks

	I0429 12:55:02.156707  875784 status.go:257] ha-212075-m02 status: &{Name:ha-212075-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:55:02.156729  875784 status.go:255] checking status of ha-212075-m03 ...

	I0429 12:55:02.157075  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:02.157115  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:02.172820  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36953

	I0429 12:55:02.173430  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:02.173991  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:02.174021  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:02.174370  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:02.174571  875784 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:55:02.176340  875784 status.go:330] ha-212075-m03 host status = "Running" (err=<nil>)

	I0429 12:55:02.176360  875784 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:55:02.176681  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:02.176748  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:02.193059  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44109

	I0429 12:55:02.193561  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:02.194203  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:02.194240  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:02.194640  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:02.194874  875784 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:55:02.197767  875784 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:55:02.198216  875784 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:55:02.198249  875784 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:55:02.198552  875784 host.go:66] Checking if "ha-212075-m03" exists ...

	I0429 12:55:02.198886  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:02.198914  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:02.216741  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44083

	I0429 12:55:02.217216  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:02.217659  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:02.217692  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:02.217997  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:02.218191  875784 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:55:02.218386  875784 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:55:02.218410  875784 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:55:02.221508  875784 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:55:02.221995  875784 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:55:02.222033  875784 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:55:02.222216  875784 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:55:02.222417  875784 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:55:02.222605  875784 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:55:02.222762  875784 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:55:02.308228  875784 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:55:02.326011  875784 kubeconfig.go:125] found "ha-212075" server: "https://192.168.39.254:8443"

	I0429 12:55:02.326045  875784 api_server.go:166] Checking apiserver status ...

	I0429 12:55:02.326092  875784 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:55:02.345047  875784 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup

	W0429 12:55:02.356922  875784 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1534/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 12:55:02.357041  875784 ssh_runner.go:195] Run: ls

	I0429 12:55:02.362417  875784 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 12:55:02.367046  875784 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 12:55:02.367089  875784 status.go:422] ha-212075-m03 apiserver status = Running (err=<nil>)

	I0429 12:55:02.367101  875784 status.go:257] ha-212075-m03 status: &{Name:ha-212075-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 12:55:02.367120  875784 status.go:255] checking status of ha-212075-m04 ...

	I0429 12:55:02.367588  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:02.367627  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:02.383748  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36719

	I0429 12:55:02.384205  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:02.384705  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:02.384726  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:02.385152  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:02.385376  875784 main.go:141] libmachine: (ha-212075-m04) Calling .GetState

	I0429 12:55:02.387081  875784 status.go:330] ha-212075-m04 host status = "Running" (err=<nil>)

	I0429 12:55:02.387102  875784 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:55:02.387427  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:02.387458  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:02.403521  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40003

	I0429 12:55:02.404068  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:02.404604  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:02.404630  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:02.404963  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:02.405175  875784 main.go:141] libmachine: (ha-212075-m04) Calling .GetIP

	I0429 12:55:02.408257  875784 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:55:02.408783  875784 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:55:02.408806  875784 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:55:02.408947  875784 host.go:66] Checking if "ha-212075-m04" exists ...

	I0429 12:55:02.409267  875784 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:55:02.409308  875784 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:55:02.427504  875784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36557

	I0429 12:55:02.428039  875784 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:55:02.428570  875784 main.go:141] libmachine: Using API Version  1

	I0429 12:55:02.428593  875784 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:55:02.429005  875784 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:55:02.429182  875784 main.go:141] libmachine: (ha-212075-m04) Calling .DriverName

	I0429 12:55:02.429466  875784 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 12:55:02.429501  875784 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHHostname

	I0429 12:55:02.432880  875784 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:55:02.433491  875784 main.go:141] libmachine: (ha-212075-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:83:05:31", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:50:55 +0000 UTC Type:0 Mac:52:54:00:83:05:31 Iaid: IPaddr:192.168.39.139 Prefix:24 Hostname:ha-212075-m04 Clientid:01:52:54:00:83:05:31}

	I0429 12:55:02.433559  875784 main.go:141] libmachine: (ha-212075-m04) DBG | domain ha-212075-m04 has defined IP address 192.168.39.139 and MAC address 52:54:00:83:05:31 in network mk-ha-212075

	I0429 12:55:02.433717  875784 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHPort

	I0429 12:55:02.433963  875784 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHKeyPath

	I0429 12:55:02.434142  875784 main.go:141] libmachine: (ha-212075-m04) Calling .GetSSHUsername

	I0429 12:55:02.434302  875784 sshutil.go:53] new ssh client: &{IP:192.168.39.139 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m04/id_rsa Username:docker}

	I0429 12:55:02.515911  875784 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:55:02.531180  875784 status.go:257] ha-212075-m04 status: &{Name:ha-212075-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-212075 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-212075 -n ha-212075

helpers_test.go:244: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-212075 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-212075 logs -n 25: (1.579075574s)

helpers_test.go:252: TestMultiControlPlane/serial/RestartSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m03:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075:/home/docker/cp-test_ha-212075-m03_ha-212075.txt                       |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075 sudo cat                                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m03_ha-212075.txt                                 |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m03:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m02:/home/docker/cp-test_ha-212075-m03_ha-212075-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m02 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m03_ha-212075-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m03:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04:/home/docker/cp-test_ha-212075-m03_ha-212075-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m04 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m03_ha-212075-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-212075 cp testdata/cp-test.txt                                                | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile1860612890/001/cp-test_ha-212075-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075:/home/docker/cp-test_ha-212075-m04_ha-212075.txt                       |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075 sudo cat                                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m04_ha-212075.txt                                 |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m02:/home/docker/cp-test_ha-212075-m04_ha-212075-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m02 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m04_ha-212075-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-212075 cp ha-212075-m04:/home/docker/cp-test.txt                              | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m03:/home/docker/cp-test_ha-212075-m04_ha-212075-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n                                                                 | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | ha-212075-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-212075 ssh -n ha-212075-m03 sudo cat                                          | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC | 29 Apr 24 12:51 UTC |

	|         | /home/docker/cp-test_ha-212075-m04_ha-212075-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-212075 node stop m02 -v=7                                                     | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:51 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-212075 node start m02 -v=7                                                    | ha-212075 | jenkins | v1.33.0 | 29 Apr 24 12:54 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/04/29 12:47:10

	Running on machine: ubuntu-20-agent-12

	Binary: Built with gc go1.22.1 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0429 12:47:10.677919  870218 out.go:291] Setting OutFile to fd 1 ...

	I0429 12:47:10.678233  870218 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:47:10.678243  870218 out.go:304] Setting ErrFile to fd 2...

	I0429 12:47:10.678248  870218 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 12:47:10.678446  870218 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18773-847310/.minikube/bin

	I0429 12:47:10.679112  870218 out.go:298] Setting JSON to false

	I0429 12:47:10.680123  870218 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-12","uptime":77376,"bootTime":1714317455,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0429 12:47:10.680195  870218 start.go:139] virtualization: kvm guest

	I0429 12:47:10.682364  870218 out.go:177] * [ha-212075] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	I0429 12:47:10.683575  870218 out.go:177]   - MINIKUBE_LOCATION=18773

	I0429 12:47:10.683620  870218 notify.go:220] Checking for updates...

	I0429 12:47:10.684719  870218 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0429 12:47:10.686075  870218 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:47:10.687233  870218 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:47:10.688452  870218 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0429 12:47:10.689537  870218 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0429 12:47:10.690735  870218 driver.go:392] Setting default libvirt URI to qemu:///system

	I0429 12:47:10.726918  870218 out.go:177] * Using the kvm2 driver based on user configuration

	I0429 12:47:10.728083  870218 start.go:297] selected driver: kvm2

	I0429 12:47:10.728096  870218 start.go:901] validating driver "kvm2" against <nil>

	I0429 12:47:10.728109  870218 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0429 12:47:10.728816  870218 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0429 12:47:10.728911  870218 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18773-847310/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0429 12:47:10.744767  870218 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0

	I0429 12:47:10.744835  870218 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0429 12:47:10.745104  870218 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 12:47:10.745163  870218 cni.go:84] Creating CNI manager for ""

	I0429 12:47:10.745175  870218 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0429 12:47:10.745180  870218 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0429 12:47:10.745248  870218 start.go:340] cluster config:

	{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0429 12:47:10.745350  870218 iso.go:125] acquiring lock: {Name:mk86e9cd005d09998272ae59568d4d340a1c61b2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0429 12:47:10.747127  870218 out.go:177] * Starting "ha-212075" primary control-plane node in "ha-212075" cluster

	I0429 12:47:10.748332  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:47:10.748369  870218 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4

	I0429 12:47:10.748377  870218 cache.go:56] Caching tarball of preloaded images

	I0429 12:47:10.748457  870218 preload.go:173] Found /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0429 12:47:10.748467  870218 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0429 12:47:10.748770  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:47:10.748791  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json: {Name:mkcbad01c1c0b2ec15b4df8b0dfb07d2b34331f5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:10.749013  870218 start.go:360] acquireMachinesLock for ha-212075: {Name:mk2ade588bdb49db467a1dc12f643b97a2b1f5bb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0429 12:47:10.749049  870218 start.go:364] duration metric: took 18.822µs to acquireMachinesLock for "ha-212075"

	I0429 12:47:10.749068  870218 start.go:93] Provisioning new machine with config: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:47:10.749132  870218 start.go:125] createHost starting for "" (driver="kvm2")

	I0429 12:47:10.750711  870218 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0429 12:47:10.750854  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:47:10.750892  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:47:10.766284  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42587

	I0429 12:47:10.766814  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:47:10.767483  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:47:10.767507  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:47:10.767857  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:47:10.768171  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:10.768384  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:10.768534  870218 start.go:159] libmachine.API.Create for "ha-212075" (driver="kvm2")

	I0429 12:47:10.768583  870218 client.go:168] LocalClient.Create starting

	I0429 12:47:10.768617  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem

	I0429 12:47:10.768656  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:47:10.768671  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:47:10.768720  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem

	I0429 12:47:10.768743  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:47:10.768756  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:47:10.768775  870218 main.go:141] libmachine: Running pre-create checks...

	I0429 12:47:10.768787  870218 main.go:141] libmachine: (ha-212075) Calling .PreCreateCheck

	I0429 12:47:10.769168  870218 main.go:141] libmachine: (ha-212075) Calling .GetConfigRaw

	I0429 12:47:10.769571  870218 main.go:141] libmachine: Creating machine...

	I0429 12:47:10.769586  870218 main.go:141] libmachine: (ha-212075) Calling .Create

	I0429 12:47:10.769732  870218 main.go:141] libmachine: (ha-212075) Creating KVM machine...

	I0429 12:47:10.771123  870218 main.go:141] libmachine: (ha-212075) DBG | found existing default KVM network

	I0429 12:47:10.771904  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:10.771751  870241 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1f0}

	I0429 12:47:10.771972  870218 main.go:141] libmachine: (ha-212075) DBG | created network xml: 

	I0429 12:47:10.771992  870218 main.go:141] libmachine: (ha-212075) DBG | <network>

	I0429 12:47:10.772001  870218 main.go:141] libmachine: (ha-212075) DBG |   <name>mk-ha-212075</name>

	I0429 12:47:10.772006  870218 main.go:141] libmachine: (ha-212075) DBG |   <dns enable='no'/>

	I0429 12:47:10.772013  870218 main.go:141] libmachine: (ha-212075) DBG |   

	I0429 12:47:10.772019  870218 main.go:141] libmachine: (ha-212075) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0429 12:47:10.772027  870218 main.go:141] libmachine: (ha-212075) DBG |     <dhcp>

	I0429 12:47:10.772033  870218 main.go:141] libmachine: (ha-212075) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0429 12:47:10.772045  870218 main.go:141] libmachine: (ha-212075) DBG |     </dhcp>

	I0429 12:47:10.772053  870218 main.go:141] libmachine: (ha-212075) DBG |   </ip>

	I0429 12:47:10.772063  870218 main.go:141] libmachine: (ha-212075) DBG |   

	I0429 12:47:10.772068  870218 main.go:141] libmachine: (ha-212075) DBG | </network>

	I0429 12:47:10.772075  870218 main.go:141] libmachine: (ha-212075) DBG | 

	I0429 12:47:10.777807  870218 main.go:141] libmachine: (ha-212075) DBG | trying to create private KVM network mk-ha-212075 192.168.39.0/24...

	I0429 12:47:10.853260  870218 main.go:141] libmachine: (ha-212075) DBG | private KVM network mk-ha-212075 192.168.39.0/24 created

	I0429 12:47:10.853342  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:10.853194  870241 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:47:10.853364  870218 main.go:141] libmachine: (ha-212075) Setting up store path in /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075 ...

	I0429 12:47:10.853387  870218 main.go:141] libmachine: (ha-212075) Building disk image from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0429 12:47:10.853475  870218 main.go:141] libmachine: (ha-212075) Downloading /home/jenkins/minikube-integration/18773-847310/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0429 12:47:11.125251  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:11.125115  870241 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa...

	I0429 12:47:11.350613  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:11.350414  870241 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/ha-212075.rawdisk...

	I0429 12:47:11.350656  870218 main.go:141] libmachine: (ha-212075) DBG | Writing magic tar header

	I0429 12:47:11.350671  870218 main.go:141] libmachine: (ha-212075) DBG | Writing SSH key tar header

	I0429 12:47:11.350683  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:11.350536  870241 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075 ...

	I0429 12:47:11.350697  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075

	I0429 12:47:11.350709  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines

	I0429 12:47:11.350722  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075 (perms=drwx------)

	I0429 12:47:11.350739  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines (perms=drwxr-xr-x)

	I0429 12:47:11.350747  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:47:11.350754  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube (perms=drwxr-xr-x)

	I0429 12:47:11.350764  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310 (perms=drwxrwxr-x)

	I0429 12:47:11.350775  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0429 12:47:11.350787  870218 main.go:141] libmachine: (ha-212075) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0429 12:47:11.350799  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310

	I0429 12:47:11.350806  870218 main.go:141] libmachine: (ha-212075) Creating domain...

	I0429 12:47:11.350818  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0429 12:47:11.350832  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home/jenkins

	I0429 12:47:11.350922  870218 main.go:141] libmachine: (ha-212075) DBG | Checking permissions on dir: /home

	I0429 12:47:11.350949  870218 main.go:141] libmachine: (ha-212075) DBG | Skipping /home - not owner

	I0429 12:47:11.352182  870218 main.go:141] libmachine: (ha-212075) define libvirt domain using xml: 

	I0429 12:47:11.352232  870218 main.go:141] libmachine: (ha-212075) <domain type='kvm'>

	I0429 12:47:11.352268  870218 main.go:141] libmachine: (ha-212075)   <name>ha-212075</name>

	I0429 12:47:11.352294  870218 main.go:141] libmachine: (ha-212075)   <memory unit='MiB'>2200</memory>

	I0429 12:47:11.352305  870218 main.go:141] libmachine: (ha-212075)   <vcpu>2</vcpu>

	I0429 12:47:11.352316  870218 main.go:141] libmachine: (ha-212075)   <features>

	I0429 12:47:11.352326  870218 main.go:141] libmachine: (ha-212075)     <acpi/>

	I0429 12:47:11.352337  870218 main.go:141] libmachine: (ha-212075)     <apic/>

	I0429 12:47:11.352346  870218 main.go:141] libmachine: (ha-212075)     <pae/>

	I0429 12:47:11.352372  870218 main.go:141] libmachine: (ha-212075)     

	I0429 12:47:11.352384  870218 main.go:141] libmachine: (ha-212075)   </features>

	I0429 12:47:11.352396  870218 main.go:141] libmachine: (ha-212075)   <cpu mode='host-passthrough'>

	I0429 12:47:11.352405  870218 main.go:141] libmachine: (ha-212075)   

	I0429 12:47:11.352415  870218 main.go:141] libmachine: (ha-212075)   </cpu>

	I0429 12:47:11.352424  870218 main.go:141] libmachine: (ha-212075)   <os>

	I0429 12:47:11.352435  870218 main.go:141] libmachine: (ha-212075)     <type>hvm</type>

	I0429 12:47:11.352446  870218 main.go:141] libmachine: (ha-212075)     <boot dev='cdrom'/>

	I0429 12:47:11.352456  870218 main.go:141] libmachine: (ha-212075)     <boot dev='hd'/>

	I0429 12:47:11.352472  870218 main.go:141] libmachine: (ha-212075)     <bootmenu enable='no'/>

	I0429 12:47:11.352482  870218 main.go:141] libmachine: (ha-212075)   </os>

	I0429 12:47:11.352492  870218 main.go:141] libmachine: (ha-212075)   <devices>

	I0429 12:47:11.352506  870218 main.go:141] libmachine: (ha-212075)     <disk type='file' device='cdrom'>

	I0429 12:47:11.352528  870218 main.go:141] libmachine: (ha-212075)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/boot2docker.iso'/>

	I0429 12:47:11.352546  870218 main.go:141] libmachine: (ha-212075)       <target dev='hdc' bus='scsi'/>

	I0429 12:47:11.352558  870218 main.go:141] libmachine: (ha-212075)       <readonly/>

	I0429 12:47:11.352571  870218 main.go:141] libmachine: (ha-212075)     </disk>

	I0429 12:47:11.352580  870218 main.go:141] libmachine: (ha-212075)     <disk type='file' device='disk'>

	I0429 12:47:11.352595  870218 main.go:141] libmachine: (ha-212075)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0429 12:47:11.352614  870218 main.go:141] libmachine: (ha-212075)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/ha-212075.rawdisk'/>

	I0429 12:47:11.352628  870218 main.go:141] libmachine: (ha-212075)       <target dev='hda' bus='virtio'/>

	I0429 12:47:11.352643  870218 main.go:141] libmachine: (ha-212075)     </disk>

	I0429 12:47:11.352660  870218 main.go:141] libmachine: (ha-212075)     <interface type='network'>

	I0429 12:47:11.352671  870218 main.go:141] libmachine: (ha-212075)       <source network='mk-ha-212075'/>

	I0429 12:47:11.352679  870218 main.go:141] libmachine: (ha-212075)       <model type='virtio'/>

	I0429 12:47:11.352691  870218 main.go:141] libmachine: (ha-212075)     </interface>

	I0429 12:47:11.352704  870218 main.go:141] libmachine: (ha-212075)     <interface type='network'>

	I0429 12:47:11.352714  870218 main.go:141] libmachine: (ha-212075)       <source network='default'/>

	I0429 12:47:11.352726  870218 main.go:141] libmachine: (ha-212075)       <model type='virtio'/>

	I0429 12:47:11.352736  870218 main.go:141] libmachine: (ha-212075)     </interface>

	I0429 12:47:11.352747  870218 main.go:141] libmachine: (ha-212075)     <serial type='pty'>

	I0429 12:47:11.352760  870218 main.go:141] libmachine: (ha-212075)       <target port='0'/>

	I0429 12:47:11.352770  870218 main.go:141] libmachine: (ha-212075)     </serial>

	I0429 12:47:11.352783  870218 main.go:141] libmachine: (ha-212075)     <console type='pty'>

	I0429 12:47:11.352796  870218 main.go:141] libmachine: (ha-212075)       <target type='serial' port='0'/>

	I0429 12:47:11.352807  870218 main.go:141] libmachine: (ha-212075)     </console>

	I0429 12:47:11.352818  870218 main.go:141] libmachine: (ha-212075)     <rng model='virtio'>

	I0429 12:47:11.352833  870218 main.go:141] libmachine: (ha-212075)       <backend model='random'>/dev/random</backend>

	I0429 12:47:11.352844  870218 main.go:141] libmachine: (ha-212075)     </rng>

	I0429 12:47:11.352851  870218 main.go:141] libmachine: (ha-212075)     

	I0429 12:47:11.352858  870218 main.go:141] libmachine: (ha-212075)     

	I0429 12:47:11.352867  870218 main.go:141] libmachine: (ha-212075)   </devices>

	I0429 12:47:11.352879  870218 main.go:141] libmachine: (ha-212075) </domain>

	I0429 12:47:11.352888  870218 main.go:141] libmachine: (ha-212075) 

	I0429 12:47:11.358129  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:b9:e2:15 in network default

	I0429 12:47:11.358761  870218 main.go:141] libmachine: (ha-212075) Ensuring networks are active...

	I0429 12:47:11.358785  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:11.359625  870218 main.go:141] libmachine: (ha-212075) Ensuring network default is active

	I0429 12:47:11.359939  870218 main.go:141] libmachine: (ha-212075) Ensuring network mk-ha-212075 is active

	I0429 12:47:11.360450  870218 main.go:141] libmachine: (ha-212075) Getting domain xml...

	I0429 12:47:11.361219  870218 main.go:141] libmachine: (ha-212075) Creating domain...

	I0429 12:47:12.584589  870218 main.go:141] libmachine: (ha-212075) Waiting to get IP...

	I0429 12:47:12.585394  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:12.585797  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:12.585868  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:12.585792  870241 retry.go:31] will retry after 305.881234ms: waiting for machine to come up

	I0429 12:47:12.893551  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:12.894049  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:12.894079  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:12.894024  870241 retry.go:31] will retry after 344.55293ms: waiting for machine to come up

	I0429 12:47:13.241013  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:13.241469  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:13.241496  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:13.241434  870241 retry.go:31] will retry after 343.048472ms: waiting for machine to come up

	I0429 12:47:13.586141  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:13.586605  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:13.586654  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:13.586558  870241 retry.go:31] will retry after 450.225843ms: waiting for machine to come up

	I0429 12:47:14.038240  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:14.038757  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:14.038783  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:14.038699  870241 retry.go:31] will retry after 523.602131ms: waiting for machine to come up

	I0429 12:47:14.563556  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:14.564014  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:14.564045  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:14.563929  870241 retry.go:31] will retry after 805.259699ms: waiting for machine to come up

	I0429 12:47:15.371056  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:15.371475  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:15.371526  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:15.371456  870241 retry.go:31] will retry after 966.64669ms: waiting for machine to come up

	I0429 12:47:16.339433  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:16.339834  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:16.339867  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:16.339785  870241 retry.go:31] will retry after 1.23057243s: waiting for machine to come up

	I0429 12:47:17.572420  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:17.572903  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:17.572937  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:17.572841  870241 retry.go:31] will retry after 1.383346304s: waiting for machine to come up

	I0429 12:47:18.958480  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:18.958907  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:18.958936  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:18.958868  870241 retry.go:31] will retry after 1.674064931s: waiting for machine to come up

	I0429 12:47:20.634352  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:20.634768  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:20.634806  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:20.634700  870241 retry.go:31] will retry after 2.486061293s: waiting for machine to come up

	I0429 12:47:23.122390  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:23.122875  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:23.122898  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:23.122835  870241 retry.go:31] will retry after 2.897978896s: waiting for machine to come up

	I0429 12:47:26.022310  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:26.022740  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:26.022767  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:26.022711  870241 retry.go:31] will retry after 2.882393702s: waiting for machine to come up

	I0429 12:47:28.908794  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:28.909215  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find current IP address of domain ha-212075 in network mk-ha-212075

	I0429 12:47:28.909242  870218 main.go:141] libmachine: (ha-212075) DBG | I0429 12:47:28.909174  870241 retry.go:31] will retry after 5.119530721s: waiting for machine to come up

	I0429 12:47:34.030038  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.030480  870218 main.go:141] libmachine: (ha-212075) Found IP for machine: 192.168.39.97

	I0429 12:47:34.030515  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has current primary IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.030535  870218 main.go:141] libmachine: (ha-212075) Reserving static IP address...

	I0429 12:47:34.030917  870218 main.go:141] libmachine: (ha-212075) DBG | unable to find host DHCP lease matching {name: "ha-212075", mac: "52:54:00:c0:56:df", ip: "192.168.39.97"} in network mk-ha-212075

	I0429 12:47:34.119852  870218 main.go:141] libmachine: (ha-212075) DBG | Getting to WaitForSSH function...

	I0429 12:47:34.119883  870218 main.go:141] libmachine: (ha-212075) Reserved static IP address: 192.168.39.97

	I0429 12:47:34.119897  870218 main.go:141] libmachine: (ha-212075) Waiting for SSH to be available...

	I0429 12:47:34.122597  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.123056  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:minikube Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.123087  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.123278  870218 main.go:141] libmachine: (ha-212075) DBG | Using SSH client type: external

	I0429 12:47:34.123304  870218 main.go:141] libmachine: (ha-212075) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa (-rw-------)

	I0429 12:47:34.123350  870218 main.go:141] libmachine: (ha-212075) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.97 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 12:47:34.123423  870218 main.go:141] libmachine: (ha-212075) DBG | About to run SSH command:

	I0429 12:47:34.123437  870218 main.go:141] libmachine: (ha-212075) DBG | exit 0

	I0429 12:47:34.255439  870218 main.go:141] libmachine: (ha-212075) DBG | SSH cmd err, output: <nil>: 

	I0429 12:47:34.255688  870218 main.go:141] libmachine: (ha-212075) KVM machine creation complete!

	I0429 12:47:34.256038  870218 main.go:141] libmachine: (ha-212075) Calling .GetConfigRaw

	I0429 12:47:34.256561  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:34.256768  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:34.256961  870218 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0429 12:47:34.256974  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:47:34.258344  870218 main.go:141] libmachine: Detecting operating system of created instance...

	I0429 12:47:34.258360  870218 main.go:141] libmachine: Waiting for SSH to be available...

	I0429 12:47:34.258367  870218 main.go:141] libmachine: Getting to WaitForSSH function...

	I0429 12:47:34.258376  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.260892  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.261301  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.261335  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.261457  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.261727  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.261875  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.261974  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.262143  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.262365  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.262379  870218 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0429 12:47:34.375070  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:47:34.375104  870218 main.go:141] libmachine: Detecting the provisioner...

	I0429 12:47:34.375116  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.377839  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.378225  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.378270  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.378421  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.378603  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.378801  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.378939  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.379246  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.379463  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.379477  870218 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0429 12:47:34.496702  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0429 12:47:34.496834  870218 main.go:141] libmachine: found compatible host: buildroot

	I0429 12:47:34.496850  870218 main.go:141] libmachine: Provisioning with buildroot...

	I0429 12:47:34.496862  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:34.497129  870218 buildroot.go:166] provisioning hostname "ha-212075"

	I0429 12:47:34.497157  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:34.497396  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.500100  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.500522  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.500549  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.500743  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.500984  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.501170  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.501329  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.501491  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.501694  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.501709  870218 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-212075 && echo "ha-212075" | sudo tee /etc/hostname

	I0429 12:47:34.639970  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-212075

	I0429 12:47:34.640000  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.643277  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.643700  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.643736  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.643969  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.644183  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.644395  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.644531  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.644725  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:34.644909  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:34.644929  870218 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-212075' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-212075/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-212075' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0429 12:47:34.769813  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:47:34.769862  870218 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18773-847310/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-847310/.minikube}

	I0429 12:47:34.769887  870218 buildroot.go:174] setting up certificates

	I0429 12:47:34.769902  870218 provision.go:84] configureAuth start

	I0429 12:47:34.769920  870218 main.go:141] libmachine: (ha-212075) Calling .GetMachineName

	I0429 12:47:34.770254  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:34.773213  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.773664  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.773697  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.773877  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.776462  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.776823  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.776853  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.777023  870218 provision.go:143] copyHostCerts

	I0429 12:47:34.777061  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:47:34.777107  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem, removing ...

	I0429 12:47:34.777120  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:47:34.777220  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem (1078 bytes)

	I0429 12:47:34.777336  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:47:34.777363  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem, removing ...

	I0429 12:47:34.777371  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:47:34.777417  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem (1123 bytes)

	I0429 12:47:34.777495  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:47:34.777518  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem, removing ...

	I0429 12:47:34.777525  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:47:34.777561  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem (1679 bytes)

	I0429 12:47:34.777648  870218 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem org=jenkins.ha-212075 san=[127.0.0.1 192.168.39.97 ha-212075 localhost minikube]

	I0429 12:47:34.986246  870218 provision.go:177] copyRemoteCerts

	I0429 12:47:34.986315  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0429 12:47:34.986343  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:34.989211  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.989554  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:34.989587  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:34.989780  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:34.990033  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:34.990225  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:34.990326  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.077898  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0429 12:47:35.078002  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0429 12:47:35.103811  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0429 12:47:35.103903  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)

	I0429 12:47:35.130521  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0429 12:47:35.130625  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0429 12:47:35.158296  870218 provision.go:87] duration metric: took 388.331009ms to configureAuth

	I0429 12:47:35.158348  870218 buildroot.go:189] setting minikube options for container-runtime

	I0429 12:47:35.158647  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:47:35.158755  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.162096  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.162516  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.162550  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.162789  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.163036  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.163228  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.163376  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.163547  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:35.163779  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:35.163806  870218 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0429 12:47:35.454761  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0429 12:47:35.454801  870218 main.go:141] libmachine: Checking connection to Docker...

	I0429 12:47:35.454812  870218 main.go:141] libmachine: (ha-212075) Calling .GetURL

	I0429 12:47:35.456291  870218 main.go:141] libmachine: (ha-212075) DBG | Using libvirt version 6000000

	I0429 12:47:35.459567  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.459976  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.460009  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.460156  870218 main.go:141] libmachine: Docker is up and running!

	I0429 12:47:35.460174  870218 main.go:141] libmachine: Reticulating splines...

	I0429 12:47:35.460182  870218 client.go:171] duration metric: took 24.691589554s to LocalClient.Create

	I0429 12:47:35.460213  870218 start.go:167] duration metric: took 24.691680665s to libmachine.API.Create "ha-212075"

	I0429 12:47:35.460226  870218 start.go:293] postStartSetup for "ha-212075" (driver="kvm2")

	I0429 12:47:35.460240  870218 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0429 12:47:35.460264  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.460530  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0429 12:47:35.460565  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.462997  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.463401  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.463421  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.463619  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.463842  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.463989  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.464114  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.554760  870218 ssh_runner.go:195] Run: cat /etc/os-release

	I0429 12:47:35.559334  870218 info.go:137] Remote host: Buildroot 2023.02.9

	I0429 12:47:35.559381  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/addons for local assets ...

	I0429 12:47:35.559459  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/files for local assets ...

	I0429 12:47:35.559534  870218 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> 8546602.pem in /etc/ssl/certs

	I0429 12:47:35.559544  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /etc/ssl/certs/8546602.pem

	I0429 12:47:35.559645  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0429 12:47:35.569671  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:47:35.596267  870218 start.go:296] duration metric: took 136.022682ms for postStartSetup

	I0429 12:47:35.596345  870218 main.go:141] libmachine: (ha-212075) Calling .GetConfigRaw

	I0429 12:47:35.596981  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:35.599978  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.600353  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.600383  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.600634  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:47:35.600866  870218 start.go:128] duration metric: took 24.851721937s to createHost

	I0429 12:47:35.600897  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.603199  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.603644  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.603674  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.603745  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.603970  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.604159  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.604339  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.604533  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:47:35.604712  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0429 12:47:35.604729  870218 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0429 12:47:35.720740  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714394855.695919494

	I0429 12:47:35.720765  870218 fix.go:216] guest clock: 1714394855.695919494

	I0429 12:47:35.720776  870218 fix.go:229] Guest: 2024-04-29 12:47:35.695919494 +0000 UTC Remote: 2024-04-29 12:47:35.600880557 +0000 UTC m=+24.976033512 (delta=95.038937ms)

	I0429 12:47:35.720806  870218 fix.go:200] guest clock delta is within tolerance: 95.038937ms

	I0429 12:47:35.720812  870218 start.go:83] releasing machines lock for "ha-212075", held for 24.971753151s

	I0429 12:47:35.720837  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.721124  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:35.723665  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.724032  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.724067  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.724221  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.724774  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.724980  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:47:35.725072  870218 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0429 12:47:35.725118  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.725227  870218 ssh_runner.go:195] Run: cat /version.json

	I0429 12:47:35.725260  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:47:35.728155  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728311  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728537  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.728566  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728669  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:35.728701  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:35.728731  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.728877  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:47:35.728952  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.729132  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.729136  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:47:35.729304  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:47:35.729322  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.729443  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:47:35.837269  870218 ssh_runner.go:195] Run: systemctl --version

	I0429 12:47:35.844092  870218 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0429 12:47:36.005807  870218 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0429 12:47:36.012800  870218 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0429 12:47:36.012902  870218 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0429 12:47:36.030274  870218 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0429 12:47:36.030311  870218 start.go:494] detecting cgroup driver to use...

	I0429 12:47:36.030402  870218 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0429 12:47:36.046974  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0429 12:47:36.061895  870218 docker.go:217] disabling cri-docker service (if available) ...

	I0429 12:47:36.061982  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0429 12:47:36.076800  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0429 12:47:36.091454  870218 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0429 12:47:36.211024  870218 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0429 12:47:36.351716  870218 docker.go:233] disabling docker service ...

	I0429 12:47:36.351802  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0429 12:47:36.367728  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0429 12:47:36.381746  870218 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0429 12:47:36.521448  870218 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0429 12:47:36.643441  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0429 12:47:36.658397  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0429 12:47:36.678361  870218 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0429 12:47:36.678431  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.690326  870218 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0429 12:47:36.690412  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.702156  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.714496  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.726598  870218 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0429 12:47:36.739087  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.750643  870218 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.769859  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:47:36.781534  870218 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0429 12:47:36.791887  870218 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0429 12:47:36.791968  870218 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0429 12:47:36.806869  870218 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0429 12:47:36.817796  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:47:36.937337  870218 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0429 12:47:37.079704  870218 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0429 12:47:37.079785  870218 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0429 12:47:37.084919  870218 start.go:562] Will wait 60s for crictl version

	I0429 12:47:37.085054  870218 ssh_runner.go:195] Run: which crictl

	I0429 12:47:37.089276  870218 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0429 12:47:37.132022  870218 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0429 12:47:37.132124  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:47:37.162365  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:47:37.194434  870218 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0429 12:47:37.195855  870218 main.go:141] libmachine: (ha-212075) Calling .GetIP

	I0429 12:47:37.198800  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:37.199235  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:47:37.199265  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:47:37.199505  870218 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0429 12:47:37.203973  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:47:37.217992  870218 kubeadm.go:877] updating cluster {Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cl

usterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mo

untType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0429 12:47:37.218119  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:47:37.218170  870218 ssh_runner.go:195] Run: sudo crictl images --output json

	I0429 12:47:37.254058  870218 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0". assuming images are not preloaded.

	I0429 12:47:37.254136  870218 ssh_runner.go:195] Run: which lz4

	I0429 12:47:37.258626  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0429 12:47:37.258735  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0429 12:47:37.263492  870218 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0429 12:47:37.263531  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394544937 bytes)

	I0429 12:47:38.827807  870218 crio.go:462] duration metric: took 1.569087769s to copy over tarball

	I0429 12:47:38.827894  870218 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0429 12:47:41.114738  870218 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.286814073s)

	I0429 12:47:41.114772  870218 crio.go:469] duration metric: took 2.286930667s to extract the tarball

	I0429 12:47:41.114780  870218 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0429 12:47:41.153797  870218 ssh_runner.go:195] Run: sudo crictl images --output json

	I0429 12:47:41.199426  870218 crio.go:514] all images are preloaded for cri-o runtime.

	I0429 12:47:41.199455  870218 cache_images.go:84] Images are preloaded, skipping loading

	I0429 12:47:41.199464  870218 kubeadm.go:928] updating node { 192.168.39.97 8443 v1.30.0 crio true true} ...

	I0429 12:47:41.199578  870218 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-212075 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.97

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0429 12:47:41.199653  870218 ssh_runner.go:195] Run: crio config

	I0429 12:47:41.250499  870218 cni.go:84] Creating CNI manager for ""

	I0429 12:47:41.250526  870218 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0429 12:47:41.250537  870218 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0429 12:47:41.250559  870218 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.97 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-212075 NodeName:ha-212075 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.97"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.97 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes/m

anifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0429 12:47:41.250705  870218 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.97

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-212075"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.97

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.97"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0429 12:47:41.250732  870218 kube-vip.go:111] generating kube-vip config ...

	I0429 12:47:41.250777  870218 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0429 12:47:41.269494  870218 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0429 12:47:41.269627  870218 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0429 12:47:41.269685  870218 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0429 12:47:41.280555  870218 binaries.go:44] Found k8s binaries, skipping transfer

	I0429 12:47:41.280644  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0429 12:47:41.291333  870218 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (308 bytes)

	I0429 12:47:41.310105  870218 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0429 12:47:41.328730  870218 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2150 bytes)

	I0429 12:47:41.347634  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1352 bytes)

	I0429 12:47:41.365931  870218 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0429 12:47:41.370302  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:47:41.383866  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:47:41.512387  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:47:41.530551  870218 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075 for IP: 192.168.39.97

	I0429 12:47:41.530581  870218 certs.go:194] generating shared ca certs ...

	I0429 12:47:41.530604  870218 certs.go:226] acquiring lock for ca certs: {Name:mk6be02e49d8ee7e457b7d9b7cd478c5e883ea66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:41.530779  870218 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key

	I0429 12:47:41.530833  870218 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key

	I0429 12:47:41.530848  870218 certs.go:256] generating profile certs ...

	I0429 12:47:41.530915  870218 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key

	I0429 12:47:41.530951  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt with IP's: []

	I0429 12:47:41.722700  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt ...

	I0429 12:47:41.722741  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt: {Name:mk4f0aba10f064735148f15f887ea67a1137a3b8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:41.722964  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key ...

	I0429 12:47:41.722982  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key: {Name:mkaee3859a995806ed485f81a0abcc895804c08c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:41.723093  870218 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294

	I0429 12:47:41.723113  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.97 192.168.39.254]

	I0429 12:47:42.017824  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294 ...

	I0429 12:47:42.017866  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294: {Name:mk192112794ed2eccfcd600bb5d5c95e549cded1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.018075  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294 ...

	I0429 12:47:42.018095  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294: {Name:mka4cfea4c0ea9fde780611847d7c0973ea6230b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.018201  870218 certs.go:381] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.e46b5294 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt

	I0429 12:47:42.018327  870218 certs.go:385] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.e46b5294 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key

	I0429 12:47:42.018421  870218 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key

	I0429 12:47:42.018445  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt with IP's: []

	I0429 12:47:42.170382  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt ...

	I0429 12:47:42.170425  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt: {Name:mk2c7c2efcf55e17dae029e8d8b23a5d23f2d657 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.170634  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key ...

	I0429 12:47:42.170652  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key: {Name:mk8ce0121b4c42805c1956fc1acf6c7e5ee80e96 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:47:42.170754  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0429 12:47:42.170777  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0429 12:47:42.170794  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0429 12:47:42.170816  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0429 12:47:42.170839  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0429 12:47:42.170869  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0429 12:47:42.170896  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0429 12:47:42.170915  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0429 12:47:42.170984  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem (1338 bytes)

	W0429 12:47:42.171032  870218 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660_empty.pem, impossibly tiny 0 bytes

	I0429 12:47:42.171059  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem (1679 bytes)

	I0429 12:47:42.171091  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem (1078 bytes)

	I0429 12:47:42.171131  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem (1123 bytes)

	I0429 12:47:42.171221  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem (1679 bytes)

	I0429 12:47:42.171302  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:47:42.171349  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.171385  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem -> /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.171405  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.172051  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0429 12:47:42.204925  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0429 12:47:42.233610  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0429 12:47:42.265193  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0429 12:47:42.292433  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0429 12:47:42.326458  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0429 12:47:42.356962  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0429 12:47:42.386083  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0429 12:47:42.418703  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0429 12:47:42.450096  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem --> /usr/share/ca-certificates/854660.pem (1338 bytes)

	I0429 12:47:42.477246  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /usr/share/ca-certificates/8546602.pem (1708 bytes)

	I0429 12:47:42.506751  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0429 12:47:42.528244  870218 ssh_runner.go:195] Run: openssl version

	I0429 12:47:42.534899  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/854660.pem && ln -fs /usr/share/ca-certificates/854660.pem /etc/ssl/certs/854660.pem"

	I0429 12:47:42.548693  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.554530  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 12:39 /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.554605  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/854660.pem

	I0429 12:47:42.561916  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/854660.pem /etc/ssl/certs/51391683.0"

	I0429 12:47:42.575762  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8546602.pem && ln -fs /usr/share/ca-certificates/8546602.pem /etc/ssl/certs/8546602.pem"

	I0429 12:47:42.589167  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.594723  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 12:39 /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.594814  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8546602.pem

	I0429 12:47:42.602038  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8546602.pem /etc/ssl/certs/3ec20f2e.0"

	I0429 12:47:42.615369  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0429 12:47:42.628913  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.634531  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:59 /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.634595  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:47:42.641566  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0429 12:47:42.655039  870218 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0429 12:47:42.659883  870218 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0429 12:47:42.659966  870218 kubeadm.go:391] StartCluster: {Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Clust

erName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mount

Type:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 12:47:42.660127  870218 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0429 12:47:42.660199  870218 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0429 12:47:42.701855  870218 cri.go:89] found id: ""

	I0429 12:47:42.701934  870218 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0429 12:47:42.712771  870218 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0429 12:47:42.723461  870218 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0429 12:47:42.735142  870218 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0429 12:47:42.735166  870218 kubeadm.go:156] found existing configuration files:

	I0429 12:47:42.735214  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0429 12:47:42.745568  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0429 12:47:42.745651  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0429 12:47:42.756257  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0429 12:47:42.767063  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0429 12:47:42.767142  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0429 12:47:42.778879  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0429 12:47:42.789320  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0429 12:47:42.789402  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0429 12:47:42.800240  870218 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0429 12:47:42.810530  870218 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0429 12:47:42.810605  870218 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0429 12:47:42.821530  870218 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0429 12:47:42.934280  870218 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0

	I0429 12:47:42.934357  870218 kubeadm.go:309] [preflight] Running pre-flight checks

	I0429 12:47:43.080585  870218 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0429 12:47:43.080749  870218 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0429 12:47:43.080883  870218 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0429 12:47:43.332866  870218 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0429 12:47:43.342245  870218 out.go:204]   - Generating certificates and keys ...

	I0429 12:47:43.342415  870218 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0429 12:47:43.342525  870218 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0429 12:47:43.667747  870218 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0429 12:47:43.718862  870218 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0429 12:47:43.877370  870218 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0429 12:47:43.955431  870218 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0429 12:47:44.025648  870218 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0429 12:47:44.025818  870218 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-212075 localhost] and IPs [192.168.39.97 127.0.0.1 ::1]

	I0429 12:47:44.114660  870218 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0429 12:47:44.114839  870218 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-212075 localhost] and IPs [192.168.39.97 127.0.0.1 ::1]

	I0429 12:47:44.454769  870218 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0429 12:47:44.530738  870218 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0429 12:47:44.602193  870218 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0429 12:47:44.602286  870218 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0429 12:47:44.691879  870218 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0429 12:47:44.867537  870218 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0429 12:47:44.989037  870218 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0429 12:47:45.099892  870218 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0429 12:47:45.247531  870218 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0429 12:47:45.248041  870218 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0429 12:47:45.251054  870218 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0429 12:47:45.254247  870218 out.go:204]   - Booting up control plane ...

	I0429 12:47:45.254379  870218 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0429 12:47:45.254461  870218 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0429 12:47:45.254540  870218 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0429 12:47:45.269826  870218 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0429 12:47:45.270735  870218 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0429 12:47:45.270791  870218 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0429 12:47:45.415518  870218 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0429 12:47:45.415641  870218 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0429 12:47:46.416954  870218 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.002166461s

	I0429 12:47:46.417061  870218 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0429 12:47:52.416938  870218 kubeadm.go:309] [api-check] The API server is healthy after 6.003166313s

	I0429 12:47:52.433395  870218 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0429 12:47:52.450424  870218 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0429 12:47:52.481163  870218 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0429 12:47:52.481367  870218 kubeadm.go:309] [mark-control-plane] Marking the node ha-212075 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0429 12:47:52.494539  870218 kubeadm.go:309] [bootstrap-token] Using token: oy0k5e.zul1f1ey7gnfr2ai

	I0429 12:47:52.496157  870218 out.go:204]   - Configuring RBAC rules ...

	I0429 12:47:52.496331  870218 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0429 12:47:52.502259  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0429 12:47:52.511107  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0429 12:47:52.515407  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0429 12:47:52.518870  870218 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0429 12:47:52.527162  870218 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0429 12:47:52.824005  870218 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0429 12:47:53.332771  870218 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0429 12:47:53.824147  870218 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0429 12:47:53.825228  870218 kubeadm.go:309] 

	I0429 12:47:53.825297  870218 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0429 12:47:53.825327  870218 kubeadm.go:309] 

	I0429 12:47:53.825444  870218 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0429 12:47:53.825457  870218 kubeadm.go:309] 

	I0429 12:47:53.825521  870218 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0429 12:47:53.825634  870218 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0429 12:47:53.825715  870218 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0429 12:47:53.825748  870218 kubeadm.go:309] 

	I0429 12:47:53.825830  870218 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0429 12:47:53.825842  870218 kubeadm.go:309] 

	I0429 12:47:53.825919  870218 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0429 12:47:53.825928  870218 kubeadm.go:309] 

	I0429 12:47:53.826008  870218 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0429 12:47:53.826118  870218 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0429 12:47:53.826239  870218 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0429 12:47:53.826252  870218 kubeadm.go:309] 

	I0429 12:47:53.826371  870218 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0429 12:47:53.826475  870218 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0429 12:47:53.826494  870218 kubeadm.go:309] 

	I0429 12:47:53.826613  870218 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token oy0k5e.zul1f1ey7gnfr2ai \

	I0429 12:47:53.826769  870218 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 \

	I0429 12:47:53.826807  870218 kubeadm.go:309] 	--control-plane 

	I0429 12:47:53.826817  870218 kubeadm.go:309] 

	I0429 12:47:53.826927  870218 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0429 12:47:53.826938  870218 kubeadm.go:309] 

	I0429 12:47:53.827054  870218 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token oy0k5e.zul1f1ey7gnfr2ai \

	I0429 12:47:53.827204  870218 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 

	I0429 12:47:53.827540  870218 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0429 12:47:53.827637  870218 cni.go:84] Creating CNI manager for ""

	I0429 12:47:53.827661  870218 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0429 12:47:53.829635  870218 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0429 12:47:53.831034  870218 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0429 12:47:53.837177  870218 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.0/kubectl ...

	I0429 12:47:53.837201  870218 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0429 12:47:53.857011  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0429 12:47:54.316710  870218 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0429 12:47:54.316795  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:54.316822  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-212075 minikube.k8s.io/updated_at=2024_04_29T12_47_54_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332 minikube.k8s.io/name=ha-212075 minikube.k8s.io/primary=true

	I0429 12:47:54.345797  870218 ops.go:34] apiserver oom_adj: -16

	I0429 12:47:54.496882  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:54.997852  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:55.497076  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:55.997178  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:56.497134  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:56.997042  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:57.497933  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:57.997275  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:58.496967  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:58.997579  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:59.497467  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:47:59.996968  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:00.497065  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:00.996897  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:01.497143  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:01.997850  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:02.497748  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:02.997561  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:03.497638  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:03.997996  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:04.497993  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:04.997647  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:05.497664  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:05.996988  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:06.497690  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:06.997830  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0429 12:48:07.106754  870218 kubeadm.go:1107] duration metric: took 12.790030758s to wait for elevateKubeSystemPrivileges

	W0429 12:48:07.106816  870218 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0429 12:48:07.106828  870218 kubeadm.go:393] duration metric: took 24.446869371s to StartCluster

	I0429 12:48:07.106853  870218 settings.go:142] acquiring lock: {Name:mkfc2a12c970f9efb6ef840042bb7ab028a1a307 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:07.106931  870218 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:48:07.107757  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/kubeconfig: {Name:mkadb918f2b0432255c1cf69aa2465afc0e639c8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:07.108054  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0429 12:48:07.108076  870218 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]

	I0429 12:48:07.108170  870218 addons.go:69] Setting storage-provisioner=true in profile "ha-212075"

	I0429 12:48:07.108059  870218 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:48:07.108227  870218 addons.go:234] Setting addon storage-provisioner=true in "ha-212075"

	I0429 12:48:07.108236  870218 start.go:240] waiting for startup goroutines ...

	I0429 12:48:07.108272  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:07.108274  870218 addons.go:69] Setting default-storageclass=true in profile "ha-212075"

	I0429 12:48:07.108298  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:07.108318  870218 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-212075"

	I0429 12:48:07.108698  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.108711  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.108741  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.108818  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.125835  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34041

	I0429 12:48:07.125855  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34713

	I0429 12:48:07.126384  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.126392  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.126889  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.126907  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.127043  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.127070  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.127240  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.127469  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.127687  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:07.127850  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.127884  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.130130  870218 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:48:07.130484  870218 kapi.go:59] client config for ha-212075: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt", KeyFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key", CAFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0429 12:48:07.131110  870218 cert_rotation.go:137] Starting client certificate rotation controller

	I0429 12:48:07.131444  870218 addons.go:234] Setting addon default-storageclass=true in "ha-212075"

	I0429 12:48:07.131495  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:07.131891  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.131942  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.145217  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33429

	I0429 12:48:07.145713  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.146291  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.146318  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.146674  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.146921  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:07.147889  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40861

	I0429 12:48:07.148424  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.148984  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.149009  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.149027  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:07.151195  870218 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0429 12:48:07.149400  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.151835  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:07.152779  870218 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0429 12:48:07.152793  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0429 12:48:07.152798  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:07.152812  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:07.156024  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.156453  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:07.156481  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.156627  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:07.156875  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:07.157054  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:07.157212  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:07.169582  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42165

	I0429 12:48:07.170085  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:07.170658  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:07.170689  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:07.171047  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:07.171293  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:07.172975  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:07.173320  870218 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0429 12:48:07.173343  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0429 12:48:07.173366  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:07.176220  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.176648  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:07.176680  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:07.176863  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:07.177079  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:07.177269  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:07.177438  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:07.266153  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0429 12:48:07.412582  870218 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0429 12:48:07.452705  870218 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0429 12:48:08.095864  870218 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0429 12:48:08.460264  870218 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (1.047632478s)

	I0429 12:48:08.460335  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460334  870218 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (1.007583898s)

	I0429 12:48:08.460382  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460397  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.460349  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.460782  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.460798  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.460807  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460814  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.460874  870218 main.go:141] libmachine: (ha-212075) DBG | Closing plugin on server side

	I0429 12:48:08.460931  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.460951  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.460968  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.460979  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.461022  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.461036  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.461284  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.461303  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.461463  870218 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0429 12:48:08.461474  870218 round_trippers.go:469] Request Headers:

	I0429 12:48:08.461491  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:48:08.461497  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:48:08.472509  870218 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0429 12:48:08.473158  870218 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0429 12:48:08.473177  870218 round_trippers.go:469] Request Headers:

	I0429 12:48:08.473184  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:48:08.473189  870218 round_trippers.go:473]     Content-Type: application/json

	I0429 12:48:08.473191  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:48:08.476542  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:48:08.476725  870218 main.go:141] libmachine: Making call to close driver server

	I0429 12:48:08.476745  870218 main.go:141] libmachine: (ha-212075) Calling .Close

	I0429 12:48:08.477033  870218 main.go:141] libmachine: Successfully made call to close driver server

	I0429 12:48:08.477052  870218 main.go:141] libmachine: Making call to close connection to plugin binary

	I0429 12:48:08.477060  870218 main.go:141] libmachine: (ha-212075) DBG | Closing plugin on server side

	I0429 12:48:08.479794  870218 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0429 12:48:08.481166  870218 addons.go:505] duration metric: took 1.373080963s for enable addons: enabled=[storage-provisioner default-storageclass]

	I0429 12:48:08.481216  870218 start.go:245] waiting for cluster config update ...

	I0429 12:48:08.481256  870218 start.go:254] writing updated cluster config ...

	I0429 12:48:08.482945  870218 out.go:177] 

	I0429 12:48:08.484429  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:08.484522  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:48:08.486369  870218 out.go:177] * Starting "ha-212075-m02" control-plane node in "ha-212075" cluster

	I0429 12:48:08.487634  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:48:08.487679  870218 cache.go:56] Caching tarball of preloaded images

	I0429 12:48:08.487783  870218 preload.go:173] Found /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0429 12:48:08.487798  870218 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0429 12:48:08.487893  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:48:08.488101  870218 start.go:360] acquireMachinesLock for ha-212075-m02: {Name:mk2ade588bdb49db467a1dc12f643b97a2b1f5bb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0429 12:48:08.488155  870218 start.go:364] duration metric: took 29.185µs to acquireMachinesLock for "ha-212075-m02"

	I0429 12:48:08.488180  870218 start.go:93] Provisioning new machine with config: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cert

Expiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:48:08.488293  870218 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0429 12:48:08.489965  870218 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0429 12:48:08.490069  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:08.490097  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:08.506743  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37965

	I0429 12:48:08.507216  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:08.507765  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:08.507789  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:08.508188  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:08.508403  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:08.508606  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:08.508820  870218 start.go:159] libmachine.API.Create for "ha-212075" (driver="kvm2")

	I0429 12:48:08.508849  870218 client.go:168] LocalClient.Create starting

	I0429 12:48:08.508889  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem

	I0429 12:48:08.508932  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:48:08.508969  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:48:08.509048  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem

	I0429 12:48:08.509075  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:48:08.509094  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:48:08.509130  870218 main.go:141] libmachine: Running pre-create checks...

	I0429 12:48:08.509143  870218 main.go:141] libmachine: (ha-212075-m02) Calling .PreCreateCheck

	I0429 12:48:08.509327  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetConfigRaw

	I0429 12:48:08.509720  870218 main.go:141] libmachine: Creating machine...

	I0429 12:48:08.509736  870218 main.go:141] libmachine: (ha-212075-m02) Calling .Create

	I0429 12:48:08.509878  870218 main.go:141] libmachine: (ha-212075-m02) Creating KVM machine...

	I0429 12:48:08.511329  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found existing default KVM network

	I0429 12:48:08.511504  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found existing private KVM network mk-ha-212075

	I0429 12:48:08.511675  870218 main.go:141] libmachine: (ha-212075-m02) Setting up store path in /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02 ...

	I0429 12:48:08.511701  870218 main.go:141] libmachine: (ha-212075-m02) Building disk image from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0429 12:48:08.511754  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.511637  870647 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:48:08.511870  870218 main.go:141] libmachine: (ha-212075-m02) Downloading /home/jenkins/minikube-integration/18773-847310/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0429 12:48:08.772309  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.772142  870647 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa...

	I0429 12:48:08.898179  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.898033  870647 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/ha-212075-m02.rawdisk...

	I0429 12:48:08.898251  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Writing magic tar header

	I0429 12:48:08.898270  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Writing SSH key tar header

	I0429 12:48:08.898287  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:08.898155  870647 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02 ...

	I0429 12:48:08.898330  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02

	I0429 12:48:08.898347  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines

	I0429 12:48:08.898361  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02 (perms=drwx------)

	I0429 12:48:08.898387  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines (perms=drwxr-xr-x)

	I0429 12:48:08.898401  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube (perms=drwxr-xr-x)

	I0429 12:48:08.898435  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310 (perms=drwxrwxr-x)

	I0429 12:48:08.898449  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:48:08.898463  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310

	I0429 12:48:08.898477  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0429 12:48:08.898494  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home/jenkins

	I0429 12:48:08.898504  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Checking permissions on dir: /home

	I0429 12:48:08.898517  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Skipping /home - not owner

	I0429 12:48:08.898531  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0429 12:48:08.898551  870218 main.go:141] libmachine: (ha-212075-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0429 12:48:08.898567  870218 main.go:141] libmachine: (ha-212075-m02) Creating domain...

	I0429 12:48:08.899629  870218 main.go:141] libmachine: (ha-212075-m02) define libvirt domain using xml: 

	I0429 12:48:08.899656  870218 main.go:141] libmachine: (ha-212075-m02) <domain type='kvm'>

	I0429 12:48:08.899663  870218 main.go:141] libmachine: (ha-212075-m02)   <name>ha-212075-m02</name>

	I0429 12:48:08.899669  870218 main.go:141] libmachine: (ha-212075-m02)   <memory unit='MiB'>2200</memory>

	I0429 12:48:08.899677  870218 main.go:141] libmachine: (ha-212075-m02)   <vcpu>2</vcpu>

	I0429 12:48:08.899684  870218 main.go:141] libmachine: (ha-212075-m02)   <features>

	I0429 12:48:08.899692  870218 main.go:141] libmachine: (ha-212075-m02)     <acpi/>

	I0429 12:48:08.899699  870218 main.go:141] libmachine: (ha-212075-m02)     <apic/>

	I0429 12:48:08.899709  870218 main.go:141] libmachine: (ha-212075-m02)     <pae/>

	I0429 12:48:08.899714  870218 main.go:141] libmachine: (ha-212075-m02)     

	I0429 12:48:08.899733  870218 main.go:141] libmachine: (ha-212075-m02)   </features>

	I0429 12:48:08.899744  870218 main.go:141] libmachine: (ha-212075-m02)   <cpu mode='host-passthrough'>

	I0429 12:48:08.899749  870218 main.go:141] libmachine: (ha-212075-m02)   

	I0429 12:48:08.899763  870218 main.go:141] libmachine: (ha-212075-m02)   </cpu>

	I0429 12:48:08.899774  870218 main.go:141] libmachine: (ha-212075-m02)   <os>

	I0429 12:48:08.899785  870218 main.go:141] libmachine: (ha-212075-m02)     <type>hvm</type>

	I0429 12:48:08.899794  870218 main.go:141] libmachine: (ha-212075-m02)     <boot dev='cdrom'/>

	I0429 12:48:08.899805  870218 main.go:141] libmachine: (ha-212075-m02)     <boot dev='hd'/>

	I0429 12:48:08.899842  870218 main.go:141] libmachine: (ha-212075-m02)     <bootmenu enable='no'/>

	I0429 12:48:08.899866  870218 main.go:141] libmachine: (ha-212075-m02)   </os>

	I0429 12:48:08.899892  870218 main.go:141] libmachine: (ha-212075-m02)   <devices>

	I0429 12:48:08.899912  870218 main.go:141] libmachine: (ha-212075-m02)     <disk type='file' device='cdrom'>

	I0429 12:48:08.899930  870218 main.go:141] libmachine: (ha-212075-m02)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/boot2docker.iso'/>

	I0429 12:48:08.899941  870218 main.go:141] libmachine: (ha-212075-m02)       <target dev='hdc' bus='scsi'/>

	I0429 12:48:08.899950  870218 main.go:141] libmachine: (ha-212075-m02)       <readonly/>

	I0429 12:48:08.899958  870218 main.go:141] libmachine: (ha-212075-m02)     </disk>

	I0429 12:48:08.899964  870218 main.go:141] libmachine: (ha-212075-m02)     <disk type='file' device='disk'>

	I0429 12:48:08.899973  870218 main.go:141] libmachine: (ha-212075-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0429 12:48:08.899981  870218 main.go:141] libmachine: (ha-212075-m02)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/ha-212075-m02.rawdisk'/>

	I0429 12:48:08.899992  870218 main.go:141] libmachine: (ha-212075-m02)       <target dev='hda' bus='virtio'/>

	I0429 12:48:08.900009  870218 main.go:141] libmachine: (ha-212075-m02)     </disk>

	I0429 12:48:08.900025  870218 main.go:141] libmachine: (ha-212075-m02)     <interface type='network'>

	I0429 12:48:08.900040  870218 main.go:141] libmachine: (ha-212075-m02)       <source network='mk-ha-212075'/>

	I0429 12:48:08.900051  870218 main.go:141] libmachine: (ha-212075-m02)       <model type='virtio'/>

	I0429 12:48:08.900062  870218 main.go:141] libmachine: (ha-212075-m02)     </interface>

	I0429 12:48:08.900072  870218 main.go:141] libmachine: (ha-212075-m02)     <interface type='network'>

	I0429 12:48:08.900081  870218 main.go:141] libmachine: (ha-212075-m02)       <source network='default'/>

	I0429 12:48:08.900092  870218 main.go:141] libmachine: (ha-212075-m02)       <model type='virtio'/>

	I0429 12:48:08.900107  870218 main.go:141] libmachine: (ha-212075-m02)     </interface>

	I0429 12:48:08.900126  870218 main.go:141] libmachine: (ha-212075-m02)     <serial type='pty'>

	I0429 12:48:08.900139  870218 main.go:141] libmachine: (ha-212075-m02)       <target port='0'/>

	I0429 12:48:08.900149  870218 main.go:141] libmachine: (ha-212075-m02)     </serial>

	I0429 12:48:08.900173  870218 main.go:141] libmachine: (ha-212075-m02)     <console type='pty'>

	I0429 12:48:08.900184  870218 main.go:141] libmachine: (ha-212075-m02)       <target type='serial' port='0'/>

	I0429 12:48:08.900192  870218 main.go:141] libmachine: (ha-212075-m02)     </console>

	I0429 12:48:08.900203  870218 main.go:141] libmachine: (ha-212075-m02)     <rng model='virtio'>

	I0429 12:48:08.900216  870218 main.go:141] libmachine: (ha-212075-m02)       <backend model='random'>/dev/random</backend>

	I0429 12:48:08.900225  870218 main.go:141] libmachine: (ha-212075-m02)     </rng>

	I0429 12:48:08.900234  870218 main.go:141] libmachine: (ha-212075-m02)     

	I0429 12:48:08.900242  870218 main.go:141] libmachine: (ha-212075-m02)     

	I0429 12:48:08.900252  870218 main.go:141] libmachine: (ha-212075-m02)   </devices>

	I0429 12:48:08.900259  870218 main.go:141] libmachine: (ha-212075-m02) </domain>

	I0429 12:48:08.900268  870218 main.go:141] libmachine: (ha-212075-m02) 

	I0429 12:48:08.907946  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:a9:53:79 in network default

	I0429 12:48:08.908582  870218 main.go:141] libmachine: (ha-212075-m02) Ensuring networks are active...

	I0429 12:48:08.908607  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:08.909355  870218 main.go:141] libmachine: (ha-212075-m02) Ensuring network default is active

	I0429 12:48:08.909634  870218 main.go:141] libmachine: (ha-212075-m02) Ensuring network mk-ha-212075 is active

	I0429 12:48:08.910063  870218 main.go:141] libmachine: (ha-212075-m02) Getting domain xml...

	I0429 12:48:08.910889  870218 main.go:141] libmachine: (ha-212075-m02) Creating domain...

	I0429 12:48:10.185813  870218 main.go:141] libmachine: (ha-212075-m02) Waiting to get IP...

	I0429 12:48:10.186939  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:10.187509  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:10.187547  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:10.187468  870647 retry.go:31] will retry after 301.578397ms: waiting for machine to come up

	I0429 12:48:10.491341  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:10.491897  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:10.491932  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:10.491839  870647 retry.go:31] will retry after 321.98325ms: waiting for machine to come up

	I0429 12:48:10.815451  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:10.815808  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:10.815832  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:10.815763  870647 retry.go:31] will retry after 394.050947ms: waiting for machine to come up

	I0429 12:48:11.211473  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:11.211909  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:11.211942  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:11.211849  870647 retry.go:31] will retry after 430.51973ms: waiting for machine to come up

	I0429 12:48:11.644676  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:11.645219  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:11.645248  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:11.645148  870647 retry.go:31] will retry after 709.605764ms: waiting for machine to come up

	I0429 12:48:12.356069  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:12.356525  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:12.356593  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:12.356473  870647 retry.go:31] will retry after 890.075621ms: waiting for machine to come up

	I0429 12:48:13.248841  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:13.249370  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:13.249406  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:13.249304  870647 retry.go:31] will retry after 727.943001ms: waiting for machine to come up

	I0429 12:48:13.978718  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:13.979281  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:13.979316  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:13.979215  870647 retry.go:31] will retry after 945.901335ms: waiting for machine to come up

	I0429 12:48:14.926762  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:14.927398  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:14.927432  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:14.927328  870647 retry.go:31] will retry after 1.459605646s: waiting for machine to come up

	I0429 12:48:16.388522  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:16.388934  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:16.388959  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:16.388887  870647 retry.go:31] will retry after 1.569864244s: waiting for machine to come up

	I0429 12:48:17.960898  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:17.961469  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:17.961500  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:17.961424  870647 retry.go:31] will retry after 2.113218061s: waiting for machine to come up

	I0429 12:48:20.078292  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:20.078741  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:20.078768  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:20.078698  870647 retry.go:31] will retry after 2.352898738s: waiting for machine to come up

	I0429 12:48:22.434312  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:22.434768  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:22.434792  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:22.434720  870647 retry.go:31] will retry after 4.188987093s: waiting for machine to come up

	I0429 12:48:26.627589  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:26.628066  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find current IP address of domain ha-212075-m02 in network mk-ha-212075

	I0429 12:48:26.628098  870218 main.go:141] libmachine: (ha-212075-m02) DBG | I0429 12:48:26.628002  870647 retry.go:31] will retry after 4.959414999s: waiting for machine to come up

	I0429 12:48:31.590773  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.591277  870218 main.go:141] libmachine: (ha-212075-m02) Found IP for machine: 192.168.39.36

	I0429 12:48:31.591299  870218 main.go:141] libmachine: (ha-212075-m02) Reserving static IP address...

	I0429 12:48:31.591312  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has current primary IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.591748  870218 main.go:141] libmachine: (ha-212075-m02) DBG | unable to find host DHCP lease matching {name: "ha-212075-m02", mac: "52:54:00:46:f4:9a", ip: "192.168.39.36"} in network mk-ha-212075

	I0429 12:48:31.678248  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Getting to WaitForSSH function...

	I0429 12:48:31.678313  870218 main.go:141] libmachine: (ha-212075-m02) Reserved static IP address: 192.168.39.36

	I0429 12:48:31.678330  870218 main.go:141] libmachine: (ha-212075-m02) Waiting for SSH to be available...

	I0429 12:48:31.681502  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.682128  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:minikube Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:31.682159  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.682371  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Using SSH client type: external

	I0429 12:48:31.682397  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa (-rw-------)

	I0429 12:48:31.682431  870218 main.go:141] libmachine: (ha-212075-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.36 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 12:48:31.682456  870218 main.go:141] libmachine: (ha-212075-m02) DBG | About to run SSH command:

	I0429 12:48:31.682464  870218 main.go:141] libmachine: (ha-212075-m02) DBG | exit 0

	I0429 12:48:31.811773  870218 main.go:141] libmachine: (ha-212075-m02) DBG | SSH cmd err, output: <nil>: 

	I0429 12:48:31.812004  870218 main.go:141] libmachine: (ha-212075-m02) KVM machine creation complete!

	I0429 12:48:31.812373  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetConfigRaw

	I0429 12:48:31.812982  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:31.813232  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:31.813485  870218 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0429 12:48:31.813500  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetState

	I0429 12:48:31.814808  870218 main.go:141] libmachine: Detecting operating system of created instance...

	I0429 12:48:31.814824  870218 main.go:141] libmachine: Waiting for SSH to be available...

	I0429 12:48:31.814830  870218 main.go:141] libmachine: Getting to WaitForSSH function...

	I0429 12:48:31.814836  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:31.817101  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.817490  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:31.817519  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.817650  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:31.817845  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.818046  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.818236  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:31.818444  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:31.818670  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:31.818681  870218 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0429 12:48:31.935100  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:48:31.935130  870218 main.go:141] libmachine: Detecting the provisioner...

	I0429 12:48:31.935138  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:31.938171  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.938493  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:31.938527  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:31.938645  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:31.938880  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.939058  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:31.939226  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:31.939407  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:31.939600  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:31.939613  870218 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0429 12:48:32.053082  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0429 12:48:32.053177  870218 main.go:141] libmachine: found compatible host: buildroot

	I0429 12:48:32.053189  870218 main.go:141] libmachine: Provisioning with buildroot...

	I0429 12:48:32.053198  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:32.053466  870218 buildroot.go:166] provisioning hostname "ha-212075-m02"

	I0429 12:48:32.053493  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:32.053731  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.056710  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.057187  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.057213  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.057373  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.057590  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.057787  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.057940  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.058097  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:32.058291  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:32.058303  870218 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-212075-m02 && echo "ha-212075-m02" | sudo tee /etc/hostname

	I0429 12:48:32.186743  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-212075-m02

	I0429 12:48:32.186780  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.190004  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.190426  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.190458  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.190737  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.190924  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.191144  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.191355  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.191580  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:32.191774  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:32.191799  870218 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-212075-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-212075-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-212075-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0429 12:48:32.313526  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:48:32.313572  870218 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18773-847310/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-847310/.minikube}

	I0429 12:48:32.313594  870218 buildroot.go:174] setting up certificates

	I0429 12:48:32.313607  870218 provision.go:84] configureAuth start

	I0429 12:48:32.313644  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetMachineName

	I0429 12:48:32.314022  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:32.316977  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.317366  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.317400  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.317566  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.319834  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.320185  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.320221  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.320393  870218 provision.go:143] copyHostCerts

	I0429 12:48:32.320430  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:48:32.320465  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem, removing ...

	I0429 12:48:32.320475  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:48:32.320540  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem (1679 bytes)

	I0429 12:48:32.320633  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:48:32.320657  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem, removing ...

	I0429 12:48:32.320664  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:48:32.320689  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem (1078 bytes)

	I0429 12:48:32.320743  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:48:32.320761  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem, removing ...

	I0429 12:48:32.320767  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:48:32.320792  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem (1123 bytes)

	I0429 12:48:32.320890  870218 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem org=jenkins.ha-212075-m02 san=[127.0.0.1 192.168.39.36 ha-212075-m02 localhost minikube]

	I0429 12:48:32.428710  870218 provision.go:177] copyRemoteCerts

	I0429 12:48:32.428786  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0429 12:48:32.428817  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.431477  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.431790  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.431816  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.431990  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.432223  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.432417  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.432560  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:32.523038  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0429 12:48:32.523114  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0429 12:48:32.552778  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0429 12:48:32.552860  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0429 12:48:32.582395  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0429 12:48:32.582487  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0429 12:48:32.611276  870218 provision.go:87] duration metric: took 297.652353ms to configureAuth

	I0429 12:48:32.611312  870218 buildroot.go:189] setting minikube options for container-runtime

	I0429 12:48:32.611552  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:32.611642  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.614288  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.614655  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.614690  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.614928  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.615179  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.615442  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.615591  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.615741  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:32.615994  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:32.616016  870218 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0429 12:48:32.889700  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0429 12:48:32.889741  870218 main.go:141] libmachine: Checking connection to Docker...

	I0429 12:48:32.889754  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetURL

	I0429 12:48:32.891136  870218 main.go:141] libmachine: (ha-212075-m02) DBG | Using libvirt version 6000000

	I0429 12:48:32.893428  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.893833  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.893868  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.894083  870218 main.go:141] libmachine: Docker is up and running!

	I0429 12:48:32.894098  870218 main.go:141] libmachine: Reticulating splines...

	I0429 12:48:32.894106  870218 client.go:171] duration metric: took 24.3852485s to LocalClient.Create

	I0429 12:48:32.894135  870218 start.go:167] duration metric: took 24.385317751s to libmachine.API.Create "ha-212075"

	I0429 12:48:32.894148  870218 start.go:293] postStartSetup for "ha-212075-m02" (driver="kvm2")

	I0429 12:48:32.894162  870218 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0429 12:48:32.894212  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:32.894482  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0429 12:48:32.894509  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:32.896782  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.897183  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:32.897213  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:32.897359  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:32.897544  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:32.897690  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:32.897796  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:32.982542  870218 ssh_runner.go:195] Run: cat /etc/os-release

	I0429 12:48:32.987133  870218 info.go:137] Remote host: Buildroot 2023.02.9

	I0429 12:48:32.987166  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/addons for local assets ...

	I0429 12:48:32.987242  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/files for local assets ...

	I0429 12:48:32.987334  870218 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> 8546602.pem in /etc/ssl/certs

	I0429 12:48:32.987350  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /etc/ssl/certs/8546602.pem

	I0429 12:48:32.987493  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0429 12:48:32.997640  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:48:33.023959  870218 start.go:296] duration metric: took 129.789656ms for postStartSetup

	I0429 12:48:33.024034  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetConfigRaw

	I0429 12:48:33.024677  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:33.027566  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.028047  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.028090  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.028348  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:48:33.028616  870218 start.go:128] duration metric: took 24.540303032s to createHost

	I0429 12:48:33.028651  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:33.031168  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.031576  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.031604  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.031827  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:33.032054  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.032225  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.032390  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:33.032628  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:48:33.032815  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.36 22 <nil> <nil>}

	I0429 12:48:33.032826  870218 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0429 12:48:33.145647  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714394913.118554750

	I0429 12:48:33.145686  870218 fix.go:216] guest clock: 1714394913.118554750

	I0429 12:48:33.145722  870218 fix.go:229] Guest: 2024-04-29 12:48:33.11855475 +0000 UTC Remote: 2024-04-29 12:48:33.028632996 +0000 UTC m=+82.403785948 (delta=89.921754ms)

	I0429 12:48:33.145751  870218 fix.go:200] guest clock delta is within tolerance: 89.921754ms

	I0429 12:48:33.145760  870218 start.go:83] releasing machines lock for "ha-212075-m02", held for 24.657592144s

	I0429 12:48:33.145790  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.146156  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:33.149182  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.149826  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.149921  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.152272  870218 out.go:177] * Found network options:

	I0429 12:48:33.153616  870218 out.go:177]   - NO_PROXY=192.168.39.97

	W0429 12:48:33.154781  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:48:33.154814  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.155526  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.155717  870218 main.go:141] libmachine: (ha-212075-m02) Calling .DriverName

	I0429 12:48:33.155839  870218 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0429 12:48:33.155888  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	W0429 12:48:33.155947  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:48:33.156040  870218 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0429 12:48:33.156068  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHHostname

	I0429 12:48:33.159109  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159175  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159607  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.159639  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159705  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:33.159739  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:33.159843  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:33.160130  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHPort

	I0429 12:48:33.160233  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.160299  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHKeyPath

	I0429 12:48:33.160394  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:33.160462  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetSSHUsername

	I0429 12:48:33.160543  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:33.160577  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.36 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m02/id_rsa Username:docker}

	I0429 12:48:33.408285  870218 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0429 12:48:33.415387  870218 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0429 12:48:33.415464  870218 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0429 12:48:33.433502  870218 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0429 12:48:33.433530  870218 start.go:494] detecting cgroup driver to use...

	I0429 12:48:33.433612  870218 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0429 12:48:33.450404  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0429 12:48:33.466440  870218 docker.go:217] disabling cri-docker service (if available) ...

	I0429 12:48:33.466506  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0429 12:48:33.482112  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0429 12:48:33.497775  870218 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0429 12:48:33.618172  870218 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0429 12:48:33.775113  870218 docker.go:233] disabling docker service ...

	I0429 12:48:33.775228  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0429 12:48:33.791054  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0429 12:48:33.805551  870218 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0429 12:48:33.929373  870218 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0429 12:48:34.046045  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0429 12:48:34.062693  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0429 12:48:34.082723  870218 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0429 12:48:34.082828  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.095496  870218 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0429 12:48:34.095585  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.107376  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.119146  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.130938  870218 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0429 12:48:34.143454  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.155583  870218 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.174540  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:48:34.188124  870218 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0429 12:48:34.200241  870218 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0429 12:48:34.200313  870218 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0429 12:48:34.215862  870218 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0429 12:48:34.226798  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:48:34.345854  870218 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0429 12:48:34.493199  870218 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0429 12:48:34.493282  870218 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0429 12:48:34.498665  870218 start.go:562] Will wait 60s for crictl version

	I0429 12:48:34.498737  870218 ssh_runner.go:195] Run: which crictl

	I0429 12:48:34.502609  870218 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0429 12:48:34.546513  870218 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0429 12:48:34.546611  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:48:34.577592  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:48:34.610836  870218 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0429 12:48:34.612460  870218 out.go:177]   - env NO_PROXY=192.168.39.97

	I0429 12:48:34.614047  870218 main.go:141] libmachine: (ha-212075-m02) Calling .GetIP

	I0429 12:48:34.617088  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:34.617431  870218 main.go:141] libmachine: (ha-212075-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:46:f4:9a", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:48:23 +0000 UTC Type:0 Mac:52:54:00:46:f4:9a Iaid: IPaddr:192.168.39.36 Prefix:24 Hostname:ha-212075-m02 Clientid:01:52:54:00:46:f4:9a}

	I0429 12:48:34.617464  870218 main.go:141] libmachine: (ha-212075-m02) DBG | domain ha-212075-m02 has defined IP address 192.168.39.36 and MAC address 52:54:00:46:f4:9a in network mk-ha-212075

	I0429 12:48:34.617681  870218 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0429 12:48:34.622595  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:48:34.637467  870218 mustload.go:65] Loading cluster: ha-212075

	I0429 12:48:34.637709  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:48:34.638083  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:34.638119  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:34.655335  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38495

	I0429 12:48:34.655921  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:34.656505  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:34.656533  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:34.656949  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:34.657168  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:48:34.658862  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:34.659208  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:34.659241  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:34.676178  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39665

	I0429 12:48:34.676652  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:34.677199  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:34.677225  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:34.677649  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:34.677907  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:34.678108  870218 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075 for IP: 192.168.39.36

	I0429 12:48:34.678120  870218 certs.go:194] generating shared ca certs ...

	I0429 12:48:34.678137  870218 certs.go:226] acquiring lock for ca certs: {Name:mk6be02e49d8ee7e457b7d9b7cd478c5e883ea66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:34.678279  870218 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key

	I0429 12:48:34.678315  870218 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key

	I0429 12:48:34.678324  870218 certs.go:256] generating profile certs ...

	I0429 12:48:34.678399  870218 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key

	I0429 12:48:34.678425  870218 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885

	I0429 12:48:34.678440  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.97 192.168.39.36 192.168.39.254]

	I0429 12:48:34.805493  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885 ...

	I0429 12:48:34.805534  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885: {Name:mkd1806caee1a077a46115403308bba9c5b89af9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:34.805721  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885 ...

	I0429 12:48:34.805735  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885: {Name:mk269ebb85b90f5fc58a4363fce8b015ee69584d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:48:34.805806  870218 certs.go:381] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.4917e885 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt

	I0429 12:48:34.805933  870218 certs.go:385] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.4917e885 -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key

	I0429 12:48:34.806072  870218 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key

	I0429 12:48:34.806091  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0429 12:48:34.806103  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0429 12:48:34.806117  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0429 12:48:34.806130  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0429 12:48:34.806140  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0429 12:48:34.806150  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0429 12:48:34.806159  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0429 12:48:34.806171  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0429 12:48:34.806219  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem (1338 bytes)

	W0429 12:48:34.806252  870218 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660_empty.pem, impossibly tiny 0 bytes

	I0429 12:48:34.806262  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem (1679 bytes)

	I0429 12:48:34.806284  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem (1078 bytes)

	I0429 12:48:34.806309  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem (1123 bytes)

	I0429 12:48:34.806339  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem (1679 bytes)

	I0429 12:48:34.806399  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:48:34.806444  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:34.806466  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem -> /usr/share/ca-certificates/854660.pem

	I0429 12:48:34.806484  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /usr/share/ca-certificates/8546602.pem

	I0429 12:48:34.806530  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:34.809733  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:34.810136  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:34.810161  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:34.810406  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:34.810632  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:34.810800  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:34.810968  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:34.887807  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0429 12:48:34.893360  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0429 12:48:34.905730  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0429 12:48:34.910714  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)

	I0429 12:48:34.925811  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0429 12:48:34.930751  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0429 12:48:34.942482  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0429 12:48:34.947167  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0429 12:48:34.959068  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0429 12:48:34.964374  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0429 12:48:34.977275  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0429 12:48:34.986440  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0429 12:48:35.002753  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0429 12:48:35.033535  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0429 12:48:35.060599  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0429 12:48:35.086939  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0429 12:48:35.113656  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0429 12:48:35.140419  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0429 12:48:35.167085  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0429 12:48:35.193420  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0429 12:48:35.218968  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0429 12:48:35.244325  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem --> /usr/share/ca-certificates/854660.pem (1338 bytes)

	I0429 12:48:35.269718  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /usr/share/ca-certificates/8546602.pem (1708 bytes)

	I0429 12:48:35.295519  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0429 12:48:35.314438  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)

	I0429 12:48:35.333492  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0429 12:48:35.351305  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0429 12:48:35.368872  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0429 12:48:35.386640  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0429 12:48:35.404506  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0429 12:48:35.422626  870218 ssh_runner.go:195] Run: openssl version

	I0429 12:48:35.429174  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8546602.pem && ln -fs /usr/share/ca-certificates/8546602.pem /etc/ssl/certs/8546602.pem"

	I0429 12:48:35.441867  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8546602.pem

	I0429 12:48:35.446719  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 12:39 /usr/share/ca-certificates/8546602.pem

	I0429 12:48:35.446818  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8546602.pem

	I0429 12:48:35.454462  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8546602.pem /etc/ssl/certs/3ec20f2e.0"

	I0429 12:48:35.466704  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0429 12:48:35.479054  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:35.484682  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:59 /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:35.484764  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:48:35.490502  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0429 12:48:35.502670  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/854660.pem && ln -fs /usr/share/ca-certificates/854660.pem /etc/ssl/certs/854660.pem"

	I0429 12:48:35.514732  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/854660.pem

	I0429 12:48:35.519580  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 12:39 /usr/share/ca-certificates/854660.pem

	I0429 12:48:35.519657  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/854660.pem

	I0429 12:48:35.525715  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/854660.pem /etc/ssl/certs/51391683.0"

	I0429 12:48:35.537965  870218 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0429 12:48:35.542342  870218 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0429 12:48:35.542400  870218 kubeadm.go:928] updating node {m02 192.168.39.36 8443 v1.30.0 crio true true} ...

	I0429 12:48:35.542490  870218 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-212075-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.36

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0429 12:48:35.542526  870218 kube-vip.go:111] generating kube-vip config ...

	I0429 12:48:35.542581  870218 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0429 12:48:35.561058  870218 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0429 12:48:35.561143  870218 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0429 12:48:35.561210  870218 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0429 12:48:35.574246  870218 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0429 12:48:35.574321  870218 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0429 12:48:35.585778  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0429 12:48:35.585815  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:48:35.585899  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:48:35.585897  870218 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm

	I0429 12:48:35.585912  870218 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet

	I0429 12:48:35.590788  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0429 12:48:35.590829  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0429 12:48:36.224127  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:48:36.224220  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:48:36.231982  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0429 12:48:36.232023  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0429 12:48:36.568380  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:48:36.585896  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:48:36.586003  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:48:36.590713  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0429 12:48:36.590749  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0429 12:48:37.056796  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0429 12:48:37.067649  870218 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0429 12:48:37.088488  870218 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0429 12:48:37.108016  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0429 12:48:37.127116  870218 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0429 12:48:37.131646  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:48:37.146577  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:48:37.271454  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:48:37.288942  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:48:37.289340  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:48:37.289389  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:48:37.305131  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36571

	I0429 12:48:37.305662  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:48:37.306176  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:48:37.306198  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:48:37.306568  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:48:37.306815  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:48:37.306984  870218 start.go:316] joinCluster: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:

26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 12:48:37.307089  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0429 12:48:37.307111  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:48:37.310630  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:37.311149  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:48:37.311190  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:48:37.311387  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:48:37.311590  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:48:37.311753  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:48:37.311911  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:48:37.495514  870218 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:48:37.495571  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token s07sl2.kup7dzd4wu3ttqwx --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m02 --control-plane --apiserver-advertise-address=192.168.39.36 --apiserver-bind-port=8443"

	I0429 12:49:02.049323  870218 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token s07sl2.kup7dzd4wu3ttqwx --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m02 --control-plane --apiserver-advertise-address=192.168.39.36 --apiserver-bind-port=8443": (24.553721774s)

	I0429 12:49:02.049397  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0429 12:49:02.558233  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-212075-m02 minikube.k8s.io/updated_at=2024_04_29T12_49_02_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332 minikube.k8s.io/name=ha-212075 minikube.k8s.io/primary=false

	I0429 12:49:02.732186  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-212075-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0429 12:49:02.854666  870218 start.go:318] duration metric: took 25.547674937s to joinCluster

	I0429 12:49:02.854762  870218 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:49:02.856131  870218 out.go:177] * Verifying Kubernetes components...

	I0429 12:49:02.855106  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:02.857470  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:49:03.067090  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:49:03.085215  870218 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:49:03.085546  870218 kapi.go:59] client config for ha-212075: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt", KeyFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key", CAFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0429 12:49:03.085629  870218 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.97:8443

	I0429 12:49:03.085948  870218 node_ready.go:35] waiting up to 6m0s for node "ha-212075-m02" to be "Ready" ...

	I0429 12:49:03.086041  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:03.086049  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:03.086057  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:03.086062  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:03.096961  870218 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0429 12:49:03.586849  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:03.586877  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:03.586887  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:03.586894  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:03.590813  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:04.086875  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:04.086906  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:04.086922  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:04.086929  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:04.118136  870218 round_trippers.go:574] Response Status: 200 OK in 31 milliseconds

	I0429 12:49:04.586198  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:04.586239  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:04.586248  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:04.586253  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:04.590710  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:05.087118  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:05.087150  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:05.087158  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:05.087162  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:05.090865  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:05.091510  870218 node_ready.go:53] node "ha-212075-m02" has status "Ready":"False"

	I0429 12:49:05.586466  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:05.586495  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:05.586506  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:05.586511  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:05.591095  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:06.087044  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:06.087077  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:06.087093  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:06.087099  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:06.091377  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:06.587078  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:06.587107  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:06.587116  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:06.587121  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:06.592788  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:07.086787  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:07.086820  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:07.086831  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:07.086839  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:07.091631  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:07.092318  870218 node_ready.go:53] node "ha-212075-m02" has status "Ready":"False"

	I0429 12:49:07.586426  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:07.586461  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:07.586474  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:07.586481  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:07.593188  870218 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 12:49:08.087222  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:08.087249  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.087260  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.087265  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.219961  870218 round_trippers.go:574] Response Status: 200 OK in 132 milliseconds

	I0429 12:49:08.220604  870218 node_ready.go:49] node "ha-212075-m02" has status "Ready":"True"

	I0429 12:49:08.220632  870218 node_ready.go:38] duration metric: took 5.134660973s for node "ha-212075-m02" to be "Ready" ...

	I0429 12:49:08.220646  870218 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:49:08.220738  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:08.220753  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.220764  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.220773  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.229060  870218 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 12:49:08.235147  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.235258  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-c2t8g

	I0429 12:49:08.235267  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.235275  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.235281  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.314925  870218 round_trippers.go:574] Response Status: 200 OK in 79 milliseconds

	I0429 12:49:08.315803  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:08.315828  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.315840  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.315847  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.329212  870218 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0429 12:49:08.329863  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:08.329897  870218 pod_ready.go:81] duration metric: took 94.712953ms for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.329913  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.330038  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-x299s

	I0429 12:49:08.330053  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.330064  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.330072  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.333533  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.334362  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:08.334381  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.334391  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.334398  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.338012  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.338971  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:08.338995  870218 pod_ready.go:81] duration metric: took 9.067885ms for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.339012  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.339105  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075

	I0429 12:49:08.339117  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.339128  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.339137  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.342835  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.343473  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:08.343496  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.343507  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.343516  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.349400  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:08.349955  870218 pod_ready.go:92] pod "etcd-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:08.349979  870218 pod_ready.go:81] duration metric: took 10.955166ms for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.349992  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:08.350072  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:08.350082  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.350093  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.350099  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.353467  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.354125  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:08.354146  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.354156  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.354163  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.357021  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:08.850289  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:08.850319  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.850331  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.850336  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.854284  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:08.854924  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:08.854948  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:08.854958  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:08.854963  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:08.858066  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:09.351005  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:09.351035  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.351057  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.351065  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.354889  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:09.356025  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:09.356044  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.356052  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.356057  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.359159  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:09.850927  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:09.850957  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.850970  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.850983  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.856731  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:09.857966  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:09.857984  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:09.857992  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:09.857998  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:09.860636  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:10.350922  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:10.350956  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.350966  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.350971  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.355448  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:10.356559  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:10.356578  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.356587  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.356591  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.360394  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:10.361486  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:10.850899  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:10.850929  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.850944  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.850949  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.855382  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:10.856870  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:10.856902  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:10.856914  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:10.856920  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:10.861517  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:11.350799  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:11.350827  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.350834  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.350838  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.354605  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:11.355335  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:11.355353  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.355378  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.355383  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.359577  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:11.851128  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:11.851157  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.851168  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.851173  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.855182  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:11.856109  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:11.856128  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:11.856138  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:11.856143  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:11.859010  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:12.350392  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:12.350424  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.350432  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.350436  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.354740  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:12.355746  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:12.355765  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.355773  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.355777  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.358545  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:12.850371  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:12.850402  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.850412  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.850418  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.854752  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:12.855683  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:12.855700  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:12.855711  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:12.855718  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:12.858834  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:12.859529  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:13.351114  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:13.351145  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.351153  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.351156  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.355082  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:13.356231  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:13.356252  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.356259  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.356264  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.359839  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:13.850437  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:13.850465  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.850473  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.850477  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.855157  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:13.855992  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:13.856011  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:13.856018  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:13.856022  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:13.859036  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:14.351293  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:14.351330  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.351340  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.351345  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.356455  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:14.357250  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:14.357269  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.357277  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.357282  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.361121  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:14.850961  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:14.851003  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.851016  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.851022  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.855394  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:14.856176  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:14.856195  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:14.856202  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:14.856205  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:14.859738  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:14.860328  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:15.350798  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:15.350830  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.350841  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.350845  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.355817  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:15.357189  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:15.357221  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.357230  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.357246  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.361330  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:15.850942  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:15.850977  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.850986  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.850989  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.854870  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:15.855657  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:15.855678  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:15.855686  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:15.855690  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:15.859126  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:16.351154  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:16.351183  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.351191  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.351196  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.359437  870218 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 12:49:16.360301  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:16.360324  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.360336  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.360342  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.363465  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:16.850422  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:16.850456  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.850466  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.850471  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.855565  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:16.856378  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:16.856396  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:16.856404  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:16.856409  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:16.860272  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:16.860861  870218 pod_ready.go:102] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"False"

	I0429 12:49:17.350900  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:17.350927  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.350935  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.350938  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.355909  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:17.356733  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:17.356756  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.356767  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.356773  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.360272  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:17.850305  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:17.850332  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.850340  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.850345  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.854785  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:17.855453  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:17.855469  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:17.855477  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:17.855482  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:17.858541  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.350427  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:18.350455  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.350468  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.350474  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.354383  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.354996  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.355013  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.355021  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.355025  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.358793  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.851129  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:49:18.851157  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.851166  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.851171  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.855430  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:18.856095  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.856112  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.856120  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.856123  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.859800  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.860384  870218 pod_ready.go:92] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.860405  870218 pod_ready.go:81] duration metric: took 10.5104068s for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.860424  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.860487  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075

	I0429 12:49:18.860495  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.860502  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.860507  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.863876  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.864907  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:18.864922  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.864930  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.864933  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.868515  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.869138  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.869156  870218 pod_ready.go:81] duration metric: took 8.723811ms for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.869166  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.869238  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075-m02

	I0429 12:49:18.869246  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.869254  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.869261  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.872567  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.873514  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.873527  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.873535  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.873543  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.876640  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.877214  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.877232  870218 pod_ready.go:81] duration metric: took 8.058402ms for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.877242  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.877307  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075

	I0429 12:49:18.877316  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.877322  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.877328  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.880468  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.881203  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:18.881224  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.881235  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.881241  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.884107  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:18.885148  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.885169  870218 pod_ready.go:81] duration metric: took 7.919576ms for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.885180  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.885305  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m02

	I0429 12:49:18.885316  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.885323  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.885328  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.888193  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:49:18.888830  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:18.888845  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:18.888856  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:18.888861  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:18.892058  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:18.892610  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:18.892627  870218 pod_ready.go:81] duration metric: took 7.442078ms for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:18.892638  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.052102  870218 request.go:629] Waited for 159.379221ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:49:19.052177  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:49:19.052184  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.052194  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.052199  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.061885  870218 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0429 12:49:19.252140  870218 request.go:629] Waited for 189.369987ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:19.252224  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:19.252232  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.252243  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.252261  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.255881  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:19.256791  870218 pod_ready.go:92] pod "kube-proxy-ncdsk" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:19.256814  870218 pod_ready.go:81] duration metric: took 364.169187ms for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.256826  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.451933  870218 request.go:629] Waited for 195.014453ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:49:19.452030  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:49:19.452042  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.452054  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.452062  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.455910  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:19.652261  870218 request.go:629] Waited for 195.417524ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:19.652340  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:19.652348  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.652359  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.652364  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.656950  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:19.657658  870218 pod_ready.go:92] pod "kube-proxy-sfmhh" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:19.657680  870218 pod_ready.go:81] duration metric: took 400.848571ms for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.657691  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:19.851979  870218 request.go:629] Waited for 194.202023ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:49:19.852092  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:49:19.852100  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:19.852111  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:19.852117  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:19.856054  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:20.051273  870218 request.go:629] Waited for 194.323385ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:20.051405  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:49:20.051419  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.051427  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.051431  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.055030  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:20.055579  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:20.055603  870218 pod_ready.go:81] duration metric: took 397.905703ms for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:20.055614  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:20.251711  870218 request.go:629] Waited for 196.011102ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:49:20.251809  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:49:20.251817  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.251838  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.251857  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.256067  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:20.451164  870218 request.go:629] Waited for 194.30553ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:20.451272  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:49:20.451280  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.451291  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.451297  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.454603  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:49:20.455129  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:49:20.455160  870218 pod_ready.go:81] duration metric: took 399.537636ms for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:49:20.455176  870218 pod_ready.go:38] duration metric: took 12.234512578s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:49:20.455196  870218 api_server.go:52] waiting for apiserver process to appear ...

	I0429 12:49:20.455270  870218 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:49:20.472016  870218 api_server.go:72] duration metric: took 17.617201161s to wait for apiserver process to appear ...

	I0429 12:49:20.472049  870218 api_server.go:88] waiting for apiserver healthz status ...

	I0429 12:49:20.472071  870218 api_server.go:253] Checking apiserver healthz at https://192.168.39.97:8443/healthz ...

	I0429 12:49:20.478128  870218 api_server.go:279] https://192.168.39.97:8443/healthz returned 200:

	ok

	I0429 12:49:20.478206  870218 round_trippers.go:463] GET https://192.168.39.97:8443/version

	I0429 12:49:20.478214  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.478222  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.478229  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.479205  870218 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0429 12:49:20.479326  870218 api_server.go:141] control plane version: v1.30.0

	I0429 12:49:20.479348  870218 api_server.go:131] duration metric: took 7.292177ms to wait for apiserver health ...

	I0429 12:49:20.479376  870218 system_pods.go:43] waiting for kube-system pods to appear ...

	I0429 12:49:20.651833  870218 request.go:629] Waited for 172.3703ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:20.651916  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:20.651921  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.651930  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.651933  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.658972  870218 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 12:49:20.663967  870218 system_pods.go:59] 17 kube-system pods found

	I0429 12:49:20.664028  870218 system_pods.go:61] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:49:20.664035  870218 system_pods.go:61] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:49:20.664039  870218 system_pods.go:61] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:49:20.664043  870218 system_pods.go:61] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:49:20.664046  870218 system_pods.go:61] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:49:20.664049  870218 system_pods.go:61] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:49:20.664052  870218 system_pods.go:61] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:49:20.664058  870218 system_pods.go:61] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:49:20.664061  870218 system_pods.go:61] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:49:20.664066  870218 system_pods.go:61] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:49:20.664069  870218 system_pods.go:61] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:49:20.664074  870218 system_pods.go:61] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:49:20.664078  870218 system_pods.go:61] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:49:20.664082  870218 system_pods.go:61] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:49:20.664087  870218 system_pods.go:61] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:49:20.664090  870218 system_pods.go:61] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:49:20.664092  870218 system_pods.go:61] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:49:20.664099  870218 system_pods.go:74] duration metric: took 184.712298ms to wait for pod list to return data ...

	I0429 12:49:20.664110  870218 default_sa.go:34] waiting for default service account to be created ...

	I0429 12:49:20.851865  870218 request.go:629] Waited for 187.634894ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:49:20.851947  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:49:20.851952  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:20.851960  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:20.851965  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:20.856481  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:49:20.856703  870218 default_sa.go:45] found service account: "default"

	I0429 12:49:20.856718  870218 default_sa.go:55] duration metric: took 192.601184ms for default service account to be created ...

	I0429 12:49:20.856727  870218 system_pods.go:116] waiting for k8s-apps to be running ...

	I0429 12:49:21.052256  870218 request.go:629] Waited for 195.417866ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:21.052333  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:49:21.052351  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:21.052361  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:21.052366  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:21.057947  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:49:21.062642  870218 system_pods.go:86] 17 kube-system pods found

	I0429 12:49:21.062687  870218 system_pods.go:89] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:49:21.062696  870218 system_pods.go:89] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:49:21.062703  870218 system_pods.go:89] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:49:21.062708  870218 system_pods.go:89] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:49:21.062714  870218 system_pods.go:89] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:49:21.062720  870218 system_pods.go:89] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:49:21.062727  870218 system_pods.go:89] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:49:21.062733  870218 system_pods.go:89] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:49:21.062739  870218 system_pods.go:89] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:49:21.062746  870218 system_pods.go:89] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:49:21.062757  870218 system_pods.go:89] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:49:21.062765  870218 system_pods.go:89] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:49:21.062774  870218 system_pods.go:89] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:49:21.062782  870218 system_pods.go:89] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:49:21.062792  870218 system_pods.go:89] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:49:21.062800  870218 system_pods.go:89] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:49:21.062806  870218 system_pods.go:89] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:49:21.062820  870218 system_pods.go:126] duration metric: took 206.083067ms to wait for k8s-apps to be running ...

	I0429 12:49:21.062833  870218 system_svc.go:44] waiting for kubelet service to be running ....

	I0429 12:49:21.062894  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:49:21.080250  870218 system_svc.go:56] duration metric: took 17.405204ms WaitForService to wait for kubelet

	I0429 12:49:21.080292  870218 kubeadm.go:576] duration metric: took 18.225480527s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 12:49:21.080313  870218 node_conditions.go:102] verifying NodePressure condition ...

	I0429 12:49:21.251755  870218 request.go:629] Waited for 171.363431ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes

	I0429 12:49:21.251820  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes

	I0429 12:49:21.251825  870218 round_trippers.go:469] Request Headers:

	I0429 12:49:21.251832  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:49:21.251837  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:49:21.258283  870218 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 12:49:21.259370  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:49:21.259409  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:49:21.259433  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:49:21.259439  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:49:21.259446  870218 node_conditions.go:105] duration metric: took 179.126951ms to run NodePressure ...

	I0429 12:49:21.259466  870218 start.go:240] waiting for startup goroutines ...

	I0429 12:49:21.259550  870218 start.go:254] writing updated cluster config ...

	I0429 12:49:21.261846  870218 out.go:177] 

	I0429 12:49:21.263452  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:21.263575  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:49:21.265353  870218 out.go:177] * Starting "ha-212075-m03" control-plane node in "ha-212075" cluster

	I0429 12:49:21.266472  870218 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0429 12:49:21.266506  870218 cache.go:56] Caching tarball of preloaded images

	I0429 12:49:21.266623  870218 preload.go:173] Found /home/jenkins/minikube-integration/18773-847310/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0429 12:49:21.266635  870218 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0429 12:49:21.266802  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:49:21.267040  870218 start.go:360] acquireMachinesLock for ha-212075-m03: {Name:mk2ade588bdb49db467a1dc12f643b97a2b1f5bb Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0429 12:49:21.267097  870218 start.go:364] duration metric: took 32.398µs to acquireMachinesLock for "ha-212075-m03"

	I0429 12:49:21.267118  870218 start.go:93] Provisioning new machine with config: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dn

s:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimiz

ations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:49:21.267234  870218 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0429 12:49:21.268814  870218 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0429 12:49:21.268990  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:21.269033  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:21.286412  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43727

	I0429 12:49:21.286903  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:21.287420  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:21.287439  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:21.287775  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:21.288007  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:21.288192  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:21.288372  870218 start.go:159] libmachine.API.Create for "ha-212075" (driver="kvm2")

	I0429 12:49:21.288401  870218 client.go:168] LocalClient.Create starting

	I0429 12:49:21.288434  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem

	I0429 12:49:21.288469  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:49:21.288485  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:49:21.288542  870218 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem

	I0429 12:49:21.288560  870218 main.go:141] libmachine: Decoding PEM data...

	I0429 12:49:21.288570  870218 main.go:141] libmachine: Parsing certificate...

	I0429 12:49:21.288584  870218 main.go:141] libmachine: Running pre-create checks...

	I0429 12:49:21.288592  870218 main.go:141] libmachine: (ha-212075-m03) Calling .PreCreateCheck

	I0429 12:49:21.288811  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetConfigRaw

	I0429 12:49:21.289218  870218 main.go:141] libmachine: Creating machine...

	I0429 12:49:21.289234  870218 main.go:141] libmachine: (ha-212075-m03) Calling .Create

	I0429 12:49:21.289387  870218 main.go:141] libmachine: (ha-212075-m03) Creating KVM machine...

	I0429 12:49:21.291003  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found existing default KVM network

	I0429 12:49:21.291207  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found existing private KVM network mk-ha-212075

	I0429 12:49:21.291323  870218 main.go:141] libmachine: (ha-212075-m03) Setting up store path in /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03 ...

	I0429 12:49:21.291379  870218 main.go:141] libmachine: (ha-212075-m03) Building disk image from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0429 12:49:21.291474  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.291312  871030 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:49:21.291566  870218 main.go:141] libmachine: (ha-212075-m03) Downloading /home/jenkins/minikube-integration/18773-847310/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18773-847310/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0429 12:49:21.553727  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.553607  871030 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa...

	I0429 12:49:21.655477  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.655312  871030 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/ha-212075-m03.rawdisk...

	I0429 12:49:21.655512  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Writing magic tar header

	I0429 12:49:21.655527  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Writing SSH key tar header

	I0429 12:49:21.655537  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:21.655481  871030 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03 ...

	I0429 12:49:21.655661  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03

	I0429 12:49:21.655697  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03 (perms=drwx------)

	I0429 12:49:21.655710  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube/machines

	I0429 12:49:21.655734  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310/.minikube

	I0429 12:49:21.655747  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18773-847310

	I0429 12:49:21.655763  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0429 12:49:21.655775  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home/jenkins

	I0429 12:49:21.655790  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Checking permissions on dir: /home

	I0429 12:49:21.655852  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Skipping /home - not owner

	I0429 12:49:21.655872  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube/machines (perms=drwxr-xr-x)

	I0429 12:49:21.655886  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310/.minikube (perms=drwxr-xr-x)

	I0429 12:49:21.655898  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration/18773-847310 (perms=drwxrwxr-x)

	I0429 12:49:21.655912  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0429 12:49:21.655924  870218 main.go:141] libmachine: (ha-212075-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0429 12:49:21.655938  870218 main.go:141] libmachine: (ha-212075-m03) Creating domain...

	I0429 12:49:21.656952  870218 main.go:141] libmachine: (ha-212075-m03) define libvirt domain using xml: 

	I0429 12:49:21.656983  870218 main.go:141] libmachine: (ha-212075-m03) <domain type='kvm'>

	I0429 12:49:21.656994  870218 main.go:141] libmachine: (ha-212075-m03)   <name>ha-212075-m03</name>

	I0429 12:49:21.657006  870218 main.go:141] libmachine: (ha-212075-m03)   <memory unit='MiB'>2200</memory>

	I0429 12:49:21.657019  870218 main.go:141] libmachine: (ha-212075-m03)   <vcpu>2</vcpu>

	I0429 12:49:21.657028  870218 main.go:141] libmachine: (ha-212075-m03)   <features>

	I0429 12:49:21.657034  870218 main.go:141] libmachine: (ha-212075-m03)     <acpi/>

	I0429 12:49:21.657039  870218 main.go:141] libmachine: (ha-212075-m03)     <apic/>

	I0429 12:49:21.657044  870218 main.go:141] libmachine: (ha-212075-m03)     <pae/>

	I0429 12:49:21.657051  870218 main.go:141] libmachine: (ha-212075-m03)     

	I0429 12:49:21.657056  870218 main.go:141] libmachine: (ha-212075-m03)   </features>

	I0429 12:49:21.657061  870218 main.go:141] libmachine: (ha-212075-m03)   <cpu mode='host-passthrough'>

	I0429 12:49:21.657067  870218 main.go:141] libmachine: (ha-212075-m03)   

	I0429 12:49:21.657074  870218 main.go:141] libmachine: (ha-212075-m03)   </cpu>

	I0429 12:49:21.657079  870218 main.go:141] libmachine: (ha-212075-m03)   <os>

	I0429 12:49:21.657089  870218 main.go:141] libmachine: (ha-212075-m03)     <type>hvm</type>

	I0429 12:49:21.657129  870218 main.go:141] libmachine: (ha-212075-m03)     <boot dev='cdrom'/>

	I0429 12:49:21.657156  870218 main.go:141] libmachine: (ha-212075-m03)     <boot dev='hd'/>

	I0429 12:49:21.657169  870218 main.go:141] libmachine: (ha-212075-m03)     <bootmenu enable='no'/>

	I0429 12:49:21.657180  870218 main.go:141] libmachine: (ha-212075-m03)   </os>

	I0429 12:49:21.657189  870218 main.go:141] libmachine: (ha-212075-m03)   <devices>

	I0429 12:49:21.657203  870218 main.go:141] libmachine: (ha-212075-m03)     <disk type='file' device='cdrom'>

	I0429 12:49:21.657216  870218 main.go:141] libmachine: (ha-212075-m03)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/boot2docker.iso'/>

	I0429 12:49:21.657227  870218 main.go:141] libmachine: (ha-212075-m03)       <target dev='hdc' bus='scsi'/>

	I0429 12:49:21.657257  870218 main.go:141] libmachine: (ha-212075-m03)       <readonly/>

	I0429 12:49:21.657282  870218 main.go:141] libmachine: (ha-212075-m03)     </disk>

	I0429 12:49:21.657296  870218 main.go:141] libmachine: (ha-212075-m03)     <disk type='file' device='disk'>

	I0429 12:49:21.657306  870218 main.go:141] libmachine: (ha-212075-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0429 12:49:21.657320  870218 main.go:141] libmachine: (ha-212075-m03)       <source file='/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/ha-212075-m03.rawdisk'/>

	I0429 12:49:21.657333  870218 main.go:141] libmachine: (ha-212075-m03)       <target dev='hda' bus='virtio'/>

	I0429 12:49:21.657343  870218 main.go:141] libmachine: (ha-212075-m03)     </disk>

	I0429 12:49:21.657358  870218 main.go:141] libmachine: (ha-212075-m03)     <interface type='network'>

	I0429 12:49:21.657370  870218 main.go:141] libmachine: (ha-212075-m03)       <source network='mk-ha-212075'/>

	I0429 12:49:21.657382  870218 main.go:141] libmachine: (ha-212075-m03)       <model type='virtio'/>

	I0429 12:49:21.657395  870218 main.go:141] libmachine: (ha-212075-m03)     </interface>

	I0429 12:49:21.657403  870218 main.go:141] libmachine: (ha-212075-m03)     <interface type='network'>

	I0429 12:49:21.657410  870218 main.go:141] libmachine: (ha-212075-m03)       <source network='default'/>

	I0429 12:49:21.657425  870218 main.go:141] libmachine: (ha-212075-m03)       <model type='virtio'/>

	I0429 12:49:21.657438  870218 main.go:141] libmachine: (ha-212075-m03)     </interface>

	I0429 12:49:21.657446  870218 main.go:141] libmachine: (ha-212075-m03)     <serial type='pty'>

	I0429 12:49:21.657458  870218 main.go:141] libmachine: (ha-212075-m03)       <target port='0'/>

	I0429 12:49:21.657468  870218 main.go:141] libmachine: (ha-212075-m03)     </serial>

	I0429 12:49:21.657477  870218 main.go:141] libmachine: (ha-212075-m03)     <console type='pty'>

	I0429 12:49:21.657492  870218 main.go:141] libmachine: (ha-212075-m03)       <target type='serial' port='0'/>

	I0429 12:49:21.657504  870218 main.go:141] libmachine: (ha-212075-m03)     </console>

	I0429 12:49:21.657514  870218 main.go:141] libmachine: (ha-212075-m03)     <rng model='virtio'>

	I0429 12:49:21.657526  870218 main.go:141] libmachine: (ha-212075-m03)       <backend model='random'>/dev/random</backend>

	I0429 12:49:21.657536  870218 main.go:141] libmachine: (ha-212075-m03)     </rng>

	I0429 12:49:21.657548  870218 main.go:141] libmachine: (ha-212075-m03)     

	I0429 12:49:21.657555  870218 main.go:141] libmachine: (ha-212075-m03)     

	I0429 12:49:21.657562  870218 main.go:141] libmachine: (ha-212075-m03)   </devices>

	I0429 12:49:21.657571  870218 main.go:141] libmachine: (ha-212075-m03) </domain>

	I0429 12:49:21.657592  870218 main.go:141] libmachine: (ha-212075-m03) 

	I0429 12:49:21.666856  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:f8:63:70 in network default

	I0429 12:49:21.667717  870218 main.go:141] libmachine: (ha-212075-m03) Ensuring networks are active...

	I0429 12:49:21.667743  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:21.668658  870218 main.go:141] libmachine: (ha-212075-m03) Ensuring network default is active

	I0429 12:49:21.669085  870218 main.go:141] libmachine: (ha-212075-m03) Ensuring network mk-ha-212075 is active

	I0429 12:49:21.669490  870218 main.go:141] libmachine: (ha-212075-m03) Getting domain xml...

	I0429 12:49:21.670407  870218 main.go:141] libmachine: (ha-212075-m03) Creating domain...

	I0429 12:49:22.960796  870218 main.go:141] libmachine: (ha-212075-m03) Waiting to get IP...

	I0429 12:49:22.961597  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:22.962057  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:22.962099  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:22.962046  871030 retry.go:31] will retry after 275.195421ms: waiting for machine to come up

	I0429 12:49:23.238662  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:23.239199  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:23.239240  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:23.239147  871030 retry.go:31] will retry after 254.361022ms: waiting for machine to come up

	I0429 12:49:23.495797  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:23.496358  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:23.496391  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:23.496305  871030 retry.go:31] will retry after 399.111276ms: waiting for machine to come up

	I0429 12:49:23.897726  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:23.898280  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:23.898315  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:23.898236  871030 retry.go:31] will retry after 423.835443ms: waiting for machine to come up

	I0429 12:49:24.324377  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:24.324945  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:24.324974  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:24.324899  871030 retry.go:31] will retry after 676.971457ms: waiting for machine to come up

	I0429 12:49:25.003929  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:25.004292  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:25.004315  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:25.004262  871030 retry.go:31] will retry after 923.473252ms: waiting for machine to come up

	I0429 12:49:25.928825  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:25.929398  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:25.929436  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:25.929332  871030 retry.go:31] will retry after 855.800309ms: waiting for machine to come up

	I0429 12:49:26.786759  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:26.787218  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:26.787248  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:26.787181  871030 retry.go:31] will retry after 999.873188ms: waiting for machine to come up

	I0429 12:49:27.788564  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:27.789010  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:27.789035  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:27.788950  871030 retry.go:31] will retry after 1.830294576s: waiting for machine to come up

	I0429 12:49:29.622339  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:29.622964  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:29.623001  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:29.622895  871030 retry.go:31] will retry after 2.277621565s: waiting for machine to come up

	I0429 12:49:31.901933  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:31.902475  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:31.902524  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:31.902398  871030 retry.go:31] will retry after 2.203385625s: waiting for machine to come up

	I0429 12:49:34.108550  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:34.108982  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:34.109014  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:34.108936  871030 retry.go:31] will retry after 3.624223076s: waiting for machine to come up

	I0429 12:49:37.735007  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:37.735616  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find current IP address of domain ha-212075-m03 in network mk-ha-212075

	I0429 12:49:37.735646  870218 main.go:141] libmachine: (ha-212075-m03) DBG | I0429 12:49:37.735568  871030 retry.go:31] will retry after 4.166668795s: waiting for machine to come up

	I0429 12:49:41.903602  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:41.904123  870218 main.go:141] libmachine: (ha-212075-m03) Found IP for machine: 192.168.39.109

	I0429 12:49:41.904142  870218 main.go:141] libmachine: (ha-212075-m03) Reserving static IP address...

	I0429 12:49:41.904152  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has current primary IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:41.904544  870218 main.go:141] libmachine: (ha-212075-m03) DBG | unable to find host DHCP lease matching {name: "ha-212075-m03", mac: "52:54:00:1c:04:a1", ip: "192.168.39.109"} in network mk-ha-212075

	I0429 12:49:41.999071  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Getting to WaitForSSH function...

	I0429 12:49:41.999113  870218 main.go:141] libmachine: (ha-212075-m03) Reserved static IP address: 192.168.39.109

	I0429 12:49:41.999129  870218 main.go:141] libmachine: (ha-212075-m03) Waiting for SSH to be available...

	I0429 12:49:42.001885  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.002602  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:minikube Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.002632  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.002653  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Using SSH client type: external

	I0429 12:49:42.002666  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa (-rw-------)

	I0429 12:49:42.002696  870218 main.go:141] libmachine: (ha-212075-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.109 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0429 12:49:42.002710  870218 main.go:141] libmachine: (ha-212075-m03) DBG | About to run SSH command:

	I0429 12:49:42.002748  870218 main.go:141] libmachine: (ha-212075-m03) DBG | exit 0

	I0429 12:49:42.132018  870218 main.go:141] libmachine: (ha-212075-m03) DBG | SSH cmd err, output: <nil>: 

	I0429 12:49:42.132286  870218 main.go:141] libmachine: (ha-212075-m03) KVM machine creation complete!

	I0429 12:49:42.132639  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetConfigRaw

	I0429 12:49:42.133225  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:42.133438  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:42.133643  870218 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0429 12:49:42.133665  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetState

	I0429 12:49:42.135130  870218 main.go:141] libmachine: Detecting operating system of created instance...

	I0429 12:49:42.135148  870218 main.go:141] libmachine: Waiting for SSH to be available...

	I0429 12:49:42.135157  870218 main.go:141] libmachine: Getting to WaitForSSH function...

	I0429 12:49:42.135168  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.137902  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.138260  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.138291  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.138462  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.138672  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.138886  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.139066  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.139259  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.139548  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.139562  870218 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0429 12:49:42.251331  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:49:42.251394  870218 main.go:141] libmachine: Detecting the provisioner...

	I0429 12:49:42.251407  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.255739  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.256325  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.256371  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.256822  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.257086  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.257291  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.257464  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.257701  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.257939  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.257959  870218 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0429 12:49:42.372811  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0429 12:49:42.372885  870218 main.go:141] libmachine: found compatible host: buildroot

	I0429 12:49:42.372892  870218 main.go:141] libmachine: Provisioning with buildroot...

	I0429 12:49:42.372902  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:42.373263  870218 buildroot.go:166] provisioning hostname "ha-212075-m03"

	I0429 12:49:42.373296  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:42.373540  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.376574  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.377111  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.377148  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.377277  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.377493  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.377667  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.377828  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.378048  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.378311  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.378330  870218 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-212075-m03 && echo "ha-212075-m03" | sudo tee /etc/hostname

	I0429 12:49:42.504636  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-212075-m03

	I0429 12:49:42.504679  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.507608  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.508004  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.508030  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.508303  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.508548  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.508754  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.508886  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.509117  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.509339  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.509357  870218 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-212075-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-212075-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-212075-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0429 12:49:42.626792  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0429 12:49:42.626829  870218 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18773-847310/.minikube CaCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18773-847310/.minikube}

	I0429 12:49:42.626849  870218 buildroot.go:174] setting up certificates

	I0429 12:49:42.626863  870218 provision.go:84] configureAuth start

	I0429 12:49:42.626876  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetMachineName

	I0429 12:49:42.627259  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:42.630150  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.630519  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.630552  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.630703  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.633425  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.633770  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.633798  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.633925  870218 provision.go:143] copyHostCerts

	I0429 12:49:42.633964  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:49:42.634010  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem, removing ...

	I0429 12:49:42.634023  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem

	I0429 12:49:42.634119  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/ca.pem (1078 bytes)

	I0429 12:49:42.634237  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:49:42.634263  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem, removing ...

	I0429 12:49:42.634273  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem

	I0429 12:49:42.634318  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/cert.pem (1123 bytes)

	I0429 12:49:42.634403  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:49:42.634426  870218 exec_runner.go:144] found /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem, removing ...

	I0429 12:49:42.634434  870218 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem

	I0429 12:49:42.634467  870218 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18773-847310/.minikube/key.pem (1679 bytes)

	I0429 12:49:42.634540  870218 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem org=jenkins.ha-212075-m03 san=[127.0.0.1 192.168.39.109 ha-212075-m03 localhost minikube]

	I0429 12:49:42.737197  870218 provision.go:177] copyRemoteCerts

	I0429 12:49:42.737263  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0429 12:49:42.737297  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.740003  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.740382  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.740442  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.740606  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.740806  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.740978  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.741155  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:42.827122  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0429 12:49:42.827206  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0429 12:49:42.855209  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0429 12:49:42.855317  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0429 12:49:42.883770  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0429 12:49:42.883851  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0429 12:49:42.911410  870218 provision.go:87] duration metric: took 284.528347ms to configureAuth

	I0429 12:49:42.911452  870218 buildroot.go:189] setting minikube options for container-runtime

	I0429 12:49:42.911733  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:42.911834  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:42.914793  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.915175  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:42.915208  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:42.915408  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:42.915653  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.915839  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:42.915991  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:42.916165  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:42.916385  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:42.916411  870218 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0429 12:49:43.217344  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0429 12:49:43.217385  870218 main.go:141] libmachine: Checking connection to Docker...

	I0429 12:49:43.217396  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetURL

	I0429 12:49:43.219000  870218 main.go:141] libmachine: (ha-212075-m03) DBG | Using libvirt version 6000000

	I0429 12:49:43.221697  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.222061  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.222087  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.222270  870218 main.go:141] libmachine: Docker is up and running!

	I0429 12:49:43.222283  870218 main.go:141] libmachine: Reticulating splines...

	I0429 12:49:43.222291  870218 client.go:171] duration metric: took 21.933879944s to LocalClient.Create

	I0429 12:49:43.222314  870218 start.go:167] duration metric: took 21.933944364s to libmachine.API.Create "ha-212075"

	I0429 12:49:43.222324  870218 start.go:293] postStartSetup for "ha-212075-m03" (driver="kvm2")

	I0429 12:49:43.222335  870218 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0429 12:49:43.222370  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.222650  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0429 12:49:43.222690  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:43.225352  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.225819  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.225855  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.226068  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.226288  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.226485  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.226624  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:43.316706  870218 ssh_runner.go:195] Run: cat /etc/os-release

	I0429 12:49:43.321843  870218 info.go:137] Remote host: Buildroot 2023.02.9

	I0429 12:49:43.321882  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/addons for local assets ...

	I0429 12:49:43.321994  870218 filesync.go:126] Scanning /home/jenkins/minikube-integration/18773-847310/.minikube/files for local assets ...

	I0429 12:49:43.322091  870218 filesync.go:149] local asset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> 8546602.pem in /etc/ssl/certs

	I0429 12:49:43.322104  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /etc/ssl/certs/8546602.pem

	I0429 12:49:43.322368  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0429 12:49:43.334078  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:49:43.361992  870218 start.go:296] duration metric: took 139.649645ms for postStartSetup

	I0429 12:49:43.362063  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetConfigRaw

	I0429 12:49:43.362790  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:43.365832  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.366363  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.366399  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.366832  870218 profile.go:143] Saving config to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/config.json ...

	I0429 12:49:43.367146  870218 start.go:128] duration metric: took 22.099896004s to createHost

	I0429 12:49:43.367183  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:43.369765  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.370219  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.370248  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.370419  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.370666  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.370874  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.371071  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.371236  870218 main.go:141] libmachine: Using SSH client type: native

	I0429 12:49:43.371460  870218 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.109 22 <nil> <nil>}

	I0429 12:49:43.371478  870218 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0429 12:49:43.485175  870218 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714394983.453178524

	I0429 12:49:43.485209  870218 fix.go:216] guest clock: 1714394983.453178524

	I0429 12:49:43.485228  870218 fix.go:229] Guest: 2024-04-29 12:49:43.453178524 +0000 UTC Remote: 2024-04-29 12:49:43.367166051 +0000 UTC m=+152.742319003 (delta=86.012473ms)

	I0429 12:49:43.485253  870218 fix.go:200] guest clock delta is within tolerance: 86.012473ms

	I0429 12:49:43.485260  870218 start.go:83] releasing machines lock for "ha-212075-m03", held for 22.218152522s

	I0429 12:49:43.485292  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.485628  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:43.488595  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.489047  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.489074  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.491763  870218 out.go:177] * Found network options:

	I0429 12:49:43.493406  870218 out.go:177]   - NO_PROXY=192.168.39.97,192.168.39.36

	W0429 12:49:43.494652  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	W0429 12:49:43.494677  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:49:43.494698  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.495627  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.495861  870218 main.go:141] libmachine: (ha-212075-m03) Calling .DriverName

	I0429 12:49:43.496005  870218 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0429 12:49:43.496064  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	W0429 12:49:43.496177  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	W0429 12:49:43.496205  870218 proxy.go:119] fail to check proxy env: Error ip not in block

	I0429 12:49:43.496282  870218 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0429 12:49:43.496308  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHHostname

	I0429 12:49:43.499425  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.499745  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.499847  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.499903  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.500060  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.500281  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.500316  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:43.500332  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:43.500490  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHPort

	I0429 12:49:43.500615  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.500728  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHKeyPath

	I0429 12:49:43.500799  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:43.500895  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetSSHUsername

	I0429 12:49:43.501079  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.109 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075-m03/id_rsa Username:docker}

	I0429 12:49:43.745296  870218 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0429 12:49:43.753042  870218 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0429 12:49:43.753146  870218 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0429 12:49:43.771662  870218 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0429 12:49:43.771702  870218 start.go:494] detecting cgroup driver to use...

	I0429 12:49:43.771785  870218 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0429 12:49:43.789253  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0429 12:49:43.805629  870218 docker.go:217] disabling cri-docker service (if available) ...

	I0429 12:49:43.805716  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0429 12:49:43.823411  870218 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0429 12:49:43.839119  870218 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0429 12:49:43.965205  870218 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0429 12:49:44.144532  870218 docker.go:233] disabling docker service ...

	I0429 12:49:44.144615  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0429 12:49:44.161598  870218 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0429 12:49:44.176924  870218 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0429 12:49:44.318518  870218 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0429 12:49:44.444464  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0429 12:49:44.460146  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0429 12:49:44.482406  870218 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0429 12:49:44.482480  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.495415  870218 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0429 12:49:44.495495  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.507625  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.520065  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.532758  870218 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0429 12:49:44.545179  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.557185  870218 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.577205  870218 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0429 12:49:44.590527  870218 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0429 12:49:44.601541  870218 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0429 12:49:44.601614  870218 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0429 12:49:44.618752  870218 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0429 12:49:44.630649  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:49:44.760043  870218 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0429 12:49:44.908104  870218 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0429 12:49:44.908203  870218 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0429 12:49:44.913590  870218 start.go:562] Will wait 60s for crictl version

	I0429 12:49:44.913671  870218 ssh_runner.go:195] Run: which crictl

	I0429 12:49:44.917832  870218 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0429 12:49:44.967004  870218 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0429 12:49:44.967123  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:49:45.000292  870218 ssh_runner.go:195] Run: crio --version

	I0429 12:49:45.033598  870218 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0429 12:49:45.034927  870218 out.go:177]   - env NO_PROXY=192.168.39.97

	I0429 12:49:45.036448  870218 out.go:177]   - env NO_PROXY=192.168.39.97,192.168.39.36

	I0429 12:49:45.037641  870218 main.go:141] libmachine: (ha-212075-m03) Calling .GetIP

	I0429 12:49:45.040460  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:45.040872  870218 main.go:141] libmachine: (ha-212075-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:1c:04:a1", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:49:36 +0000 UTC Type:0 Mac:52:54:00:1c:04:a1 Iaid: IPaddr:192.168.39.109 Prefix:24 Hostname:ha-212075-m03 Clientid:01:52:54:00:1c:04:a1}

	I0429 12:49:45.040897  870218 main.go:141] libmachine: (ha-212075-m03) DBG | domain ha-212075-m03 has defined IP address 192.168.39.109 and MAC address 52:54:00:1c:04:a1 in network mk-ha-212075

	I0429 12:49:45.041102  870218 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0429 12:49:45.045938  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:49:45.060030  870218 mustload.go:65] Loading cluster: ha-212075

	I0429 12:49:45.060296  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:49:45.060651  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:45.060702  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:45.076464  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38675

	I0429 12:49:45.076966  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:45.077478  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:45.077508  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:45.077859  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:45.078069  870218 main.go:141] libmachine: (ha-212075) Calling .GetState

	I0429 12:49:45.079901  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:49:45.080243  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:45.080285  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:45.096699  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43045

	I0429 12:49:45.097237  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:45.097836  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:45.097862  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:45.098219  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:45.098405  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:49:45.098548  870218 certs.go:68] Setting up /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075 for IP: 192.168.39.109

	I0429 12:49:45.098562  870218 certs.go:194] generating shared ca certs ...

	I0429 12:49:45.098585  870218 certs.go:226] acquiring lock for ca certs: {Name:mk6be02e49d8ee7e457b7d9b7cd478c5e883ea66 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:49:45.098756  870218 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key

	I0429 12:49:45.098808  870218 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key

	I0429 12:49:45.098823  870218 certs.go:256] generating profile certs ...

	I0429 12:49:45.098924  870218 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key

	I0429 12:49:45.098980  870218 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a

	I0429 12:49:45.099003  870218 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.97 192.168.39.36 192.168.39.109 192.168.39.254]

	I0429 12:49:45.305371  870218 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a ...

	I0429 12:49:45.305425  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a: {Name:mk17ce06665377b1ef8d805c47fa76e8dc7207f1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:49:45.305633  870218 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a ...

	I0429 12:49:45.305648  870218 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a: {Name:mk93b7c74bfe26fde2277c8d3d88ed9da0ad319b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0429 12:49:45.305724  870218 certs.go:381] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt.ed1ead6a -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt

	I0429 12:49:45.305871  870218 certs.go:385] copying /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key.ed1ead6a -> /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key

	I0429 12:49:45.306065  870218 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key

	I0429 12:49:45.306084  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0429 12:49:45.306097  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0429 12:49:45.306107  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0429 12:49:45.306122  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0429 12:49:45.306135  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0429 12:49:45.306148  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0429 12:49:45.306159  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0429 12:49:45.306177  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0429 12:49:45.306231  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem (1338 bytes)

	W0429 12:49:45.306261  870218 certs.go:480] ignoring /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660_empty.pem, impossibly tiny 0 bytes

	I0429 12:49:45.306271  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca-key.pem (1679 bytes)

	I0429 12:49:45.306291  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/ca.pem (1078 bytes)

	I0429 12:49:45.306311  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/cert.pem (1123 bytes)

	I0429 12:49:45.306339  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/key.pem (1679 bytes)

	I0429 12:49:45.306382  870218 certs.go:484] found cert: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem (1708 bytes)

	I0429 12:49:45.306422  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem -> /usr/share/ca-certificates/854660.pem

	I0429 12:49:45.306443  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem -> /usr/share/ca-certificates/8546602.pem

	I0429 12:49:45.306461  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:45.306505  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:49:45.310065  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:45.310591  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:49:45.310624  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:45.310800  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:49:45.311020  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:49:45.311175  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:49:45.311404  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:49:45.391809  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0429 12:49:45.398724  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0429 12:49:45.413103  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0429 12:49:45.418467  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)

	I0429 12:49:45.432802  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0429 12:49:45.440754  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0429 12:49:45.455596  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0429 12:49:45.461211  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0429 12:49:45.474952  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0429 12:49:45.480353  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0429 12:49:45.494613  870218 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0429 12:49:45.500103  870218 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0429 12:49:45.514344  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0429 12:49:45.543413  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0429 12:49:45.571376  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0429 12:49:45.599504  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0429 12:49:45.626755  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0429 12:49:45.654437  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0429 12:49:45.683324  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0429 12:49:45.711211  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0429 12:49:45.741014  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/certs/854660.pem --> /usr/share/ca-certificates/854660.pem (1338 bytes)

	I0429 12:49:45.771670  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/files/etc/ssl/certs/8546602.pem --> /usr/share/ca-certificates/8546602.pem (1708 bytes)

	I0429 12:49:45.799792  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0429 12:49:45.827179  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0429 12:49:45.846410  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)

	I0429 12:49:45.865742  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0429 12:49:45.884880  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0429 12:49:45.906579  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0429 12:49:45.934587  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0429 12:49:45.954505  870218 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0429 12:49:45.975997  870218 ssh_runner.go:195] Run: openssl version

	I0429 12:49:45.982992  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/854660.pem && ln -fs /usr/share/ca-certificates/854660.pem /etc/ssl/certs/854660.pem"

	I0429 12:49:45.997527  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/854660.pem

	I0429 12:49:46.003152  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 29 12:39 /usr/share/ca-certificates/854660.pem

	I0429 12:49:46.003236  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/854660.pem

	I0429 12:49:46.010012  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/854660.pem /etc/ssl/certs/51391683.0"

	I0429 12:49:46.023112  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/8546602.pem && ln -fs /usr/share/ca-certificates/8546602.pem /etc/ssl/certs/8546602.pem"

	I0429 12:49:46.036215  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/8546602.pem

	I0429 12:49:46.041157  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 29 12:39 /usr/share/ca-certificates/8546602.pem

	I0429 12:49:46.041267  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/8546602.pem

	I0429 12:49:46.047620  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/8546602.pem /etc/ssl/certs/3ec20f2e.0"

	I0429 12:49:46.060305  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0429 12:49:46.073926  870218 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:46.079569  870218 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 29 11:59 /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:46.079679  870218 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0429 12:49:46.086524  870218 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0429 12:49:46.099843  870218 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0429 12:49:46.105249  870218 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0429 12:49:46.105323  870218 kubeadm.go:928] updating node {m03 192.168.39.109 8443 v1.30.0 crio true true} ...

	I0429 12:49:46.105422  870218 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-212075-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.109

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0429 12:49:46.105448  870218 kube-vip.go:111] generating kube-vip config ...

	I0429 12:49:46.105491  870218 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0429 12:49:46.128538  870218 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0429 12:49:46.128670  870218 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0429 12:49:46.128781  870218 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0429 12:49:46.141116  870218 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0429 12:49:46.141207  870218 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0429 12:49:46.154231  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256

	I0429 12:49:46.154250  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256

	I0429 12:49:46.154278  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:49:46.154231  870218 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0429 12:49:46.154301  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:49:46.154310  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:49:46.154344  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0429 12:49:46.154399  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0429 12:49:46.167622  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0429 12:49:46.167674  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0429 12:49:46.183740  870218 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:49:46.183810  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0429 12:49:46.183852  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0429 12:49:46.183861  870218 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0429 12:49:46.248362  870218 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0429 12:49:46.248422  870218 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18773-847310/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0429 12:49:47.245635  870218 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0429 12:49:47.257815  870218 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0429 12:49:47.279835  870218 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0429 12:49:47.302241  870218 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0429 12:49:47.321197  870218 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0429 12:49:47.325960  870218 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0429 12:49:47.340454  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:49:47.476126  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:49:47.495980  870218 host.go:66] Checking if "ha-212075" exists ...

	I0429 12:49:47.496376  870218 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 12:49:47.496420  870218 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 12:49:47.513164  870218 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36255

	I0429 12:49:47.513691  870218 main.go:141] libmachine: () Calling .GetVersion

	I0429 12:49:47.514330  870218 main.go:141] libmachine: Using API Version  1

	I0429 12:49:47.514356  870218 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 12:49:47.514754  870218 main.go:141] libmachine: () Calling .GetMachineName

	I0429 12:49:47.514985  870218 main.go:141] libmachine: (ha-212075) Calling .DriverName

	I0429 12:49:47.515150  870218 start.go:316] joinCluster: &{Name:ha-212075 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-212075 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.36 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false in

spektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fal

se DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0429 12:49:47.515340  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0429 12:49:47.515385  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHHostname

	I0429 12:49:47.518988  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:47.519544  870218 main.go:141] libmachine: (ha-212075) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:c0:56:df", ip: ""} in network mk-ha-212075: {Iface:virbr1 ExpiryTime:2024-04-29 13:47:25 +0000 UTC Type:0 Mac:52:54:00:c0:56:df Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-212075 Clientid:01:52:54:00:c0:56:df}

	I0429 12:49:47.519582  870218 main.go:141] libmachine: (ha-212075) DBG | domain ha-212075 has defined IP address 192.168.39.97 and MAC address 52:54:00:c0:56:df in network mk-ha-212075

	I0429 12:49:47.519819  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHPort

	I0429 12:49:47.520072  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHKeyPath

	I0429 12:49:47.520249  870218 main.go:141] libmachine: (ha-212075) Calling .GetSSHUsername

	I0429 12:49:47.520432  870218 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18773-847310/.minikube/machines/ha-212075/id_rsa Username:docker}

	I0429 12:49:47.723515  870218 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:49:47.723578  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token vnojfi.4shmv2la5ipmuekk --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m03 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443"

	I0429 12:50:11.558514  870218 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token vnojfi.4shmv2la5ipmuekk --discovery-token-ca-cert-hash sha256:8e86e01321b0ee2400049a0f2863e21b68a0f729e3f866035e1506a51e5de529 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-212075-m03 --control-plane --apiserver-advertise-address=192.168.39.109 --apiserver-bind-port=8443": (23.834907661s)

	I0429 12:50:11.558556  870218 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0429 12:50:12.191163  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-212075-m03 minikube.k8s.io/updated_at=2024_04_29T12_50_12_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332 minikube.k8s.io/name=ha-212075 minikube.k8s.io/primary=false

	I0429 12:50:12.332310  870218 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-212075-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0429 12:50:12.457983  870218 start.go:318] duration metric: took 24.942805115s to joinCluster

	I0429 12:50:12.458080  870218 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.109 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0429 12:50:12.459647  870218 out.go:177] * Verifying Kubernetes components...

	I0429 12:50:12.458462  870218 config.go:182] Loaded profile config "ha-212075": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 12:50:12.460883  870218 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0429 12:50:12.786218  870218 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0429 12:50:12.827610  870218 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18773-847310/kubeconfig

	I0429 12:50:12.827947  870218 kapi.go:59] client config for ha-212075: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.crt", KeyFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/profiles/ha-212075/client.key", CAFile:"/home/jenkins/minikube-integration/18773-847310/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0429 12:50:12.828022  870218 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.97:8443

	I0429 12:50:12.828333  870218 node_ready.go:35] waiting up to 6m0s for node "ha-212075-m03" to be "Ready" ...

	I0429 12:50:12.828437  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:12.828446  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:12.828457  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:12.828466  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:12.832030  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:13.328972  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:13.329002  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:13.329012  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:13.329016  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:13.333488  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:13.829280  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:13.829310  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:13.829317  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:13.829321  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:13.833464  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:14.328604  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:14.328634  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:14.328647  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:14.328654  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:14.332954  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:14.829170  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:14.829194  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:14.829202  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:14.829206  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:14.833857  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:14.834791  870218 node_ready.go:53] node "ha-212075-m03" has status "Ready":"False"

	I0429 12:50:15.329188  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:15.329215  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:15.329224  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:15.329228  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:15.333208  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:15.829111  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:15.829145  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:15.829156  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:15.829162  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:15.833305  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:16.328929  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:16.328964  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:16.328977  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:16.328983  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:16.332860  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:16.828885  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:16.828914  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:16.828923  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:16.828928  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:16.832858  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:17.328914  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:17.328949  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:17.328960  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:17.328966  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:17.333213  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:17.334349  870218 node_ready.go:53] node "ha-212075-m03" has status "Ready":"False"

	I0429 12:50:17.828574  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:17.828607  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:17.828618  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:17.828622  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:17.833207  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:18.329374  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:18.329402  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.329410  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.329415  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.333316  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.828563  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:18.828591  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.828600  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.828603  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.833296  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:18.833938  870218 node_ready.go:49] node "ha-212075-m03" has status "Ready":"True"

	I0429 12:50:18.833966  870218 node_ready.go:38] duration metric: took 6.005614001s for node "ha-212075-m03" to be "Ready" ...

	I0429 12:50:18.833976  870218 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:50:18.834052  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:18.834061  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.834069  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.834076  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.848836  870218 round_trippers.go:574] Response Status: 200 OK in 14 milliseconds

	I0429 12:50:18.858243  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.858371  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-c2t8g

	I0429 12:50:18.858382  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.858395  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.858405  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.861615  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.862314  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:18.862334  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.862342  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.862347  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.865782  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.866457  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.866479  870218 pod_ready.go:81] duration metric: took 8.200804ms for pod "coredns-7db6d8ff4d-c2t8g" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.866490  870218 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.866552  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-x299s

	I0429 12:50:18.866560  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.866567  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.866572  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.870040  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.870670  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:18.870686  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.870696  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.870702  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.874007  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.874553  870218 pod_ready.go:92] pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.874575  870218 pod_ready.go:81] duration metric: took 8.079218ms for pod "coredns-7db6d8ff4d-x299s" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.874586  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.874655  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075

	I0429 12:50:18.874665  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.874674  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.874680  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.878665  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.879434  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:18.879460  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.879471  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.879478  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.882752  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:18.883423  870218 pod_ready.go:92] pod "etcd-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.883447  870218 pod_ready.go:81] duration metric: took 8.854916ms for pod "etcd-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.883459  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.883533  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m02

	I0429 12:50:18.883540  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.883548  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.883553  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.886433  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:50:18.887117  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:18.887135  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:18.887143  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:18.887147  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:18.889866  870218 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0429 12:50:18.890552  870218 pod_ready.go:92] pod "etcd-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:18.890577  870218 pod_ready.go:81] duration metric: took 7.108063ms for pod "etcd-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:18.890591  870218 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:19.028989  870218 request.go:629] Waited for 138.314405ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.029067  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.029072  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.029080  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.029085  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.032924  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.229133  870218 request.go:629] Waited for 195.395298ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.229202  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.229207  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.229217  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.229220  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.232853  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.428983  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.429028  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.429039  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.429044  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.432974  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.629442  870218 request.go:629] Waited for 195.37277ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.629530  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:19.629538  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.629547  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.629554  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.633456  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:19.891393  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:19.891419  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:19.891429  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:19.891433  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:19.895758  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:20.028865  870218 request.go:629] Waited for 132.326326ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.028930  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.028936  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.028944  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.028948  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.032892  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.390899  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:20.390924  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.390932  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.390936  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.394598  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.428843  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.428894  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.428908  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.428916  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.432578  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.891566  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:20.891605  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.891617  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.891624  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.895968  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:20.896842  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:20.896866  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:20.896880  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:20.896885  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:20.900749  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:20.901250  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:21.391390  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:21.391422  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.391432  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.391437  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.395486  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:21.396301  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:21.396323  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.396333  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.396337  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.399629  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:21.891709  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:21.891737  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.891746  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.891751  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.895525  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:21.896515  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:21.896534  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:21.896544  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:21.896549  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:21.899591  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:22.391086  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:22.391120  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.391129  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.391134  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.395272  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:22.396260  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:22.396280  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.396292  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.396298  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.399934  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:22.891706  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:22.891741  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.891754  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.891762  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.895857  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:22.896485  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:22.896507  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:22.896518  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:22.896524  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:22.899783  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:23.391764  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:23.391802  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.391813  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.391819  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.396591  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:23.397678  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:23.397697  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.397706  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.397712  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.401022  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:23.401638  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:23.891473  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:23.891518  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.891527  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.891531  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.895998  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:23.897166  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:23.897188  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:23.897198  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:23.897203  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:23.900834  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.391767  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:24.391793  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.391801  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.391806  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.395683  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.396364  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:24.396382  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.396390  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.396394  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.399833  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.890825  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:24.890853  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.890862  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.890866  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.894777  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:24.895773  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:24.895795  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:24.895803  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:24.895807  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:24.899690  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.391837  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:25.391877  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.391890  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.391897  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.395911  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.396638  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:25.396658  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.396667  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.396672  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.400113  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.890897  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:25.890925  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.890933  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.890937  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.894971  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:25.895752  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:25.895776  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:25.895786  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:25.895792  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:25.899327  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:25.900011  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:26.391728  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:26.391755  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.391766  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.391771  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.395868  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:26.396629  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:26.396652  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.396659  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.396662  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.399977  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:26.890872  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:26.890906  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.890916  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.890921  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.894973  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:26.895971  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:26.895993  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:26.896002  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:26.896005  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:26.899197  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:27.390790  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:27.390819  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.390828  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.390832  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.395080  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:27.396304  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:27.396327  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.396340  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.396345  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.399685  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:27.891328  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:27.891383  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.891396  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.891408  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.895963  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:27.896759  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:27.896777  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:27.896785  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:27.896789  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:27.900307  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:27.900827  870218 pod_ready.go:102] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 12:50:28.391176  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:28.391206  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.391214  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.391219  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.395304  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:28.396189  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:28.396216  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.396228  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.396234  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.399510  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.891313  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/etcd-ha-212075-m03

	I0429 12:50:28.891343  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.891351  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.891368  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.896027  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:28.897004  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:28.897024  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.897033  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.897037  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.900096  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.900611  870218 pod_ready.go:92] pod "etcd-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.900634  870218 pod_ready.go:81] duration metric: took 10.01003378s for pod "etcd-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.900658  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.900736  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075

	I0429 12:50:28.900748  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.900759  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.900772  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.904062  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.905012  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:28.905033  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.905041  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.905046  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.914390  870218 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0429 12:50:28.915162  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.915184  870218 pod_ready.go:81] duration metric: took 14.517505ms for pod "kube-apiserver-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.915206  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.915288  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075-m02

	I0429 12:50:28.915299  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.915310  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.915316  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.918801  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.919480  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:28.919499  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.919511  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.919518  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.925028  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:50:28.925481  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.925502  870218 pod_ready.go:81] duration metric: took 10.2876ms for pod "kube-apiserver-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.925512  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.925600  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-212075-m03

	I0429 12:50:28.925609  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.925617  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.925622  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.930192  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:28.930899  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:28.930923  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.930934  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.930939  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.936104  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:50:28.936664  870218 pod_ready.go:92] pod "kube-apiserver-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.936690  870218 pod_ready.go:81] duration metric: took 11.171571ms for pod "kube-apiserver-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.936706  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.936798  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075

	I0429 12:50:28.936813  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.936821  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.936825  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.945481  870218 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 12:50:28.946622  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:28.946652  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:28.946664  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:28.946671  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:28.950691  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:28.951321  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:28.951353  870218 pod_ready.go:81] duration metric: took 14.638423ms for pod "kube-controller-manager-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:28.951391  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.091822  870218 request.go:629] Waited for 140.318624ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m02

	I0429 12:50:29.091900  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m02

	I0429 12:50:29.091906  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.091914  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.091922  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.096036  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:29.292235  870218 request.go:629] Waited for 195.433606ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:29.292308  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:29.292313  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.292320  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.292327  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.296173  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:29.296828  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:29.296855  870218 pod_ready.go:81] duration metric: took 345.456965ms for pod "kube-controller-manager-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.296868  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.491886  870218 request.go:629] Waited for 194.903497ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m03

	I0429 12:50:29.491968  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-212075-m03

	I0429 12:50:29.491976  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.491987  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.491995  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.497776  870218 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 12:50:29.691599  870218 request.go:629] Waited for 192.371637ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:29.691712  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:29.691717  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.691726  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.691731  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.695802  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:29.696538  870218 pod_ready.go:92] pod "kube-controller-manager-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:29.696564  870218 pod_ready.go:81] duration metric: took 399.690214ms for pod "kube-controller-manager-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.696579  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-c27wn" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:29.892095  870218 request.go:629] Waited for 195.391435ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-c27wn

	I0429 12:50:29.892181  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-c27wn

	I0429 12:50:29.892188  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:29.892199  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:29.892207  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:29.896134  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:30.092329  870218 request.go:629] Waited for 195.502679ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:30.092433  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:30.092441  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.092452  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.092459  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.096200  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:30.096729  870218 pod_ready.go:92] pod "kube-proxy-c27wn" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:30.096753  870218 pod_ready.go:81] duration metric: took 400.166366ms for pod "kube-proxy-c27wn" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.096765  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.291287  870218 request.go:629] Waited for 194.439552ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:50:30.291447  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-ncdsk

	I0429 12:50:30.291461  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.291474  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.291485  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.297628  870218 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 12:50:30.492144  870218 request.go:629] Waited for 193.412376ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:30.492229  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:30.492248  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.492260  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.492268  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.496334  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:30.496860  870218 pod_ready.go:92] pod "kube-proxy-ncdsk" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:30.496885  870218 pod_ready.go:81] duration metric: took 400.112924ms for pod "kube-proxy-ncdsk" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.496899  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.691664  870218 request.go:629] Waited for 194.681632ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:50:30.692181  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-proxy-sfmhh

	I0429 12:50:30.692198  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.692210  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.692215  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.696295  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:30.891291  870218 request.go:629] Waited for 194.303719ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:30.891444  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:30.891459  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:30.891470  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:30.891477  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:30.895385  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:30.896331  870218 pod_ready.go:92] pod "kube-proxy-sfmhh" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:30.896364  870218 pod_ready.go:81] duration metric: took 399.456713ms for pod "kube-proxy-sfmhh" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:30.896378  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.092314  870218 request.go:629] Waited for 195.838169ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:50:31.092382  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075

	I0429 12:50:31.092387  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.092395  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.092403  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.096642  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:31.291736  870218 request.go:629] Waited for 194.40661ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:31.291832  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075

	I0429 12:50:31.291839  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.291847  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.291853  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.295531  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:31.296465  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:31.296496  870218 pod_ready.go:81] duration metric: took 400.108799ms for pod "kube-scheduler-ha-212075" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.296513  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.491925  870218 request.go:629] Waited for 195.318095ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:50:31.491999  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m02

	I0429 12:50:31.492008  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.492016  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.492029  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.496031  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:31.692069  870218 request.go:629] Waited for 195.409831ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:31.692136  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m02

	I0429 12:50:31.692141  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.692149  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.692154  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.696368  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:31.697106  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:31.697129  870218 pod_ready.go:81] duration metric: took 400.605212ms for pod "kube-scheduler-ha-212075-m02" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.697143  870218 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:31.891352  870218 request.go:629] Waited for 194.092342ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m03

	I0429 12:50:31.891478  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-212075-m03

	I0429 12:50:31.891491  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:31.891503  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:31.891512  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:31.895522  870218 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 12:50:32.091710  870218 request.go:629] Waited for 195.413817ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:32.091787  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes/ha-212075-m03

	I0429 12:50:32.091792  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.091801  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.091806  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.095880  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:32.096637  870218 pod_ready.go:92] pod "kube-scheduler-ha-212075-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 12:50:32.096661  870218 pod_ready.go:81] duration metric: took 399.509578ms for pod "kube-scheduler-ha-212075-m03" in "kube-system" namespace to be "Ready" ...

	I0429 12:50:32.096673  870218 pod_ready.go:38] duration metric: took 13.262684539s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 12:50:32.096690  870218 api_server.go:52] waiting for apiserver process to appear ...

	I0429 12:50:32.096751  870218 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 12:50:32.117800  870218 api_server.go:72] duration metric: took 19.659670409s to wait for apiserver process to appear ...

	I0429 12:50:32.117840  870218 api_server.go:88] waiting for apiserver healthz status ...

	I0429 12:50:32.117869  870218 api_server.go:253] Checking apiserver healthz at https://192.168.39.97:8443/healthz ...

	I0429 12:50:32.123543  870218 api_server.go:279] https://192.168.39.97:8443/healthz returned 200:

	ok

	I0429 12:50:32.123629  870218 round_trippers.go:463] GET https://192.168.39.97:8443/version

	I0429 12:50:32.123638  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.123645  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.123653  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.124638  870218 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0429 12:50:32.124714  870218 api_server.go:141] control plane version: v1.30.0

	I0429 12:50:32.124735  870218 api_server.go:131] duration metric: took 6.886333ms to wait for apiserver health ...

	I0429 12:50:32.124744  870218 system_pods.go:43] waiting for kube-system pods to appear ...

	I0429 12:50:32.292129  870218 request.go:629] Waited for 167.303987ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.292211  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.292216  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.292224  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.292230  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.299499  870218 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 12:50:32.306492  870218 system_pods.go:59] 24 kube-system pods found

	I0429 12:50:32.306546  870218 system_pods.go:61] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:50:32.306553  870218 system_pods.go:61] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:50:32.306559  870218 system_pods.go:61] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:50:32.306564  870218 system_pods.go:61] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:50:32.306569  870218 system_pods.go:61] "etcd-ha-212075-m03" [92f8e094-a516-4426-a1c5-5f92d2022603] Running

	I0429 12:50:32.306575  870218 system_pods.go:61] "kindnet-2d8zp" [43b594a8-818d-423a-80f3-ad2b5dc79785] Running

	I0429 12:50:32.306579  870218 system_pods.go:61] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:50:32.306584  870218 system_pods.go:61] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:50:32.306591  870218 system_pods.go:61] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:50:32.306596  870218 system_pods.go:61] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:50:32.306600  870218 system_pods.go:61] "kube-apiserver-ha-212075-m03" [7484f88d-78bb-486c-9bc7-71c2a779083b] Running

	I0429 12:50:32.306605  870218 system_pods.go:61] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:50:32.306611  870218 system_pods.go:61] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:50:32.306620  870218 system_pods.go:61] "kube-controller-manager-ha-212075-m03" [94aae029-f109-447d-8080-4f41c99b4dbb] Running

	I0429 12:50:32.306626  870218 system_pods.go:61] "kube-proxy-c27wn" [c45c40a2-2b5d-495f-862a-9e54d6fd6a69] Running

	I0429 12:50:32.306634  870218 system_pods.go:61] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:50:32.306639  870218 system_pods.go:61] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:50:32.306647  870218 system_pods.go:61] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:50:32.306652  870218 system_pods.go:61] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:50:32.306660  870218 system_pods.go:61] "kube-scheduler-ha-212075-m03" [0029c03a-f2cd-4964-a1f9-71127fc72819] Running

	I0429 12:50:32.306665  870218 system_pods.go:61] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:50:32.306674  870218 system_pods.go:61] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:50:32.306678  870218 system_pods.go:61] "kube-vip-ha-212075-m03" [68d29842-0ac7-4c12-a12c-546a42040bb2] Running

	I0429 12:50:32.306685  870218 system_pods.go:61] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:50:32.306694  870218 system_pods.go:74] duration metric: took 181.939437ms to wait for pod list to return data ...

	I0429 12:50:32.306709  870218 default_sa.go:34] waiting for default service account to be created ...

	I0429 12:50:32.491873  870218 request.go:629] Waited for 185.06023ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:50:32.491951  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/default/serviceaccounts

	I0429 12:50:32.491957  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.491964  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.491970  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.496044  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:32.496184  870218 default_sa.go:45] found service account: "default"

	I0429 12:50:32.496202  870218 default_sa.go:55] duration metric: took 189.48187ms for default service account to be created ...

	I0429 12:50:32.496212  870218 system_pods.go:116] waiting for k8s-apps to be running ...

	I0429 12:50:32.692200  870218 request.go:629] Waited for 195.908867ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.692277  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/namespaces/kube-system/pods

	I0429 12:50:32.692285  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.692298  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.692309  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.700260  870218 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 12:50:32.707846  870218 system_pods.go:86] 24 kube-system pods found

	I0429 12:50:32.707891  870218 system_pods.go:89] "coredns-7db6d8ff4d-c2t8g" [343d2b3e-1dde-4bf1-b27a-d720d1b21ef4] Running

	I0429 12:50:32.707906  870218 system_pods.go:89] "coredns-7db6d8ff4d-x299s" [441b065a-2b42-4ac5-889e-c18200f43691] Running

	I0429 12:50:32.707913  870218 system_pods.go:89] "etcd-ha-212075" [4c8ad5e6-9375-455f-bae6-3fb3e8f51a0b] Running

	I0429 12:50:32.707920  870218 system_pods.go:89] "etcd-ha-212075-m02" [89f561a6-6871-405d-81fc-2d08b1746ffd] Running

	I0429 12:50:32.707927  870218 system_pods.go:89] "etcd-ha-212075-m03" [92f8e094-a516-4426-a1c5-5f92d2022603] Running

	I0429 12:50:32.707934  870218 system_pods.go:89] "kindnet-2d8zp" [43b594a8-818d-423a-80f3-ad2b5dc79785] Running

	I0429 12:50:32.707943  870218 system_pods.go:89] "kindnet-sx2zd" [a678c6bd-59c7-4620-9a5d-87d0dfd0f12c] Running

	I0429 12:50:32.707953  870218 system_pods.go:89] "kindnet-vnw75" [d7b71f12-5d80-4c41-ae97-a4d7e023ec98] Running

	I0429 12:50:32.707960  870218 system_pods.go:89] "kube-apiserver-ha-212075" [50f980d0-c58d-430b-90cb-3d821a13bf52] Running

	I0429 12:50:32.707970  870218 system_pods.go:89] "kube-apiserver-ha-212075-m02" [ca7d4290-16e5-4dea-a9a6-507931fa8acd] Running

	I0429 12:50:32.707977  870218 system_pods.go:89] "kube-apiserver-ha-212075-m03" [7484f88d-78bb-486c-9bc7-71c2a779083b] Running

	I0429 12:50:32.707984  870218 system_pods.go:89] "kube-controller-manager-ha-212075" [87261df5-c5e2-4d17-99bd-4e3d4c90d658] Running

	I0429 12:50:32.707997  870218 system_pods.go:89] "kube-controller-manager-ha-212075-m02" [83139960-a6ac-4cae-811f-2d55fb6114a6] Running

	I0429 12:50:32.708007  870218 system_pods.go:89] "kube-controller-manager-ha-212075-m03" [94aae029-f109-447d-8080-4f41c99b4dbb] Running

	I0429 12:50:32.708014  870218 system_pods.go:89] "kube-proxy-c27wn" [c45c40a2-2b5d-495f-862a-9e54d6fd6a69] Running

	I0429 12:50:32.708023  870218 system_pods.go:89] "kube-proxy-ncdsk" [632757a3-fa64-4483-af75-828e292ce184] Running

	I0429 12:50:32.708037  870218 system_pods.go:89] "kube-proxy-sfmhh" [6e4ed152-474f-4f58-84bb-16046d39e2ed] Running

	I0429 12:50:32.708043  870218 system_pods.go:89] "kube-scheduler-ha-212075" [1f0296ee-8103-4a99-b0ee-0730db753865] Running

	I0429 12:50:32.708049  870218 system_pods.go:89] "kube-scheduler-ha-212075-m02" [357354cb-865d-4b27-8adf-6324f178cafc] Running

	I0429 12:50:32.708055  870218 system_pods.go:89] "kube-scheduler-ha-212075-m03" [0029c03a-f2cd-4964-a1f9-71127fc72819] Running

	I0429 12:50:32.708062  870218 system_pods.go:89] "kube-vip-ha-212075" [44e6d402-7c09-4c33-9905-15f9d4a29381] Running

	I0429 12:50:32.708071  870218 system_pods.go:89] "kube-vip-ha-212075-m02" [d4927851-25a6-4b3d-84f6-95569c2fe4b7] Running

	I0429 12:50:32.708077  870218 system_pods.go:89] "kube-vip-ha-212075-m03" [68d29842-0ac7-4c12-a12c-546a42040bb2] Running

	I0429 12:50:32.708087  870218 system_pods.go:89] "storage-provisioner" [66e2d2b6-bf65-4b8a-ba39-9c99a83f633e] Running

	I0429 12:50:32.708096  870218 system_pods.go:126] duration metric: took 211.875538ms to wait for k8s-apps to be running ...

	I0429 12:50:32.708108  870218 system_svc.go:44] waiting for kubelet service to be running ....

	I0429 12:50:32.708158  870218 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 12:50:32.729023  870218 system_svc.go:56] duration metric: took 20.905519ms WaitForService to wait for kubelet

	I0429 12:50:32.729060  870218 kubeadm.go:576] duration metric: took 20.270939588s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 12:50:32.729082  870218 node_conditions.go:102] verifying NodePressure condition ...

	I0429 12:50:32.891459  870218 request.go:629] Waited for 162.285599ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.97:8443/api/v1/nodes

	I0429 12:50:32.891529  870218 round_trippers.go:463] GET https://192.168.39.97:8443/api/v1/nodes

	I0429 12:50:32.891542  870218 round_trippers.go:469] Request Headers:

	I0429 12:50:32.891550  870218 round_trippers.go:473]     Accept: application/json, */*

	I0429 12:50:32.891556  870218 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 12:50:32.895591  870218 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 12:50:32.896692  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:50:32.896723  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:50:32.896738  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:50:32.896743  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:50:32.896748  870218 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 12:50:32.896752  870218 node_conditions.go:123] node cpu capacity is 2

	I0429 12:50:32.896757  870218 node_conditions.go:105] duration metric: took 167.669117ms to run NodePressure ...

	I0429 12:50:32.896775  870218 start.go:240] waiting for startup goroutines ...

	I0429 12:50:32.896808  870218 start.go:254] writing updated cluster config ...

	I0429 12:50:32.897223  870218 ssh_runner.go:195] Run: rm -f paused

	I0429 12:50:32.955697  870218 start.go:600] kubectl: 1.30.0, cluster: 1.30.0 (minor skew: 0)

	I0429 12:50:32.958387  870218 out.go:177] * Done! kubectl is now configured to use "ha-212075" cluster and "default" namespace by default

	==> CRI-O <==

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.375200057Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395303375175613,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=f53fa985-eec9-47ff-81e8-f2004578db00 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.376154726Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=58ed0948-4871-4672-8e63-4bd191e84cde name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.376228350Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=58ed0948-4871-4672-8e63-4bd191e84cde name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.376459770Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=58ed0948-4871-4672-8e63-4bd191e84cde name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.417444895Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=99776b4f-8311-479a-98e2-2b6d900dad0f name=/runtime.v1.RuntimeService/Version

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.417523538Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=99776b4f-8311-479a-98e2-2b6d900dad0f name=/runtime.v1.RuntimeService/Version

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.418860258Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=aa783a39-b411-4de1-b5a5-535c50284217 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.419284082Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395303419256587,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=aa783a39-b411-4de1-b5a5-535c50284217 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.419901343Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=147152ef-7f99-4a93-8335-0d11fa7d3b43 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.419957651Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=147152ef-7f99-4a93-8335-0d11fa7d3b43 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.420213697Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=147152ef-7f99-4a93-8335-0d11fa7d3b43 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.464797852Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=4a01b1e6-8e01-41e1-8a51-f0fd6cf1386c name=/runtime.v1.RuntimeService/Version

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.464877025Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=4a01b1e6-8e01-41e1-8a51-f0fd6cf1386c name=/runtime.v1.RuntimeService/Version

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.466333996Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=ab139498-5427-4175-88f0-d91660421270 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.466889707Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395303466862442,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=ab139498-5427-4175-88f0-d91660421270 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.468298148Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=5770093d-060f-429b-bfc7-72d2327a6bb3 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.468456793Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=5770093d-060f-429b-bfc7-72d2327a6bb3 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.468810783Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=5770093d-060f-429b-bfc7-72d2327a6bb3 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.509450056Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=34dc27b5-83de-4d8c-8091-fd95616273d6 name=/runtime.v1.RuntimeService/Version

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.509965287Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=34dc27b5-83de-4d8c-8091-fd95616273d6 name=/runtime.v1.RuntimeService/Version

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.511588679Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=bbbe45c4-11c7-42da-a519-86d328821720 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.512084657Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714395303512061103,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=bbbe45c4-11c7-42da-a519-86d328821720 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.512724020Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=6b6a98cc-be72-4993-ad97-9b29eb8be7bb name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.512777922Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=6b6a98cc-be72-4993-ad97-9b29eb8be7bb name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 12:55:03 ha-212075 crio[678]: time="2024-04-29 12:55:03.513014549Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6079fd69c4d0760ef90f4fbb02bb18dbdcde3b26b5bfdb046497ef9e4bd5d23b,PodSandboxId:377fa41dd93a551baa7d287a8b847531a704550acfb115938d6e18094855ac00,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714395035320489557,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-rcq9m,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: de803f70-5f57-4282-af1e-47845231d712,},Annotations:map[string]string{io.kubernetes.container.hash: a1064d2b,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad,PodSandboxId:e0bec542cd6898b5d41c6ac7b1cad838458cccef07b8d2122fb3f58fe1c6c984,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890366187649,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-c2t8g,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 343d2b3e-1dde-4bf1-b27a-d720d1b21ef4,},Annotations:map[string]string{io.kubernetes.container.hash: d270191f,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6,PodSandboxId:cb2c23b3b3b1c4bbb2519fa0078398bfcd6b18e73f88235242c9233a0f905bac,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714394890318589252,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-x299s,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

441b065a-2b42-4ac5-889e-c18200f43691,},Annotations:map[string]string{io.kubernetes.container.hash: 53e9084a,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7101dd3def458bbf8264638d74ec7010e02872566430ade0c9a8f549d0f5f99f,PodSandboxId:77a1ef53b73e0b1175a0b030e20cc727db07429b982b77afcbb43aa9e01b65f3,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714394890225724244,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 66e2d2b6-bf65-4b8a-ba39-9c99a83f633e,},Annotations:map[string]string{io.kubernetes.container.hash: 493ddf20,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df,PodSandboxId:8f85b8a4ba604ff164d3558ddb0f0a19b427d7f03910a2fabb487a0d1e9cd3fa,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143948

87985326826,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnw75,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d7b71f12-5d80-4c41-ae97-a4d7e023ec98,},Annotations:map[string]string{io.kubernetes.container.hash: 3ad8b079,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d,PodSandboxId:84bca27dac841d90c559f5b2bf511a7a2b8d1f6611b69b2befe3fa6b8841db52,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714394887675604412,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-ncdsk,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 632757a3-fa64-4483-af75-828e292ce184,},Annotations:map[string]string{io.kubernetes.container.hash: f6ee901a,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0c3dc33eb6d5db4717d250127a1abbf0202bb3ce7056499e1673e69d9884a523,PodSandboxId:13efcdd103317913e7e3068be22d5e63fce6354e6ff2080f5592b4188943988d,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714394869189335644,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 24190e4c2daab44202ef18cf148d0f29,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf,PodSandboxId:258b9f1c2d733c4da858a872c6e9abc6c07bd92752810e1f632d1cf51d82f7bd,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714394866813747579,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1ef10b09e6abe0d5e22898bbab1b91b6,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d,PodSandboxId:87588649b2c7923ea0d3d142063e04e513a3628028062e656137f21c6bf3b6f7,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714394866801264642,Labels:map[string]string{io.kubernetes.container.name: kube-controller

-manager,io.kubernetes.pod.name: kube-controller-manager-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 83e05ac5498423338e4375f7ce45dcdf,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16,PodSandboxId:f21fd4330dda0e4110f46aaae38cefac4d1c1af3e3e1bfc67f7f65c5b04578ca,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714394866715741281,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.

kubernetes.pod.name: kube-apiserver-ha-212075,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f99ab7da4da37d23a0aa069a82f24c8c,},Annotations:map[string]string{io.kubernetes.container.hash: 58a58029,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab,PodSandboxId:814df27c007a6d8d0f71243b0c74e23b9ff81a600847b10a9450247db7678439,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714394866667237974,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-ha-212075,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 93f41646a8b279b2bde6d2412bfb785c,},Annotations:map[string]string{io.kubernetes.container.hash: 6647d5b7,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=6b6a98cc-be72-4993-ad97-9b29eb8be7bb name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	6079fd69c4d07       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   4 minutes ago       Running             busybox                   0                   377fa41dd93a5       busybox-fc5497c4f-rcq9m

	8923eb9969f74       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   e0bec542cd689       coredns-7db6d8ff4d-c2t8g

	a7bedc2be5698       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   cb2c23b3b3b1c       coredns-7db6d8ff4d-x299s

	7101dd3def458       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      6 minutes ago       Running             storage-provisioner       0                   77a1ef53b73e0       storage-provisioner

	85ad5484c2e54       4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5                                      6 minutes ago       Running             kindnet-cni               0                   8f85b8a4ba604       kindnet-vnw75

	ae027e60b2a1e       a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b                                      6 minutes ago       Running             kube-proxy                0                   84bca27dac841       kube-proxy-ncdsk

	0c3dc33eb6d5d       ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a     7 minutes ago       Running             kube-vip                  0                   13efcdd103317       kube-vip-ha-212075

	220538e592762       259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced                                      7 minutes ago       Running             kube-scheduler            0                   258b9f1c2d733       kube-scheduler-ha-212075

	382081d5ba19b       c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b                                      7 minutes ago       Running             kube-controller-manager   0                   87588649b2c79       kube-controller-manager-ha-212075

	e9f8269450f85       c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0                                      7 minutes ago       Running             kube-apiserver            0                   f21fd4330dda0       kube-apiserver-ha-212075

	6ba91c742f08c       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      7 minutes ago       Running             etcd                      0                   814df27c007a6       etcd-ha-212075

	==> coredns [8923eb9969f74944eebcb146bad6f62077fbfc7fb2419f92960ba2f5fd5974ad] <==

	[INFO] 10.244.1.2:38828 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000298968s

	[INFO] 10.244.1.2:58272 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000274219s

	[INFO] 10.244.1.2:41537 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000154361s

	[INFO] 10.244.1.2:51430 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000167101s

	[INFO] 10.244.0.4:39294 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002366491s

	[INFO] 10.244.0.4:47691 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000095562s

	[INFO] 10.244.0.4:49991 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000146136s

	[INFO] 10.244.0.4:45880 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000133788s

	[INFO] 10.244.2.2:40297 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00017628s

	[INFO] 10.244.2.2:44282 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001974026s

	[INFO] 10.244.2.2:48058 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000199321s

	[INFO] 10.244.2.2:50097 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000220995s

	[INFO] 10.244.2.2:60877 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000132114s

	[INFO] 10.244.2.2:38824 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000114121s

	[INFO] 10.244.1.2:60691 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000192262s

	[INFO] 10.244.1.2:51664 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000123427s

	[INFO] 10.244.1.2:57326 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000156295s

	[INFO] 10.244.0.4:51093 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000105493s

	[INFO] 10.244.0.4:39454 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000248959s

	[INFO] 10.244.2.2:56559 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00010789s

	[INFO] 10.244.1.2:57860 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144445s

	[INFO] 10.244.1.2:40470 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000145332s

	[INFO] 10.244.0.4:35067 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000124783s

	[INFO] 10.244.2.2:47889 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000150138s

	[INFO] 10.244.2.2:60310 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000091159s

	==> coredns [a7bedc2be56987be4610d367e93c3951fbe9f41a3abb1cb27668d1b7b2488cf6] <==

	[INFO] 10.244.2.2:49673 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.00011362s

	[INFO] 10.244.2.2:52287 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001865115s

	[INFO] 10.244.1.2:45655 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.028655691s

	[INFO] 10.244.1.2:34986 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000171925s

	[INFO] 10.244.1.2:48145 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003370523s

	[INFO] 10.244.1.2:43604 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000158954s

	[INFO] 10.244.0.4:58453 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000127934s

	[INFO] 10.244.0.4:52484 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001277738s

	[INFO] 10.244.0.4:47770 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000128102s

	[INFO] 10.244.0.4:53060 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000103039s

	[INFO] 10.244.2.2:55991 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001854135s

	[INFO] 10.244.2.2:33533 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090157s

	[INFO] 10.244.1.2:52893 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090867s

	[INFO] 10.244.0.4:54479 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000102901s

	[INFO] 10.244.0.4:53525 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000359828s

	[INFO] 10.244.2.2:57755 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000264423s

	[INFO] 10.244.2.2:47852 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000118616s

	[INFO] 10.244.2.2:38289 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000112347s

	[INFO] 10.244.1.2:55092 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000184788s

	[INFO] 10.244.1.2:52235 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000146353s

	[INFO] 10.244.0.4:55598 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000137209s

	[INFO] 10.244.0.4:54649 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000121493s

	[INFO] 10.244.0.4:50694 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000136791s

	[INFO] 10.244.2.2:49177 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000104896s

	[INFO] 10.244.2.2:41037 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000088839s

	==> describe nodes <==

	Name:               ha-212075

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_04_29T12_47_54_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:47:50 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:55:02 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:47:49 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:47:49 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:47:49 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 12:50:56 +0000   Mon, 29 Apr 2024 12:48:09 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.97

	  Hostname:    ha-212075

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 eefe9cc034f74464a919edd5f6b61c2b

	  System UUID:                eefe9cc0-34f7-4464-a919-edd5f6b61c2b

	  Boot ID:                    20b6e47d-4696-4b2a-ba7c-62e73184f5c7

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-rcq9m              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m30s

	  kube-system                 coredns-7db6d8ff4d-c2t8g             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m56s

	  kube-system                 coredns-7db6d8ff4d-x299s             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m56s

	  kube-system                 etcd-ha-212075                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         7m10s

	  kube-system                 kindnet-vnw75                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m57s

	  kube-system                 kube-apiserver-ha-212075             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m10s

	  kube-system                 kube-controller-manager-ha-212075    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m10s

	  kube-system                 kube-proxy-ncdsk                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m57s

	  kube-system                 kube-scheduler-ha-212075             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m12s

	  kube-system                 kube-vip-ha-212075                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m12s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m55s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 6m55s                  kube-proxy       

	  Normal  Starting                 7m18s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientPID     7m17s (x7 over 7m17s)  kubelet          Node ha-212075 status is now: NodeHasSufficientPID

	  Normal  NodeHasSufficientMemory  7m17s (x8 over 7m17s)  kubelet          Node ha-212075 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m17s (x8 over 7m17s)  kubelet          Node ha-212075 status is now: NodeHasNoDiskPressure

	  Normal  NodeAllocatableEnforced  7m17s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 7m10s                  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  7m10s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  7m10s                  kubelet          Node ha-212075 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m10s                  kubelet          Node ha-212075 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     7m10s                  kubelet          Node ha-212075 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m57s                  node-controller  Node ha-212075 event: Registered Node ha-212075 in Controller

	  Normal  NodeReady                6m54s                  kubelet          Node ha-212075 status is now: NodeReady

	  Normal  RegisteredNode           5m46s                  node-controller  Node ha-212075 event: Registered Node ha-212075 in Controller

	  Normal  RegisteredNode           4m36s                  node-controller  Node ha-212075 event: Registered Node ha-212075 in Controller

	Name:               ha-212075-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T12_49_02_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:48:58 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:51:42 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 29 Apr 2024 12:51:02 +0000   Mon, 29 Apr 2024 12:52:22 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.36

	  Hostname:    ha-212075-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 088c5f79339047d6aaf2c88397c97942

	  System UUID:                088c5f79-3390-47d6-aaf2-c88397c97942

	  Boot ID:                    26514912-b71e-458e-b679-e7e1ba2580cb

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-9q8rf                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m30s

	  kube-system                 etcd-ha-212075-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m4s

	  kube-system                 kindnet-sx2zd                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m5s

	  kube-system                 kube-apiserver-ha-212075-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m4s

	  kube-system                 kube-controller-manager-ha-212075-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m4s

	  kube-system                 kube-proxy-sfmhh                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m5s

	  kube-system                 kube-scheduler-ha-212075-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m4s

	  kube-system                 kube-vip-ha-212075-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m1s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 6m                   kube-proxy       

	  Normal  NodeHasSufficientMemory  6m5s (x8 over 6m5s)  kubelet          Node ha-212075-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m5s (x8 over 6m5s)  kubelet          Node ha-212075-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m5s (x7 over 6m5s)  kubelet          Node ha-212075-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  6m5s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           6m2s                 node-controller  Node ha-212075-m02 event: Registered Node ha-212075-m02 in Controller

	  Normal  RegisteredNode           5m46s                node-controller  Node ha-212075-m02 event: Registered Node ha-212075-m02 in Controller

	  Normal  RegisteredNode           4m36s                node-controller  Node ha-212075-m02 event: Registered Node ha-212075-m02 in Controller

	  Normal  NodeNotReady             2m41s                node-controller  Node ha-212075-m02 status is now: NodeNotReady

	Name:               ha-212075-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T12_50_12_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:50:08 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:54:55 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:08 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:08 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:08 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 12:50:39 +0000   Mon, 29 Apr 2024 12:50:18 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.109

	  Hostname:    ha-212075-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 535ef7f0e3c949a7801d0ab8f3e70b91

	  System UUID:                535ef7f0-e3c9-49a7-801d-0ab8f3e70b91

	  Boot ID:                    bc34a15b-f8d2-49d7-ac30-f44e734d2ed5

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-xw452                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m30s

	  kube-system                 etcd-ha-212075-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m53s

	  kube-system                 kindnet-2d8zp                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m55s

	  kube-system                 kube-apiserver-ha-212075-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m53s

	  kube-system                 kube-controller-manager-ha-212075-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m53s

	  kube-system                 kube-proxy-c27wn                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m55s

	  kube-system                 kube-scheduler-ha-212075-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m53s

	  kube-system                 kube-vip-ha-212075-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m50s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m50s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  4m55s (x8 over 4m55s)  kubelet          Node ha-212075-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m55s (x8 over 4m55s)  kubelet          Node ha-212075-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m55s (x7 over 4m55s)  kubelet          Node ha-212075-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m55s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m52s                  node-controller  Node ha-212075-m03 event: Registered Node ha-212075-m03 in Controller

	  Normal  RegisteredNode           4m51s                  node-controller  Node ha-212075-m03 event: Registered Node ha-212075-m03 in Controller

	  Normal  RegisteredNode           4m36s                  node-controller  Node ha-212075-m03 event: Registered Node ha-212075-m03 in Controller

	Name:               ha-212075-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-212075-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=ac56d99acb3fbd2d6010a41c69273a14230e0332

	                    minikube.k8s.io/name=ha-212075

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T12_51_13_0700

	                    minikube.k8s.io/version=v1.33.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 12:51:12 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-212075-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 12:54:58 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:12 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:12 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:12 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 12:51:43 +0000   Mon, 29 Apr 2024 12:51:21 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.139

	  Hostname:    ha-212075-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 ee58aa83584b463285f294fa28d19e05

	  System UUID:                ee58aa83-584b-4632-85f2-94fa28d19e05

	  Boot ID:                    05003e8a-1683-4cb9-9ad4-cb1e00255e69

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-d6tbw       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m52s

	  kube-system                 kube-proxy-bnbr8    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m52s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m46s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  3m52s (x3 over 3m52s)  kubelet          Node ha-212075-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m52s (x3 over 3m52s)  kubelet          Node ha-212075-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m52s (x3 over 3m52s)  kubelet          Node ha-212075-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m52s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m48s                  node-controller  Node ha-212075-m04 event: Registered Node ha-212075-m04 in Controller

	  Normal  RegisteredNode           3m47s                  node-controller  Node ha-212075-m04 event: Registered Node ha-212075-m04 in Controller

	  Normal  RegisteredNode           3m47s                  node-controller  Node ha-212075-m04 event: Registered Node ha-212075-m04 in Controller

	  Normal  NodeReady                3m43s                  kubelet          Node ha-212075-m04 status is now: NodeReady

	==> dmesg <==

	[Apr29 12:47] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.053063] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.042417] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.595489] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.659216] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.658122] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +9.473754] systemd-fstab-generator[595]: Ignoring "noauto" option for root device

	[  +0.066120] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.063959] systemd-fstab-generator[607]: Ignoring "noauto" option for root device

	[  +0.171013] systemd-fstab-generator[621]: Ignoring "noauto" option for root device

	[  +0.136787] systemd-fstab-generator[633]: Ignoring "noauto" option for root device

	[  +0.290881] systemd-fstab-generator[662]: Ignoring "noauto" option for root device

	[  +4.567542] systemd-fstab-generator[761]: Ignoring "noauto" option for root device

	[  +0.067175] kauditd_printk_skb: 130 callbacks suppressed

	[  +3.833264] systemd-fstab-generator[939]: Ignoring "noauto" option for root device

	[  +1.214053] kauditd_printk_skb: 57 callbacks suppressed

	[  +6.340857] systemd-fstab-generator[1355]: Ignoring "noauto" option for root device

	[  +0.082766] kauditd_printk_skb: 40 callbacks suppressed

	[Apr29 12:48] kauditd_printk_skb: 21 callbacks suppressed

	[  +5.082460] kauditd_printk_skb: 72 callbacks suppressed

	==> etcd [6ba91c742f08ce5ca7f85885956dbab905a45671f8b29cd3697fce939dae35ab] <==

	{"level":"warn","ts":"2024-04-29T12:55:03.84182Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.855009Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.857395Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.864899Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.8739Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.87834Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.883275Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.89485Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.904756Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.919862Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.925977Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.926955Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.931902Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.947767Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.954932Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.955071Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.9647Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.969698Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.97501Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.984629Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:03.993204Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:04.004959Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:04.043888Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:04.045372Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T12:55:04.054521Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f61fae125a956d36","from":"f61fae125a956d36","remote-peer-id":"3a236c728dfaea86","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 12:55:04 up 7 min,  0 users,  load average: 0.31, 0.24, 0.12

	Linux ha-212075 5.10.207 #1 SMP Mon Apr 22 03:02:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [85ad5484c2e545d7d4327f4b4a1257ea8f1bdf2af728bf6ff304883f154269df] <==

	I0429 12:54:29.654436       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	I0429 12:54:39.669953       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0429 12:54:39.669997       1 main.go:227] handling current node

	I0429 12:54:39.670008       1 main.go:223] Handling node with IPs: map[192.168.39.36:{}]

	I0429 12:54:39.670092       1 main.go:250] Node ha-212075-m02 has CIDR [10.244.1.0/24] 

	I0429 12:54:39.670217       1 main.go:223] Handling node with IPs: map[192.168.39.109:{}]

	I0429 12:54:39.670248       1 main.go:250] Node ha-212075-m03 has CIDR [10.244.2.0/24] 

	I0429 12:54:39.670297       1 main.go:223] Handling node with IPs: map[192.168.39.139:{}]

	I0429 12:54:39.670320       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	I0429 12:54:49.676716       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0429 12:54:49.676744       1 main.go:227] handling current node

	I0429 12:54:49.676755       1 main.go:223] Handling node with IPs: map[192.168.39.36:{}]

	I0429 12:54:49.676760       1 main.go:250] Node ha-212075-m02 has CIDR [10.244.1.0/24] 

	I0429 12:54:49.676885       1 main.go:223] Handling node with IPs: map[192.168.39.109:{}]

	I0429 12:54:49.676910       1 main.go:250] Node ha-212075-m03 has CIDR [10.244.2.0/24] 

	I0429 12:54:49.676962       1 main.go:223] Handling node with IPs: map[192.168.39.139:{}]

	I0429 12:54:49.676967       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	I0429 12:54:59.685164       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0429 12:54:59.685219       1 main.go:227] handling current node

	I0429 12:54:59.685238       1 main.go:223] Handling node with IPs: map[192.168.39.36:{}]

	I0429 12:54:59.685243       1 main.go:250] Node ha-212075-m02 has CIDR [10.244.1.0/24] 

	I0429 12:54:59.685546       1 main.go:223] Handling node with IPs: map[192.168.39.109:{}]

	I0429 12:54:59.685577       1 main.go:250] Node ha-212075-m03 has CIDR [10.244.2.0/24] 

	I0429 12:54:59.685637       1 main.go:223] Handling node with IPs: map[192.168.39.139:{}]

	I0429 12:54:59.685700       1 main.go:250] Node ha-212075-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [e9f8269450f858894c1b94127abd7a27936ce2cc4abbb18d34b631473dd5df16] <==

	I0429 12:47:52.206856       1 controller.go:615] quota admission added evaluator for: endpoints

	I0429 12:47:52.212802       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0429 12:47:53.195190       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0429 12:47:53.272240       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0429 12:47:53.319588       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0429 12:47:53.336489       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0429 12:48:06.889872       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0429 12:48:06.889872       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	I0429 12:48:07.345600       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	E0429 12:50:37.199894       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50238: use of closed network connection

	E0429 12:50:37.422099       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50256: use of closed network connection

	E0429 12:50:37.642894       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50274: use of closed network connection

	E0429 12:50:37.900488       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50288: use of closed network connection

	E0429 12:50:38.116582       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50304: use of closed network connection

	E0429 12:50:38.344331       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50320: use of closed network connection

	E0429 12:50:38.560181       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50328: use of closed network connection

	E0429 12:50:38.773132       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50354: use of closed network connection

	E0429 12:50:39.005884       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50368: use of closed network connection

	E0429 12:50:39.389303       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50394: use of closed network connection

	E0429 12:50:39.600752       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50404: use of closed network connection

	E0429 12:50:39.815611       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50424: use of closed network connection

	E0429 12:50:40.035011       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50440: use of closed network connection

	E0429 12:50:40.245499       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50462: use of closed network connection

	E0429 12:50:40.457578       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:50492: use of closed network connection

	W0429 12:51:52.205330       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.109 192.168.39.97]

	==> kube-controller-manager [382081d5ba19b58fe32cebbee291e6aa1da39c9e68841bb337d713605174e64d] <==

	I0429 12:49:01.445000       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-212075-m02"

	I0429 12:50:08.617501       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-212075-m03\" does not exist"

	I0429 12:50:08.663917       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-212075-m03" podCIDRs=["10.244.2.0/24"]

	I0429 12:50:11.474203       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-212075-m03"

	I0429 12:50:34.047890       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="132.017808ms"

	I0429 12:50:34.146964       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="98.922663ms"

	I0429 12:50:34.376985       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="229.814363ms"

	E0429 12:50:34.377038       1 replica_set.go:557] sync "default/busybox-fc5497c4f" failed with Operation cannot be fulfilled on replicasets.apps "busybox-fc5497c4f": the object has been modified; please apply your changes to the latest version and try again

	I0429 12:50:34.377201       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="55.971µs"

	I0429 12:50:34.384897       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="81.618µs"

	I0429 12:50:35.869494       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="17.517378ms"

	I0429 12:50:35.869952       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="98.254µs"

	I0429 12:50:36.030792       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="44.135927ms"

	I0429 12:50:36.030945       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="73.996µs"

	I0429 12:50:36.451336       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="20.394422ms"

	I0429 12:50:36.451462       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="60.817µs"

	I0429 12:51:12.921789       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-212075-m04\" does not exist"

	I0429 12:51:12.964704       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-212075-m04" podCIDRs=["10.244.3.0/24"]

	I0429 12:51:16.503129       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-212075-m04"

	I0429 12:51:21.706750       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-212075-m04"

	I0429 12:52:22.540869       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-212075-m04"

	I0429 12:52:22.611915       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="12.169574ms"

	I0429 12:52:22.612104       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="42.399µs"

	I0429 12:52:22.663107       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="23.847549ms"

	I0429 12:52:22.663624       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="54.292µs"

	==> kube-proxy [ae027e60b2a1eaabf421377161cd1baef302a90ef2098603aef1534cd97af30d] <==

	I0429 12:48:07.949311       1 server_linux.go:69] "Using iptables proxy"

	I0429 12:48:07.970912       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.97"]

	I0429 12:48:08.111869       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0429 12:48:08.111971       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0429 12:48:08.112000       1 server_linux.go:165] "Using iptables Proxier"

	I0429 12:48:08.119057       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0429 12:48:08.119347       1 server.go:872] "Version info" version="v1.30.0"

	I0429 12:48:08.119376       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0429 12:48:08.121414       1 config.go:192] "Starting service config controller"

	I0429 12:48:08.121424       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0429 12:48:08.121444       1 config.go:101] "Starting endpoint slice config controller"

	I0429 12:48:08.121447       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0429 12:48:08.121966       1 config.go:319] "Starting node config controller"

	I0429 12:48:08.121973       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0429 12:48:08.222195       1 shared_informer.go:320] Caches are synced for node config

	I0429 12:48:08.222222       1 shared_informer.go:320] Caches are synced for service config

	I0429 12:48:08.222241       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [220538e592762feea78576a891b3a24ffcc0f8de3708d743c54c2d703427e0cf] <==

	W0429 12:47:51.705755       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0429 12:47:51.705803       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0429 12:47:51.705952       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0429 12:47:51.705995       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0429 12:47:51.762409       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0429 12:47:51.762955       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0429 12:47:51.831035       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0429 12:47:51.831222       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	I0429 12:47:54.028994       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0429 12:50:33.990786       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-xw452\": pod busybox-fc5497c4f-xw452 is already assigned to node \"ha-212075-m03\"" plugin="DefaultBinder" pod="default/busybox-fc5497c4f-xw452" node="ha-212075-m03"

	E0429 12:50:33.992233       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod f23383ad-d9ed-46ed-9327-d850179b2822(default/busybox-fc5497c4f-xw452) wasn't assumed so cannot be forgotten" pod="default/busybox-fc5497c4f-xw452"

	E0429 12:50:33.996630       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-xw452\": pod busybox-fc5497c4f-xw452 is already assigned to node \"ha-212075-m03\"" pod="default/busybox-fc5497c4f-xw452"

	I0429 12:50:33.997434       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-fc5497c4f-xw452" node="ha-212075-m03"

	E0429 12:51:13.049010       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-d6tbw\": pod kindnet-d6tbw is already assigned to node \"ha-212075-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-d6tbw" node="ha-212075-m04"

	E0429 12:51:13.049114       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 7effb27d-adcf-42ce-9c98-d1cb8db7fd04(kube-system/kindnet-d6tbw) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-d6tbw"

	E0429 12:51:13.049139       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-d6tbw\": pod kindnet-d6tbw is already assigned to node \"ha-212075-m04\"" pod="kube-system/kindnet-d6tbw"

	I0429 12:51:13.049158       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-d6tbw" node="ha-212075-m04"

	E0429 12:51:13.049476       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-bnbr8\": pod kube-proxy-bnbr8 is already assigned to node \"ha-212075-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-bnbr8" node="ha-212075-m04"

	E0429 12:51:13.049643       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 16945b1d-2d33-4a95-b9ad-03d0665b74e8(kube-system/kube-proxy-bnbr8) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-bnbr8"

	E0429 12:51:13.049799       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-bnbr8\": pod kube-proxy-bnbr8 is already assigned to node \"ha-212075-m04\"" pod="kube-system/kube-proxy-bnbr8"

	I0429 12:51:13.049931       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-bnbr8" node="ha-212075-m04"

	E0429 12:51:13.198840       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-9qm85\": pod kindnet-9qm85 is already assigned to node \"ha-212075-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-9qm85" node="ha-212075-m04"

	E0429 12:51:13.199120       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod f060a9cf-2fcb-4ef4-8991-954beeaa1614(kube-system/kindnet-9qm85) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-9qm85"

	E0429 12:51:13.199784       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-9qm85\": pod kindnet-9qm85 is already assigned to node \"ha-212075-m04\"" pod="kube-system/kindnet-9qm85"

	I0429 12:51:13.199829       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-9qm85" node="ha-212075-m04"

	==> kubelet <==

	Apr 29 12:50:53 ha-212075 kubelet[1362]: E0429 12:50:53.153020    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:50:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:50:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:50:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:50:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:51:53 ha-212075 kubelet[1362]: E0429 12:51:53.156281    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:51:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:51:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:51:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:51:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:52:53 ha-212075 kubelet[1362]: E0429 12:52:53.152345    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:52:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:52:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:52:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:52:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:53:53 ha-212075 kubelet[1362]: E0429 12:53:53.152414    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:53:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:53:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:53:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:53:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 12:54:53 ha-212075 kubelet[1362]: E0429 12:54:53.152844    1362 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 12:54:53 ha-212075 kubelet[1362]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 12:54:53 ha-212075 kubelet[1362]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 12:54:53 ha-212075 kubelet[1362]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 12:54:53 ha-212075 kubelet[1362]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-212075 -n ha-212075

helpers_test.go:261: (dbg) Run:  kubectl --context ha-212075 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (55.44s)