=== RUN   TestAddons/Setup

addons_test.go:109: (dbg) Run:  out/minikube-linux-amd64 start -p addons-971694 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:109: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-971694 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: signal: killed (39m59.939643832s)

-- stdout --

	* [addons-971694] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=17977

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/17977-13393/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/17977-13393/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-971694" primary control-plane node in "addons-971694" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image docker.io/registry:2.8.3

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.27.0

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	  - Using image docker.io/marcnuri/yakd:0.0.4

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.15.0

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.15

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image ghcr.io/helm/tiller:v2.17.0

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image docker.io/busybox:stable

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	* Verifying registry addon...

	* Verifying ingress addon...

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-971694 service yakd-dashboard -n yakd-dashboard

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	* Verifying csi-hostpath-driver addon...

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-971694 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: ingress-dns, storage-provisioner, nvidia-device-plugin, helm-tiller, metrics-server, inspektor-gadget, cloud-spanner, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

-- /stdout --

** stderr ** 

	I0428 23:08:16.976563   21498 out.go:291] Setting OutFile to fd 1 ...

	I0428 23:08:16.976700   21498 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0428 23:08:16.976709   21498 out.go:304] Setting ErrFile to fd 2...

	I0428 23:08:16.976713   21498 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0428 23:08:16.976943   21498 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0428 23:08:16.977561   21498 out.go:298] Setting JSON to false

	I0428 23:08:16.978445   21498 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":3041,"bootTime":1714342656,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0428 23:08:16.978504   21498 start.go:139] virtualization: kvm guest

	I0428 23:08:16.980627   21498 out.go:177] * [addons-971694] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	I0428 23:08:16.982012   21498 out.go:177]   - MINIKUBE_LOCATION=17977

	I0428 23:08:16.983476   21498 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0428 23:08:16.982074   21498 notify.go:220] Checking for updates...

	I0428 23:08:16.985015   21498 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:08:16.986384   21498 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:08:16.987638   21498 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0428 23:08:16.988808   21498 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0428 23:08:16.990099   21498 driver.go:392] Setting default libvirt URI to qemu:///system

	I0428 23:08:17.021181   21498 out.go:177] * Using the kvm2 driver based on user configuration

	I0428 23:08:17.022421   21498 start.go:297] selected driver: kvm2

	I0428 23:08:17.022432   21498 start.go:901] validating driver "kvm2" against <nil>

	I0428 23:08:17.022442   21498 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0428 23:08:17.023130   21498 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0428 23:08:17.023204   21498 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17977-13393/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0428 23:08:17.037611   21498 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0

	I0428 23:08:17.037649   21498 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0428 23:08:17.037873   21498 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0428 23:08:17.037936   21498 cni.go:84] Creating CNI manager for ""

	I0428 23:08:17.037953   21498 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0428 23:08:17.037968   21498 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0428 23:08:17.038067   21498 start.go:340] cluster config:

	{Name:addons-971694 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:addons-971694 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c

rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg

entPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:08:17.038169   21498 iso.go:125] acquiring lock: {Name:mkdac29be984af97898eb097bf04b319c0b5a23b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0428 23:08:17.040001   21498 out.go:177] * Starting "addons-971694" primary control-plane node in "addons-971694" cluster

	I0428 23:08:17.041356   21498 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:08:17.041382   21498 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4

	I0428 23:08:17.041401   21498 cache.go:56] Caching tarball of preloaded images

	I0428 23:08:17.041476   21498 preload.go:173] Found /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0428 23:08:17.041499   21498 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0428 23:08:17.041804   21498 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/config.json ...

	I0428 23:08:17.041826   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/config.json: {Name:mke1f27fd604139ddac9b28ed75c38d6bfd93fb8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:17.041961   21498 start.go:360] acquireMachinesLock for addons-971694: {Name:mkf607109012ed2f4aeb283e90eb20782d746716 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0428 23:08:17.042017   21498 start.go:364] duration metric: took 40.141µs to acquireMachinesLock for "addons-971694"

	I0428 23:08:17.042056   21498 start.go:93] Provisioning new machine with config: &{Name:addons-971694 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.30.0 ClusterName:addons-971694 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:08:17.042122   21498 start.go:125] createHost starting for "" (driver="kvm2")

	I0428 23:08:17.043733   21498 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0428 23:08:17.043860   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:08:17.043904   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:08:17.057391   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41991

	I0428 23:08:17.057801   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:08:17.058339   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:08:17.058359   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:08:17.058704   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:08:17.058893   21498 main.go:141] libmachine: (addons-971694) Calling .GetMachineName

	I0428 23:08:17.059028   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:17.059175   21498 start.go:159] libmachine.API.Create for "addons-971694" (driver="kvm2")

	I0428 23:08:17.059199   21498 client.go:168] LocalClient.Create starting

	I0428 23:08:17.059233   21498 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem

	I0428 23:08:17.137592   21498 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem

	I0428 23:08:17.330122   21498 main.go:141] libmachine: Running pre-create checks...

	I0428 23:08:17.330142   21498 main.go:141] libmachine: (addons-971694) Calling .PreCreateCheck

	I0428 23:08:17.330625   21498 main.go:141] libmachine: (addons-971694) Calling .GetConfigRaw

	I0428 23:08:17.331027   21498 main.go:141] libmachine: Creating machine...

	I0428 23:08:17.331042   21498 main.go:141] libmachine: (addons-971694) Calling .Create

	I0428 23:08:17.331155   21498 main.go:141] libmachine: (addons-971694) Creating KVM machine...

	I0428 23:08:17.332282   21498 main.go:141] libmachine: (addons-971694) DBG | found existing default KVM network

	I0428 23:08:17.332971   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:17.332843   21520 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ad0}

	I0428 23:08:17.333022   21498 main.go:141] libmachine: (addons-971694) DBG | created network xml: 

	I0428 23:08:17.333042   21498 main.go:141] libmachine: (addons-971694) DBG | <network>

	I0428 23:08:17.333057   21498 main.go:141] libmachine: (addons-971694) DBG |   <name>mk-addons-971694</name>

	I0428 23:08:17.333072   21498 main.go:141] libmachine: (addons-971694) DBG |   <dns enable='no'/>

	I0428 23:08:17.333079   21498 main.go:141] libmachine: (addons-971694) DBG |   

	I0428 23:08:17.333088   21498 main.go:141] libmachine: (addons-971694) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0428 23:08:17.333096   21498 main.go:141] libmachine: (addons-971694) DBG |     <dhcp>

	I0428 23:08:17.333102   21498 main.go:141] libmachine: (addons-971694) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0428 23:08:17.333109   21498 main.go:141] libmachine: (addons-971694) DBG |     </dhcp>

	I0428 23:08:17.333114   21498 main.go:141] libmachine: (addons-971694) DBG |   </ip>

	I0428 23:08:17.333122   21498 main.go:141] libmachine: (addons-971694) DBG |   

	I0428 23:08:17.333126   21498 main.go:141] libmachine: (addons-971694) DBG | </network>

	I0428 23:08:17.333134   21498 main.go:141] libmachine: (addons-971694) DBG | 

	I0428 23:08:17.338386   21498 main.go:141] libmachine: (addons-971694) DBG | trying to create private KVM network mk-addons-971694 192.168.39.0/24...

	I0428 23:08:17.402470   21498 main.go:141] libmachine: (addons-971694) DBG | private KVM network mk-addons-971694 192.168.39.0/24 created

	I0428 23:08:17.402496   21498 main.go:141] libmachine: (addons-971694) Setting up store path in /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694 ...

	I0428 23:08:17.402516   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:17.402463   21520 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:08:17.402527   21498 main.go:141] libmachine: (addons-971694) Building disk image from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0428 23:08:17.402638   21498 main.go:141] libmachine: (addons-971694) Downloading /home/jenkins/minikube-integration/17977-13393/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0428 23:08:17.646623   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:17.646503   21520 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa...

	I0428 23:08:17.750443   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:17.750302   21520 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/addons-971694.rawdisk...

	I0428 23:08:17.750481   21498 main.go:141] libmachine: (addons-971694) DBG | Writing magic tar header

	I0428 23:08:17.750495   21498 main.go:141] libmachine: (addons-971694) DBG | Writing SSH key tar header

	I0428 23:08:17.750513   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:17.750417   21520 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694 ...

	I0428 23:08:17.750530   21498 main.go:141] libmachine: (addons-971694) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694

	I0428 23:08:17.750595   21498 main.go:141] libmachine: (addons-971694) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines

	I0428 23:08:17.750619   21498 main.go:141] libmachine: (addons-971694) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:08:17.750633   21498 main.go:141] libmachine: (addons-971694) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694 (perms=drwx------)

	I0428 23:08:17.750649   21498 main.go:141] libmachine: (addons-971694) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines (perms=drwxr-xr-x)

	I0428 23:08:17.750660   21498 main.go:141] libmachine: (addons-971694) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube (perms=drwxr-xr-x)

	I0428 23:08:17.750671   21498 main.go:141] libmachine: (addons-971694) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393 (perms=drwxrwxr-x)

	I0428 23:08:17.750678   21498 main.go:141] libmachine: (addons-971694) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0428 23:08:17.750685   21498 main.go:141] libmachine: (addons-971694) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0428 23:08:17.750693   21498 main.go:141] libmachine: (addons-971694) Creating domain...

	I0428 23:08:17.750708   21498 main.go:141] libmachine: (addons-971694) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393

	I0428 23:08:17.750723   21498 main.go:141] libmachine: (addons-971694) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0428 23:08:17.750732   21498 main.go:141] libmachine: (addons-971694) DBG | Checking permissions on dir: /home/jenkins

	I0428 23:08:17.750746   21498 main.go:141] libmachine: (addons-971694) DBG | Checking permissions on dir: /home

	I0428 23:08:17.750758   21498 main.go:141] libmachine: (addons-971694) DBG | Skipping /home - not owner

	I0428 23:08:17.751681   21498 main.go:141] libmachine: (addons-971694) define libvirt domain using xml: 

	I0428 23:08:17.751710   21498 main.go:141] libmachine: (addons-971694) <domain type='kvm'>

	I0428 23:08:17.751725   21498 main.go:141] libmachine: (addons-971694)   <name>addons-971694</name>

	I0428 23:08:17.751740   21498 main.go:141] libmachine: (addons-971694)   <memory unit='MiB'>4000</memory>

	I0428 23:08:17.751749   21498 main.go:141] libmachine: (addons-971694)   <vcpu>2</vcpu>

	I0428 23:08:17.751758   21498 main.go:141] libmachine: (addons-971694)   <features>

	I0428 23:08:17.751766   21498 main.go:141] libmachine: (addons-971694)     <acpi/>

	I0428 23:08:17.751780   21498 main.go:141] libmachine: (addons-971694)     <apic/>

	I0428 23:08:17.751785   21498 main.go:141] libmachine: (addons-971694)     <pae/>

	I0428 23:08:17.751789   21498 main.go:141] libmachine: (addons-971694)     

	I0428 23:08:17.751797   21498 main.go:141] libmachine: (addons-971694)   </features>

	I0428 23:08:17.751802   21498 main.go:141] libmachine: (addons-971694)   <cpu mode='host-passthrough'>

	I0428 23:08:17.751806   21498 main.go:141] libmachine: (addons-971694)   

	I0428 23:08:17.751848   21498 main.go:141] libmachine: (addons-971694)   </cpu>

	I0428 23:08:17.751857   21498 main.go:141] libmachine: (addons-971694)   <os>

	I0428 23:08:17.751862   21498 main.go:141] libmachine: (addons-971694)     <type>hvm</type>

	I0428 23:08:17.751867   21498 main.go:141] libmachine: (addons-971694)     <boot dev='cdrom'/>

	I0428 23:08:17.751873   21498 main.go:141] libmachine: (addons-971694)     <boot dev='hd'/>

	I0428 23:08:17.751900   21498 main.go:141] libmachine: (addons-971694)     <bootmenu enable='no'/>

	I0428 23:08:17.751920   21498 main.go:141] libmachine: (addons-971694)   </os>

	I0428 23:08:17.751931   21498 main.go:141] libmachine: (addons-971694)   <devices>

	I0428 23:08:17.751943   21498 main.go:141] libmachine: (addons-971694)     <disk type='file' device='cdrom'>

	I0428 23:08:17.751958   21498 main.go:141] libmachine: (addons-971694)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/boot2docker.iso'/>

	I0428 23:08:17.751969   21498 main.go:141] libmachine: (addons-971694)       <target dev='hdc' bus='scsi'/>

	I0428 23:08:17.751979   21498 main.go:141] libmachine: (addons-971694)       <readonly/>

	I0428 23:08:17.751987   21498 main.go:141] libmachine: (addons-971694)     </disk>

	I0428 23:08:17.752001   21498 main.go:141] libmachine: (addons-971694)     <disk type='file' device='disk'>

	I0428 23:08:17.752017   21498 main.go:141] libmachine: (addons-971694)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0428 23:08:17.752029   21498 main.go:141] libmachine: (addons-971694)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/addons-971694.rawdisk'/>

	I0428 23:08:17.752036   21498 main.go:141] libmachine: (addons-971694)       <target dev='hda' bus='virtio'/>

	I0428 23:08:17.752042   21498 main.go:141] libmachine: (addons-971694)     </disk>

	I0428 23:08:17.752049   21498 main.go:141] libmachine: (addons-971694)     <interface type='network'>

	I0428 23:08:17.752056   21498 main.go:141] libmachine: (addons-971694)       <source network='mk-addons-971694'/>

	I0428 23:08:17.752063   21498 main.go:141] libmachine: (addons-971694)       <model type='virtio'/>

	I0428 23:08:17.752068   21498 main.go:141] libmachine: (addons-971694)     </interface>

	I0428 23:08:17.752075   21498 main.go:141] libmachine: (addons-971694)     <interface type='network'>

	I0428 23:08:17.752092   21498 main.go:141] libmachine: (addons-971694)       <source network='default'/>

	I0428 23:08:17.752102   21498 main.go:141] libmachine: (addons-971694)       <model type='virtio'/>

	I0428 23:08:17.752110   21498 main.go:141] libmachine: (addons-971694)     </interface>

	I0428 23:08:17.752117   21498 main.go:141] libmachine: (addons-971694)     <serial type='pty'>

	I0428 23:08:17.752123   21498 main.go:141] libmachine: (addons-971694)       <target port='0'/>

	I0428 23:08:17.752129   21498 main.go:141] libmachine: (addons-971694)     </serial>

	I0428 23:08:17.752135   21498 main.go:141] libmachine: (addons-971694)     <console type='pty'>

	I0428 23:08:17.752144   21498 main.go:141] libmachine: (addons-971694)       <target type='serial' port='0'/>

	I0428 23:08:17.752152   21498 main.go:141] libmachine: (addons-971694)     </console>

	I0428 23:08:17.752156   21498 main.go:141] libmachine: (addons-971694)     <rng model='virtio'>

	I0428 23:08:17.752165   21498 main.go:141] libmachine: (addons-971694)       <backend model='random'>/dev/random</backend>

	I0428 23:08:17.752172   21498 main.go:141] libmachine: (addons-971694)     </rng>

	I0428 23:08:17.752177   21498 main.go:141] libmachine: (addons-971694)     

	I0428 23:08:17.752183   21498 main.go:141] libmachine: (addons-971694)     

	I0428 23:08:17.752188   21498 main.go:141] libmachine: (addons-971694)   </devices>

	I0428 23:08:17.752194   21498 main.go:141] libmachine: (addons-971694) </domain>

	I0428 23:08:17.752200   21498 main.go:141] libmachine: (addons-971694) 

	I0428 23:08:17.757491   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:04:09:2c in network default

	I0428 23:08:17.757997   21498 main.go:141] libmachine: (addons-971694) Ensuring networks are active...

	I0428 23:08:17.758013   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:17.758537   21498 main.go:141] libmachine: (addons-971694) Ensuring network default is active

	I0428 23:08:17.758786   21498 main.go:141] libmachine: (addons-971694) Ensuring network mk-addons-971694 is active

	I0428 23:08:17.759683   21498 main.go:141] libmachine: (addons-971694) Getting domain xml...

	I0428 23:08:17.760216   21498 main.go:141] libmachine: (addons-971694) Creating domain...

	I0428 23:08:19.108179   21498 main.go:141] libmachine: (addons-971694) Waiting to get IP...

	I0428 23:08:19.109008   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:19.109390   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:19.109437   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:19.109366   21520 retry.go:31] will retry after 296.607439ms: waiting for machine to come up

	I0428 23:08:19.407935   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:19.408323   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:19.408355   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:19.408290   21520 retry.go:31] will retry after 289.016818ms: waiting for machine to come up

	I0428 23:08:19.698715   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:19.699021   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:19.699069   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:19.699000   21520 retry.go:31] will retry after 373.291407ms: waiting for machine to come up

	I0428 23:08:20.073473   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:20.073905   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:20.073939   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:20.073858   21520 retry.go:31] will retry after 384.322825ms: waiting for machine to come up

	I0428 23:08:20.460092   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:20.460527   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:20.460555   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:20.460478   21520 retry.go:31] will retry after 569.0562ms: waiting for machine to come up

	I0428 23:08:21.031105   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:21.031446   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:21.031482   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:21.031394   21520 retry.go:31] will retry after 596.381126ms: waiting for machine to come up

	I0428 23:08:21.629143   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:21.629543   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:21.629574   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:21.629503   21520 retry.go:31] will retry after 1.014220514s: waiting for machine to come up

	I0428 23:08:22.645139   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:22.645547   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:22.645575   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:22.645502   21520 retry.go:31] will retry after 1.161580533s: waiting for machine to come up

	I0428 23:08:23.808778   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:23.809207   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:23.809233   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:23.809153   21520 retry.go:31] will retry after 1.150388059s: waiting for machine to come up

	I0428 23:08:24.961492   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:24.961875   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:24.961906   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:24.961835   21520 retry.go:31] will retry after 1.900313091s: waiting for machine to come up

	I0428 23:08:26.863298   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:26.863743   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:26.863769   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:26.863698   21520 retry.go:31] will retry after 2.33130277s: waiting for machine to come up

	I0428 23:08:29.198011   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:29.198420   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:29.198443   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:29.198383   21520 retry.go:31] will retry after 3.190930952s: waiting for machine to come up

	I0428 23:08:32.391272   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:32.391686   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:32.391717   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:32.391646   21520 retry.go:31] will retry after 3.170538093s: waiting for machine to come up

	I0428 23:08:35.567192   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:35.567716   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find current IP address of domain addons-971694 in network mk-addons-971694

	I0428 23:08:35.567740   21498 main.go:141] libmachine: (addons-971694) DBG | I0428 23:08:35.567680   21520 retry.go:31] will retry after 5.405183393s: waiting for machine to come up

	I0428 23:08:40.977330   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:40.977710   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has current primary IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:40.977723   21498 main.go:141] libmachine: (addons-971694) Found IP for machine: 192.168.39.130

	I0428 23:08:40.977733   21498 main.go:141] libmachine: (addons-971694) Reserving static IP address...

	I0428 23:08:40.978065   21498 main.go:141] libmachine: (addons-971694) DBG | unable to find host DHCP lease matching {name: "addons-971694", mac: "52:54:00:36:e2:9e", ip: "192.168.39.130"} in network mk-addons-971694

	I0428 23:08:41.049954   21498 main.go:141] libmachine: (addons-971694) Reserved static IP address: 192.168.39.130

	I0428 23:08:41.049984   21498 main.go:141] libmachine: (addons-971694) Waiting for SSH to be available...

	I0428 23:08:41.049993   21498 main.go:141] libmachine: (addons-971694) DBG | Getting to WaitForSSH function...

	I0428 23:08:41.053057   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.053410   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:minikube Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.053440   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.053590   21498 main.go:141] libmachine: (addons-971694) DBG | Using SSH client type: external

	I0428 23:08:41.053628   21498 main.go:141] libmachine: (addons-971694) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa (-rw-------)

	I0428 23:08:41.053666   21498 main.go:141] libmachine: (addons-971694) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.130 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:08:41.053693   21498 main.go:141] libmachine: (addons-971694) DBG | About to run SSH command:

	I0428 23:08:41.053704   21498 main.go:141] libmachine: (addons-971694) DBG | exit 0

	I0428 23:08:41.190365   21498 main.go:141] libmachine: (addons-971694) DBG | SSH cmd err, output: <nil>: 

	I0428 23:08:41.190655   21498 main.go:141] libmachine: (addons-971694) KVM machine creation complete!

	I0428 23:08:41.191046   21498 main.go:141] libmachine: (addons-971694) Calling .GetConfigRaw

	I0428 23:08:41.191588   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:41.191786   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:41.191908   21498 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0428 23:08:41.191920   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:08:41.193115   21498 main.go:141] libmachine: Detecting operating system of created instance...

	I0428 23:08:41.193134   21498 main.go:141] libmachine: Waiting for SSH to be available...

	I0428 23:08:41.193142   21498 main.go:141] libmachine: Getting to WaitForSSH function...

	I0428 23:08:41.193152   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:41.195240   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.195626   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.195657   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.195702   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:41.195889   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.196023   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.196119   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:41.196264   21498 main.go:141] libmachine: Using SSH client type: native

	I0428 23:08:41.196451   21498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.130 22 <nil> <nil>}

	I0428 23:08:41.196463   21498 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0428 23:08:41.309592   21498 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:08:41.309612   21498 main.go:141] libmachine: Detecting the provisioner...

	I0428 23:08:41.309620   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:41.312247   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.312641   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.312670   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.312800   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:41.313019   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.313194   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.313316   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:41.313446   21498 main.go:141] libmachine: Using SSH client type: native

	I0428 23:08:41.313634   21498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.130 22 <nil> <nil>}

	I0428 23:08:41.313648   21498 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0428 23:08:41.427303   21498 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0428 23:08:41.427380   21498 main.go:141] libmachine: found compatible host: buildroot

	I0428 23:08:41.427395   21498 main.go:141] libmachine: Provisioning with buildroot...

	I0428 23:08:41.427410   21498 main.go:141] libmachine: (addons-971694) Calling .GetMachineName

	I0428 23:08:41.427674   21498 buildroot.go:166] provisioning hostname "addons-971694"

	I0428 23:08:41.427703   21498 main.go:141] libmachine: (addons-971694) Calling .GetMachineName

	I0428 23:08:41.427898   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:41.430307   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.430654   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.430676   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.430819   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:41.430978   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.431124   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.431243   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:41.431380   21498 main.go:141] libmachine: Using SSH client type: native

	I0428 23:08:41.431554   21498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.130 22 <nil> <nil>}

	I0428 23:08:41.431565   21498 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-971694 && echo "addons-971694" | sudo tee /etc/hostname

	I0428 23:08:41.557524   21498 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-971694

	I0428 23:08:41.557551   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:41.560062   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.560396   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.560442   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.560646   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:41.560831   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.561000   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.561129   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:41.561276   21498 main.go:141] libmachine: Using SSH client type: native

	I0428 23:08:41.561471   21498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.130 22 <nil> <nil>}

	I0428 23:08:41.561489   21498 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-971694' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-971694/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-971694' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0428 23:08:41.680226   21498 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:08:41.680269   21498 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17977-13393/.minikube CaCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17977-13393/.minikube}

	I0428 23:08:41.680301   21498 buildroot.go:174] setting up certificates

	I0428 23:08:41.680311   21498 provision.go:84] configureAuth start

	I0428 23:08:41.680327   21498 main.go:141] libmachine: (addons-971694) Calling .GetMachineName

	I0428 23:08:41.680581   21498 main.go:141] libmachine: (addons-971694) Calling .GetIP

	I0428 23:08:41.682925   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.683264   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.683323   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.683469   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:41.685268   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.685552   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.685573   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.685698   21498 provision.go:143] copyHostCerts

	I0428 23:08:41.685765   21498 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem (1123 bytes)

	I0428 23:08:41.685908   21498 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem (1675 bytes)

	I0428 23:08:41.685991   21498 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem (1082 bytes)

	I0428 23:08:41.686121   21498 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem org=jenkins.addons-971694 san=[127.0.0.1 192.168.39.130 addons-971694 localhost minikube]

	I0428 23:08:41.958013   21498 provision.go:177] copyRemoteCerts

	I0428 23:08:41.958116   21498 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0428 23:08:41.958139   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:41.960776   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.961101   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:41.961130   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:41.961263   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:41.961457   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:41.961595   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:41.961730   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:08:42.049088   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0428 23:08:42.075955   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0428 23:08:42.101902   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0428 23:08:42.128548   21498 provision.go:87] duration metric: took 448.22678ms to configureAuth

	I0428 23:08:42.128578   21498 buildroot.go:189] setting minikube options for container-runtime

	I0428 23:08:42.128728   21498 config.go:182] Loaded profile config "addons-971694": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:08:42.128793   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:42.131214   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.131530   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.131560   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.131688   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:42.131869   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:42.132004   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:42.132131   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:42.132266   21498 main.go:141] libmachine: Using SSH client type: native

	I0428 23:08:42.132477   21498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.130 22 <nil> <nil>}

	I0428 23:08:42.132509   21498 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0428 23:08:42.430581   21498 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0428 23:08:42.430610   21498 main.go:141] libmachine: Checking connection to Docker...

	I0428 23:08:42.430619   21498 main.go:141] libmachine: (addons-971694) Calling .GetURL

	I0428 23:08:42.431957   21498 main.go:141] libmachine: (addons-971694) DBG | Using libvirt version 6000000

	I0428 23:08:42.434159   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.434518   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.434545   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.434715   21498 main.go:141] libmachine: Docker is up and running!

	I0428 23:08:42.434730   21498 main.go:141] libmachine: Reticulating splines...

	I0428 23:08:42.434737   21498 client.go:171] duration metric: took 25.375529995s to LocalClient.Create

	I0428 23:08:42.434760   21498 start.go:167] duration metric: took 25.375585054s to libmachine.API.Create "addons-971694"

	I0428 23:08:42.434773   21498 start.go:293] postStartSetup for "addons-971694" (driver="kvm2")

	I0428 23:08:42.434785   21498 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0428 23:08:42.434805   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:42.435041   21498 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0428 23:08:42.435058   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:42.436868   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.437188   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.437220   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.437342   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:42.437523   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:42.437683   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:42.437803   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:08:42.524927   21498 ssh_runner.go:195] Run: cat /etc/os-release

	I0428 23:08:42.529585   21498 info.go:137] Remote host: Buildroot 2023.02.9

	I0428 23:08:42.529607   21498 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/addons for local assets ...

	I0428 23:08:42.529677   21498 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/files for local assets ...

	I0428 23:08:42.529702   21498 start.go:296] duration metric: took 94.923154ms for postStartSetup

	I0428 23:08:42.529730   21498 main.go:141] libmachine: (addons-971694) Calling .GetConfigRaw

	I0428 23:08:42.530344   21498 main.go:141] libmachine: (addons-971694) Calling .GetIP

	I0428 23:08:42.533325   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.533663   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.533685   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.533941   21498 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/config.json ...

	I0428 23:08:42.534168   21498 start.go:128] duration metric: took 25.492033555s to createHost

	I0428 23:08:42.534190   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:42.536182   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.536472   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.536504   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.536602   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:42.536731   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:42.536819   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:42.536947   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:42.537179   21498 main.go:141] libmachine: Using SSH client type: native

	I0428 23:08:42.537339   21498 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.130 22 <nil> <nil>}

	I0428 23:08:42.537354   21498 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0428 23:08:42.647392   21498 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714345722.617957899

	I0428 23:08:42.647423   21498 fix.go:216] guest clock: 1714345722.617957899

	I0428 23:08:42.647431   21498 fix.go:229] Guest: 2024-04-28 23:08:42.617957899 +0000 UTC Remote: 2024-04-28 23:08:42.5341808 +0000 UTC m=+25.604341703 (delta=83.777099ms)

	I0428 23:08:42.647451   21498 fix.go:200] guest clock delta is within tolerance: 83.777099ms

	I0428 23:08:42.647456   21498 start.go:83] releasing machines lock for "addons-971694", held for 25.605412391s

	I0428 23:08:42.647473   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:42.647736   21498 main.go:141] libmachine: (addons-971694) Calling .GetIP

	I0428 23:08:42.650247   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.650552   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.650583   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.650683   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:42.651173   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:42.651342   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:08:42.651433   21498 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0428 23:08:42.651472   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:42.651554   21498 ssh_runner.go:195] Run: cat /version.json

	I0428 23:08:42.651578   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:08:42.654080   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.654244   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.654463   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.654490   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.654614   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:42.654626   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:42.654638   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:42.654810   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:08:42.654845   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:42.654952   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:08:42.654963   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:42.655112   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:08:42.655129   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:08:42.655262   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:08:42.744477   21498 ssh_runner.go:195] Run: systemctl --version

	I0428 23:08:42.770091   21498 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0428 23:08:42.938684   21498 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0428 23:08:42.945217   21498 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0428 23:08:42.945284   21498 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0428 23:08:42.964445   21498 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0428 23:08:42.964470   21498 start.go:494] detecting cgroup driver to use...

	I0428 23:08:42.964537   21498 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0428 23:08:42.983771   21498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0428 23:08:42.999341   21498 docker.go:217] disabling cri-docker service (if available) ...

	I0428 23:08:42.999398   21498 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0428 23:08:43.014464   21498 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0428 23:08:43.029731   21498 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0428 23:08:43.158805   21498 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0428 23:08:43.310416   21498 docker.go:233] disabling docker service ...

	I0428 23:08:43.310474   21498 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0428 23:08:43.327376   21498 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0428 23:08:43.340498   21498 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0428 23:08:43.482174   21498 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0428 23:08:43.610477   21498 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0428 23:08:43.625951   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0428 23:08:43.645779   21498 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0428 23:08:43.645847   21498 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:08:43.656544   21498 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0428 23:08:43.656614   21498 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:08:43.667446   21498 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:08:43.677846   21498 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:08:43.688395   21498 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0428 23:08:43.699426   21498 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:08:43.710582   21498 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:08:43.730801   21498 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:08:43.742410   21498 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0428 23:08:43.752491   21498 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0428 23:08:43.752552   21498 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0428 23:08:43.765744   21498 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0428 23:08:43.776695   21498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:08:43.888008   21498 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0428 23:08:44.031968   21498 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0428 23:08:44.032046   21498 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0428 23:08:44.037590   21498 start.go:562] Will wait 60s for crictl version

	I0428 23:08:44.037654   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:08:44.041795   21498 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0428 23:08:44.081786   21498 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0428 23:08:44.081912   21498 ssh_runner.go:195] Run: crio --version

	I0428 23:08:44.111087   21498 ssh_runner.go:195] Run: crio --version

	I0428 23:08:44.142943   21498 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0428 23:08:44.144168   21498 main.go:141] libmachine: (addons-971694) Calling .GetIP

	I0428 23:08:44.146661   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:44.146947   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:08:44.146968   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:08:44.147095   21498 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0428 23:08:44.151778   21498 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:08:44.165553   21498 kubeadm.go:877] updating cluster {Name:addons-971694 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.

0 ClusterName:addons-971694 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.130 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT

ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0428 23:08:44.165693   21498 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:08:44.165740   21498 ssh_runner.go:195] Run: sudo crictl images --output json

	I0428 23:08:44.202496   21498 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0". assuming images are not preloaded.

	I0428 23:08:44.202554   21498 ssh_runner.go:195] Run: which lz4

	I0428 23:08:44.206959   21498 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0428 23:08:44.211561   21498 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0428 23:08:44.211584   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394544937 bytes)

	I0428 23:08:45.731333   21498 crio.go:462] duration metric: took 1.524409656s to copy over tarball

	I0428 23:08:45.731403   21498 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0428 23:08:48.303013   21498 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.571581629s)

	I0428 23:08:48.303045   21498 crio.go:469] duration metric: took 2.571681573s to extract the tarball

	I0428 23:08:48.303055   21498 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0428 23:08:48.342083   21498 ssh_runner.go:195] Run: sudo crictl images --output json

	I0428 23:08:48.386346   21498 crio.go:514] all images are preloaded for cri-o runtime.

	I0428 23:08:48.386366   21498 cache_images.go:84] Images are preloaded, skipping loading

	I0428 23:08:48.386372   21498 kubeadm.go:928] updating node { 192.168.39.130 8443 v1.30.0 crio true true} ...

	I0428 23:08:48.386478   21498 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-971694 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.130

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:addons-971694 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0428 23:08:48.386548   21498 ssh_runner.go:195] Run: crio config

	I0428 23:08:48.438259   21498 cni.go:84] Creating CNI manager for ""

	I0428 23:08:48.438281   21498 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0428 23:08:48.438290   21498 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0428 23:08:48.438310   21498 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.130 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-971694 NodeName:addons-971694 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.130"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.130 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k

ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0428 23:08:48.438453   21498 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.130

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-971694"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.130

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.130"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0428 23:08:48.438511   21498 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0428 23:08:48.449879   21498 binaries.go:44] Found k8s binaries, skipping transfer

	I0428 23:08:48.449936   21498 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0428 23:08:48.461415   21498 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0428 23:08:48.480329   21498 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0428 23:08:48.499428   21498 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2157 bytes)

	I0428 23:08:48.519240   21498 ssh_runner.go:195] Run: grep 192.168.39.130	control-plane.minikube.internal$ /etc/hosts

	I0428 23:08:48.523708   21498 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.130	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:08:48.538253   21498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:08:48.679990   21498 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:08:48.700459   21498 certs.go:68] Setting up /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694 for IP: 192.168.39.130

	I0428 23:08:48.700485   21498 certs.go:194] generating shared ca certs ...

	I0428 23:08:48.700500   21498 certs.go:226] acquiring lock for ca certs: {Name:mka5d31eea282c20e045cfb5e09273edc965e467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:48.700640   21498 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key

	I0428 23:08:48.875637   21498 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt ...

	I0428 23:08:48.875667   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt: {Name:mk839b8fe24e02c34606db9edb3e7a7b41d28fae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:48.875851   21498 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key ...

	I0428 23:08:48.875870   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key: {Name:mkea4c916ad6e3d3d484faa3215506e2d36bc456 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:48.875969   21498 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key

	I0428 23:08:49.032252   21498 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt ...

	I0428 23:08:49.032281   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt: {Name:mkd72e8423bc6299e083afcfd0469f070ea710b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.032496   21498 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key ...

	I0428 23:08:49.032511   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key: {Name:mkd02fa31dbad2aa3a268c124ed3067569bf4339 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.032605   21498 certs.go:256] generating profile certs ...

	I0428 23:08:49.032691   21498 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/client.key

	I0428 23:08:49.032706   21498 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/client.crt with IP's: []

	I0428 23:08:49.275382   21498 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/client.crt ...

	I0428 23:08:49.275413   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/client.crt: {Name:mkfd58add8fd14fd1eaf69671271e66bfaabde29 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.275599   21498 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/client.key ...

	I0428 23:08:49.275615   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/client.key: {Name:mk7f1338e594e5a03a86d6cbeac0487b696676a8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.275724   21498 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.key.68304783

	I0428 23:08:49.275755   21498 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.crt.68304783 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.130]

	I0428 23:08:49.506926   21498 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.crt.68304783 ...

	I0428 23:08:49.506955   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.crt.68304783: {Name:mk84a831543c7b6a9391a9ffe6bc9672036afcd7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.507154   21498 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.key.68304783 ...

	I0428 23:08:49.507177   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.key.68304783: {Name:mk5fa55b9da04d8d8af20df80deb112b22809cf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.507285   21498 certs.go:381] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.crt.68304783 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.crt

	I0428 23:08:49.507394   21498 certs.go:385] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.key.68304783 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.key

	I0428 23:08:49.507468   21498 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.key

	I0428 23:08:49.507491   21498 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.crt with IP's: []

	I0428 23:08:49.631135   21498 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.crt ...

	I0428 23:08:49.631163   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.crt: {Name:mkd4093da5cde66c2cffe2cdfb7dafbff13ed404 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.631333   21498 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.key ...

	I0428 23:08:49.631350   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.key: {Name:mk7b3f5adc451a17542163a14c96ee48ebe95d8c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:08:49.631561   21498 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem (1675 bytes)

	I0428 23:08:49.631602   21498 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem (1082 bytes)

	I0428 23:08:49.631637   21498 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem (1123 bytes)

	I0428 23:08:49.631675   21498 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem (1675 bytes)

	I0428 23:08:49.632298   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0428 23:08:49.663795   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0428 23:08:49.694272   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0428 23:08:49.724533   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0428 23:08:49.751954   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0428 23:08:49.780901   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0428 23:08:49.809784   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0428 23:08:49.838392   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/addons-971694/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0428 23:08:49.865120   21498 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0428 23:08:49.891954   21498 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0428 23:08:49.911453   21498 ssh_runner.go:195] Run: openssl version

	I0428 23:08:49.917930   21498 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0428 23:08:49.931470   21498 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:08:49.936717   21498 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 28 23:08 /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:08:49.936778   21498 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:08:49.943359   21498 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0428 23:08:49.956735   21498 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0428 23:08:49.961565   21498 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0428 23:08:49.961617   21498 kubeadm.go:391] StartCluster: {Name:addons-971694 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 C

lusterName:addons-971694 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.130 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType

:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:08:49.961693   21498 cri.go:56] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0428 23:08:49.961757   21498 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0428 23:08:50.002126   21498 cri.go:91] found id: ""

	I0428 23:08:50.002198   21498 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0428 23:08:50.014353   21498 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0428 23:08:50.026933   21498 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0428 23:08:50.038880   21498 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0428 23:08:50.038900   21498 kubeadm.go:156] found existing configuration files:

	I0428 23:08:50.038953   21498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0428 23:08:50.050088   21498 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0428 23:08:50.050166   21498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0428 23:08:50.061769   21498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0428 23:08:50.074822   21498 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0428 23:08:50.074892   21498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0428 23:08:50.085608   21498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0428 23:08:50.097946   21498 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0428 23:08:50.098013   21498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0428 23:08:50.108145   21498 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0428 23:08:50.118064   21498 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0428 23:08:50.118132   21498 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0428 23:08:50.128295   21498 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0428 23:08:50.324623   21498 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0428 23:09:01.055970   21498 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0

	I0428 23:09:01.056046   21498 kubeadm.go:309] [preflight] Running pre-flight checks

	I0428 23:09:01.056148   21498 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0428 23:09:01.056263   21498 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0428 23:09:01.056395   21498 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0428 23:09:01.056476   21498 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0428 23:09:01.058438   21498 out.go:204]   - Generating certificates and keys ...

	I0428 23:09:01.058504   21498 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0428 23:09:01.058592   21498 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0428 23:09:01.058700   21498 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0428 23:09:01.058784   21498 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0428 23:09:01.058876   21498 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0428 23:09:01.058951   21498 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0428 23:09:01.059034   21498 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0428 23:09:01.059146   21498 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [addons-971694 localhost] and IPs [192.168.39.130 127.0.0.1 ::1]

	I0428 23:09:01.059196   21498 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0428 23:09:01.059328   21498 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [addons-971694 localhost] and IPs [192.168.39.130 127.0.0.1 ::1]

	I0428 23:09:01.059406   21498 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0428 23:09:01.059492   21498 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0428 23:09:01.059550   21498 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0428 23:09:01.059598   21498 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0428 23:09:01.059652   21498 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0428 23:09:01.059711   21498 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0428 23:09:01.059766   21498 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0428 23:09:01.059830   21498 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0428 23:09:01.059902   21498 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0428 23:09:01.059971   21498 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0428 23:09:01.060032   21498 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0428 23:09:01.061722   21498 out.go:204]   - Booting up control plane ...

	I0428 23:09:01.061820   21498 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0428 23:09:01.061890   21498 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0428 23:09:01.061947   21498 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0428 23:09:01.062079   21498 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0428 23:09:01.062170   21498 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0428 23:09:01.062229   21498 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0428 23:09:01.062380   21498 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0428 23:09:01.062477   21498 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0428 23:09:01.062536   21498 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.001168013s

	I0428 23:09:01.062598   21498 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0428 23:09:01.062647   21498 kubeadm.go:309] [api-check] The API server is healthy after 5.001898028s

	I0428 23:09:01.062741   21498 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0428 23:09:01.062859   21498 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0428 23:09:01.062915   21498 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0428 23:09:01.063089   21498 kubeadm.go:309] [mark-control-plane] Marking the node addons-971694 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0428 23:09:01.063159   21498 kubeadm.go:309] [bootstrap-token] Using token: xr6z4d.yarjymvs908hmll3

	I0428 23:09:01.065679   21498 out.go:204]   - Configuring RBAC rules ...

	I0428 23:09:01.065789   21498 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0428 23:09:01.065894   21498 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0428 23:09:01.066088   21498 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0428 23:09:01.066246   21498 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0428 23:09:01.066390   21498 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0428 23:09:01.066491   21498 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0428 23:09:01.066649   21498 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0428 23:09:01.066811   21498 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0428 23:09:01.066864   21498 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0428 23:09:01.066871   21498 kubeadm.go:309] 

	I0428 23:09:01.066934   21498 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0428 23:09:01.066948   21498 kubeadm.go:309] 

	I0428 23:09:01.067015   21498 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0428 23:09:01.067022   21498 kubeadm.go:309] 

	I0428 23:09:01.067074   21498 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0428 23:09:01.067129   21498 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0428 23:09:01.067184   21498 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0428 23:09:01.067191   21498 kubeadm.go:309] 

	I0428 23:09:01.067275   21498 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0428 23:09:01.067286   21498 kubeadm.go:309] 

	I0428 23:09:01.067342   21498 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0428 23:09:01.067354   21498 kubeadm.go:309] 

	I0428 23:09:01.067396   21498 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0428 23:09:01.067461   21498 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0428 23:09:01.067520   21498 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0428 23:09:01.067533   21498 kubeadm.go:309] 

	I0428 23:09:01.067611   21498 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0428 23:09:01.067690   21498 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0428 23:09:01.067716   21498 kubeadm.go:309] 

	I0428 23:09:01.067817   21498 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token xr6z4d.yarjymvs908hmll3 \

	I0428 23:09:01.067961   21498 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 \

	I0428 23:09:01.068000   21498 kubeadm.go:309] 	--control-plane 

	I0428 23:09:01.068009   21498 kubeadm.go:309] 

	I0428 23:09:01.068094   21498 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0428 23:09:01.068102   21498 kubeadm.go:309] 

	I0428 23:09:01.068185   21498 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token xr6z4d.yarjymvs908hmll3 \

	I0428 23:09:01.068337   21498 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 

	I0428 23:09:01.068356   21498 cni.go:84] Creating CNI manager for ""

	I0428 23:09:01.068365   21498 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0428 23:09:01.070929   21498 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0428 23:09:01.072198   21498 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0428 23:09:01.085215   21498 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0428 23:09:01.105183   21498 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0428 23:09:01.105318   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:01.105336   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-971694 minikube.k8s.io/updated_at=2024_04_28T23_09_01_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328 minikube.k8s.io/name=addons-971694 minikube.k8s.io/primary=true

	I0428 23:09:01.141482   21498 ops.go:34] apiserver oom_adj: -16

	I0428 23:09:01.271070   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:01.771860   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:02.271672   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:02.771313   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:03.271951   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:03.771514   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:04.271117   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:04.771094   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:05.271221   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:05.771845   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:06.271395   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:06.771705   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:07.271581   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:07.771917   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:08.271276   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:08.771461   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:09.272106   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:09.771607   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:10.271932   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:10.771954   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:11.271554   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:11.771910   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:12.271195   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:12.771778   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:13.271144   21498 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:09:13.355556   21498 kubeadm.go:1107] duration metric: took 12.250308213s to wait for elevateKubeSystemPrivileges

	W0428 23:09:13.355594   21498 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0428 23:09:13.355604   21498 kubeadm.go:393] duration metric: took 23.393991559s to StartCluster

	I0428 23:09:13.355624   21498 settings.go:142] acquiring lock: {Name:mk4e6965347be51f4cd501030baea6b9cd2dbc9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:09:13.355770   21498 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:09:13.356324   21498 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/kubeconfig: {Name:mk5412a370a0ddec304ff7697d6d137221e96742 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:09:13.356541   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0428 23:09:13.356555   21498 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]

	I0428 23:09:13.356631   21498 addons.go:69] Setting yakd=true in profile "addons-971694"

	I0428 23:09:13.356536   21498 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.130 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:09:13.356666   21498 addons.go:234] Setting addon yakd=true in "addons-971694"

	I0428 23:09:13.359886   21498 out.go:177] * Verifying Kubernetes components...

	I0428 23:09:13.356678   21498 addons.go:69] Setting registry=true in profile "addons-971694"

	I0428 23:09:13.359939   21498 addons.go:234] Setting addon registry=true in "addons-971694"

	I0428 23:09:13.359976   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.356677   21498 addons.go:69] Setting ingress-dns=true in profile "addons-971694"

	I0428 23:09:13.360081   21498 addons.go:234] Setting addon ingress-dns=true in "addons-971694"

	I0428 23:09:13.356690   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.360146   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.356689   21498 addons.go:69] Setting inspektor-gadget=true in profile "addons-971694"

	I0428 23:09:13.360258   21498 addons.go:234] Setting addon inspektor-gadget=true in "addons-971694"

	I0428 23:09:13.356699   21498 addons.go:69] Setting storage-provisioner=true in profile "addons-971694"

	I0428 23:09:13.356698   21498 addons.go:69] Setting gcp-auth=true in profile "addons-971694"

	I0428 23:09:13.356703   21498 addons.go:69] Setting metrics-server=true in profile "addons-971694"

	I0428 23:09:13.356705   21498 addons.go:69] Setting helm-tiller=true in profile "addons-971694"

	I0428 23:09:13.356709   21498 addons.go:69] Setting ingress=true in profile "addons-971694"

	I0428 23:09:13.356712   21498 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-971694"

	I0428 23:09:13.356715   21498 addons.go:69] Setting cloud-spanner=true in profile "addons-971694"

	I0428 23:09:13.356713   21498 config.go:182] Loaded profile config "addons-971694": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:09:13.356721   21498 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-971694"

	I0428 23:09:13.356723   21498 addons.go:69] Setting volumesnapshots=true in profile "addons-971694"

	I0428 23:09:13.356731   21498 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-971694"

	I0428 23:09:13.356737   21498 addons.go:69] Setting default-storageclass=true in profile "addons-971694"

	I0428 23:09:13.361857   21498 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:09:13.360324   21498 addons.go:234] Setting addon metrics-server=true in "addons-971694"

	I0428 23:09:13.361963   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.360354   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.360376   21498 addons.go:234] Setting addon ingress=true in "addons-971694"

	I0428 23:09:13.362180   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.360383   21498 addons.go:234] Setting addon storage-provisioner=true in "addons-971694"

	I0428 23:09:13.362265   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.362310   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.360398   21498 addons.go:234] Setting addon helm-tiller=true in "addons-971694"

	I0428 23:09:13.362353   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.362370   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.362384   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.360410   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.360420   21498 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-971694"

	I0428 23:09:13.360426   21498 addons.go:234] Setting addon volumesnapshots=true in "addons-971694"

	I0428 23:09:13.360444   21498 addons.go:234] Setting addon cloud-spanner=true in "addons-971694"

	I0428 23:09:13.360443   21498 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-971694"

	I0428 23:09:13.360449   21498 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-971694"

	I0428 23:09:13.360415   21498 mustload.go:65] Loading cluster: addons-971694

	I0428 23:09:13.360458   21498 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-971694"

	I0428 23:09:13.360555   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.362820   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.362864   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.360619   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.362924   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.363213   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.363249   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.364152   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.364532   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.364574   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.364604   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.364973   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.364990   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.365053   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.365075   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.365132   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.365133   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.365139   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.365162   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.365249   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.365263   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.365285   21498 config.go:182] Loaded profile config "addons-971694": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:09:13.365488   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.385937   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39963

	I0428 23:09:13.386313   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36005

	I0428 23:09:13.386564   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36671

	I0428 23:09:13.386702   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.386945   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.387206   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45935

	I0428 23:09:13.387222   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.387236   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.387360   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.387664   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.387975   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42717

	I0428 23:09:13.388304   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.388367   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.388384   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.388443   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.388469   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.388674   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.388694   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.388773   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.388855   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.388960   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.388984   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.389453   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.389458   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.389501   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.389553   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.389576   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.389777   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.389962   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.390499   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.390543   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.390813   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.390847   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.390962   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.390989   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.391145   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.391186   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.398323   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.398348   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.398371   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.398376   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.418536   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.418577   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.420991   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34825

	I0428 23:09:13.421441   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45719

	I0428 23:09:13.421862   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.422489   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.422507   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.422886   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.422965   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.423412   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.423429   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.423492   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45411

	I0428 23:09:13.423947   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.424648   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39045

	I0428 23:09:13.424778   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.425220   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.425248   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.425551   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.425559   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.425580   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.425755   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.425975   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.426246   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.426263   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.426763   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.426801   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.426965   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.427491   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.427523   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.430429   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33467

	I0428 23:09:13.430854   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.430980   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.433428   21498 out.go:177]   - Using image docker.io/registry:2.8.3

	I0428 23:09:13.431394   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.434979   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.436895   21498 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0428 23:09:13.438433   21498 addons.go:426] installing /etc/kubernetes/addons/registry-rc.yaml

	I0428 23:09:13.438452   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)

	I0428 23:09:13.438473   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.436199   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42569

	I0428 23:09:13.437166   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.439041   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.439562   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.439586   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.439965   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.440568   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.441385   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42285

	I0428 23:09:13.441701   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34449

	I0428 23:09:13.441872   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.441963   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.442263   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.442342   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.442357   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.442391   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.442587   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.442727   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.442882   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.443390   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.443522   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.443538   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.443605   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44885

	I0428 23:09:13.443970   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.443995   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.444009   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.444195   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44841

	I0428 23:09:13.444385   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.444639   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.444657   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.445087   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.445119   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.445351   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39123

	I0428 23:09:13.445469   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.445531   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.445583   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.447727   21498 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.27.0

	I0428 23:09:13.446497   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.446515   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.446520   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.446602   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.449300   21498 addons.go:426] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0428 23:09:13.449436   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.449823   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.450517   21498 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	I0428 23:09:13.450525   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.452145   21498 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0428 23:09:13.452164   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0428 23:09:13.452182   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.450550   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0428 23:09:13.452241   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.449990   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.452274   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.449871   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41065

	I0428 23:09:13.450648   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.452738   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.453351   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.453366   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.453387   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.453777   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.453987   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.454932   21498 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-971694"

	I0428 23:09:13.454968   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.455337   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.455369   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.455802   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.456388   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.456416   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.456449   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.456474   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.456689   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.456928   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.457028   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.457048   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.457180   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.457242   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.457602   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.457671   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.457932   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.459874   21498 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4

	I0428 23:09:13.458183   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.458335   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.458868   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.459049   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.460465   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34231

	I0428 23:09:13.461622   21498 addons.go:426] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0428 23:09:13.461634   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0428 23:09:13.461650   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.462054   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.462092   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.462871   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.463798   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.464046   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42799

	I0428 23:09:13.464815   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.465264   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.465286   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.465631   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.465834   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.466394   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.466927   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.466948   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.467121   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.467329   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.467557   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.467758   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.470427   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.470944   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.470961   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.471028   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37437

	I0428 23:09:13.471939   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.472437   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.472453   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.472517   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.472717   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.472845   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.473263   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.473419   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.474453   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.476949   21498 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.15.0

	I0428 23:09:13.474901   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.478794   21498 addons.go:426] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0428 23:09:13.478807   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0428 23:09:13.478826   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.480505   21498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0

	I0428 23:09:13.482056   21498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0428 23:09:13.480443   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44835

	I0428 23:09:13.482190   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.482975   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38573

	I0428 23:09:13.483009   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.483116   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43167

	I0428 23:09:13.485383   21498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0428 23:09:13.483860   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.485416   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.484104   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.484190   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37351

	I0428 23:09:13.484282   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.484333   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.484640   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43721

	I0428 23:09:13.485348   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.487091   21498 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0428 23:09:13.487112   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0428 23:09:13.487128   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.486176   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.486257   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.487216   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.486257   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.487260   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.486269   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.487293   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.486278   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.486289   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.487454   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.487753   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.487815   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.487955   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.488020   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.488865   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.488884   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.488947   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.489325   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.489522   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.489884   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.489948   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.489966   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.490336   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.490524   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.491033   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.492944   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.492946   21498 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.15

	I0428 23:09:13.494610   21498 addons.go:426] installing /etc/kubernetes/addons/deployment.yaml

	I0428 23:09:13.494627   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0428 23:09:13.492452   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.492476   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.492296   21498 addons.go:234] Setting addon default-storageclass=true in "addons-971694"

	I0428 23:09:13.494770   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:13.493203   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.493411   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.494884   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.493596   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.494642   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.496962   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0428 23:09:13.498849   21498 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0

	I0428 23:09:13.495148   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.495371   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.497785   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.498215   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37921

	I0428 23:09:13.498393   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.499475   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46555

	I0428 23:09:13.500386   21498 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0428 23:09:13.500427   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.501594   21498 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0428 23:09:13.501832   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.502848   21498 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0428 23:09:13.502859   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0428 23:09:13.502876   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.502926   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.502947   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.503134   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)

	I0428 23:09:13.503150   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.505019   21498 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0428 23:09:13.505037   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0428 23:09:13.503392   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.504107   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.505139   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.504145   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.504182   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.505675   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.505855   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.505869   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.506091   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.506342   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.506585   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.507374   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.507735   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.507753   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.508485   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.508547   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.508601   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.508625   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.508787   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.509037   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.509098   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.509154   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45809

	I0428 23:09:13.509357   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.509414   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.509468   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.509540   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.511693   21498 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I0428 23:09:13.509897   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.510381   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.510567   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.511386   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.512173   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.513202   21498 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0428 23:09:13.513215   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0428 23:09:13.513218   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.513228   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.513202   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.513281   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.513293   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.513312   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.513773   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.513846   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.513897   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.513949   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.514332   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.514387   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.516542   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.516872   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.517076   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41823

	I0428 23:09:13.517520   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.518433   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.518453   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.518796   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.519086   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.519792   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.523153   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.523171   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.523199   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.523407   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.525461   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0428 23:09:13.523752   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.528569   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0428 23:09:13.526910   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43581

	I0428 23:09:13.527110   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.527181   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39857

	I0428 23:09:13.531229   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0428 23:09:13.530163   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.530319   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.530348   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.533992   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0428 23:09:13.532930   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.533064   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.535970   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.537390   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0428 23:09:13.536013   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.536380   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.540014   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0428 23:09:13.541359   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0428 23:09:13.539058   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.539325   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:13.541422   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:13.541574   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.542929   21498 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0428 23:09:13.544329   21498 addons.go:426] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0428 23:09:13.544350   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0428 23:09:13.544411   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.544675   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.546340   21498 out.go:177]   - Using image docker.io/busybox:stable

	I0428 23:09:13.547971   21498 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0428 23:09:13.549413   21498 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0428 23:09:13.549428   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0428 23:09:13.547214   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.549476   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.549506   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.547829   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.549444   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.549710   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.549889   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.550080   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.552217   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.552554   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.552575   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.552798   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.552957   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.553098   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.553196   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	W0428 23:09:13.571306   21498 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:33742->192.168.39.130:22: read: connection reset by peer

	I0428 23:09:13.571338   21498 retry.go:31] will retry after 176.118084ms: ssh: handshake failed: read tcp 192.168.39.1:33742->192.168.39.130:22: read: connection reset by peer

	W0428 23:09:13.571401   21498 sshutil.go:64] dial failure (will retry): ssh: handshake failed: read tcp 192.168.39.1:33744->192.168.39.130:22: read: connection reset by peer

	I0428 23:09:13.571413   21498 retry.go:31] will retry after 175.13825ms: ssh: handshake failed: read tcp 192.168.39.1:33744->192.168.39.130:22: read: connection reset by peer

	I0428 23:09:13.585983   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37599

	I0428 23:09:13.586352   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:13.586845   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:13.586863   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:13.587217   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:13.587428   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:13.589193   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:13.589455   21498 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0428 23:09:13.589475   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0428 23:09:13.589493   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:13.592458   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.592946   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:13.592980   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:13.593140   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:13.593341   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:13.593501   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:13.593654   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:13.879846   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0428 23:09:13.944752   21498 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0428 23:09:13.944771   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0428 23:09:13.956191   21498 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0428 23:09:13.956211   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0428 23:09:13.966341   21498 addons.go:426] installing /etc/kubernetes/addons/registry-svc.yaml

	I0428 23:09:13.966367   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0428 23:09:13.989054   21498 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0428 23:09:13.989076   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0428 23:09:14.038968   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0428 23:09:14.043333   21498 addons.go:426] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0428 23:09:14.043355   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0428 23:09:14.084246   21498 addons.go:426] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0428 23:09:14.084273   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0428 23:09:14.115357   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0428 23:09:14.117901   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0428 23:09:14.137967   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0428 23:09:14.140357   21498 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0428 23:09:14.140376   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0428 23:09:14.144876   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0428 23:09:14.227233   21498 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0428 23:09:14.227257   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0428 23:09:14.229696   21498 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0428 23:09:14.229721   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0428 23:09:14.241056   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0428 23:09:14.241087   21498 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:09:14.263223   21498 addons.go:426] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0428 23:09:14.263244   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0428 23:09:14.275570   21498 addons.go:426] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0428 23:09:14.275588   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0428 23:09:14.297643   21498 addons.go:426] installing /etc/kubernetes/addons/ig-role.yaml

	I0428 23:09:14.297668   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0428 23:09:14.502491   21498 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0428 23:09:14.502514   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0428 23:09:14.513521   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0428 23:09:14.517258   21498 addons.go:426] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0428 23:09:14.517281   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0428 23:09:14.531349   21498 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0428 23:09:14.531370   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0428 23:09:14.646376   21498 addons.go:426] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0428 23:09:14.646414   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0428 23:09:14.742803   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0428 23:09:14.795310   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0428 23:09:14.843751   21498 addons.go:426] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0428 23:09:14.843776   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0428 23:09:14.844246   21498 addons.go:426] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0428 23:09:14.844262   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0428 23:09:14.869145   21498 addons.go:426] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0428 23:09:14.869169   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0428 23:09:14.911799   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0428 23:09:15.028313   21498 addons.go:426] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0428 23:09:15.028341   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0428 23:09:15.087379   21498 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0428 23:09:15.087404   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0428 23:09:15.199567   21498 addons.go:426] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0428 23:09:15.199602   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0428 23:09:15.207618   21498 addons.go:426] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0428 23:09:15.207645   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0428 23:09:15.410200   21498 addons.go:426] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0428 23:09:15.410227   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0428 23:09:15.542511   21498 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0428 23:09:15.542552   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0428 23:09:15.609985   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0428 23:09:15.630551   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0428 23:09:15.722664   21498 addons.go:426] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0428 23:09:15.722684   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0428 23:09:15.765185   21498 addons.go:426] installing /etc/kubernetes/addons/ig-crd.yaml

	I0428 23:09:15.765208   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0428 23:09:16.051774   21498 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0428 23:09:16.051796   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0428 23:09:16.066176   21498 addons.go:426] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0428 23:09:16.066196   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0428 23:09:16.240104   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0428 23:09:16.402087   21498 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0428 23:09:16.402111   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0428 23:09:16.858118   21498 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0428 23:09:16.858145   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0428 23:09:17.063860   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.183974178s)

	I0428 23:09:17.063901   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:17.063915   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:17.064186   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:17.064221   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:17.064236   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:17.064251   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:17.064264   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:17.064471   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:17.064485   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:17.293813   21498 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0428 23:09:17.293840   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0428 23:09:17.649368   21498 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0428 23:09:17.649391   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0428 23:09:18.054697   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0428 23:09:19.601318   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (5.562318545s)

	I0428 23:09:19.601354   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:19.601367   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:19.601653   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:19.601695   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:19.601711   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:19.601720   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:19.601745   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:19.602062   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:19.602079   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:20.535470   21498 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0428 23:09:20.535508   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:20.538921   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:20.539373   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:20.539410   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:20.539594   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:20.539814   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:20.540011   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:20.540183   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:21.276017   21498 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0428 23:09:21.973483   21498 addons.go:234] Setting addon gcp-auth=true in "addons-971694"

	I0428 23:09:21.973547   21498 host.go:66] Checking if "addons-971694" exists ...

	I0428 23:09:21.973850   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:21.973880   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:21.988620   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40859

	I0428 23:09:21.989037   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:21.989492   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:21.989517   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:21.989825   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:21.990283   21498 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:09:21.990310   21498 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:09:22.005591   21498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43353

	I0428 23:09:22.005983   21498 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:09:22.006464   21498 main.go:141] libmachine: Using API Version  1

	I0428 23:09:22.006493   21498 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:09:22.006809   21498 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:09:22.007018   21498 main.go:141] libmachine: (addons-971694) Calling .GetState

	I0428 23:09:22.008454   21498 main.go:141] libmachine: (addons-971694) Calling .DriverName

	I0428 23:09:22.008678   21498 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0428 23:09:22.008705   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHHostname

	I0428 23:09:22.010979   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:22.011401   21498 main.go:141] libmachine: (addons-971694) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:36:e2:9e", ip: ""} in network mk-addons-971694: {Iface:virbr1 ExpiryTime:2024-04-29 00:08:33 +0000 UTC Type:0 Mac:52:54:00:36:e2:9e Iaid: IPaddr:192.168.39.130 Prefix:24 Hostname:addons-971694 Clientid:01:52:54:00:36:e2:9e}

	I0428 23:09:22.011427   21498 main.go:141] libmachine: (addons-971694) DBG | domain addons-971694 has defined IP address 192.168.39.130 and MAC address 52:54:00:36:e2:9e in network mk-addons-971694

	I0428 23:09:22.011675   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHPort

	I0428 23:09:22.011849   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHKeyPath

	I0428 23:09:22.012052   21498 main.go:141] libmachine: (addons-971694) Calling .GetSSHUsername

	I0428 23:09:22.012188   21498 sshutil.go:53] new ssh client: &{IP:192.168.39.130 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/addons-971694/id_rsa Username:docker}

	I0428 23:09:23.168238   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (9.052843924s)

	I0428 23:09:23.168276   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (9.030283197s)

	I0428 23:09:23.168296   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168304   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168308   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168315   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168324   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (9.023417966s)

	I0428 23:09:23.168256   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (9.050323893s)

	I0428 23:09:23.168352   21498 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (8.927239412s)

	I0428 23:09:23.168425   21498 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (8.927344802s)

	I0428 23:09:23.168448   21498 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0428 23:09:23.168494   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (8.654939561s)

	I0428 23:09:23.168521   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168530   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168542   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (8.425707539s)

	I0428 23:09:23.168592   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (8.373255082s)

	I0428 23:09:23.168612   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168621   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168594   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168657   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168661   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (8.256832522s)

	I0428 23:09:23.168358   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168679   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168687   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168687   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168802   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (7.558787427s)

	I0428 23:09:23.168357   21498 main.go:141] libmachine: Making call to close driver server

	W0428 23:09:23.168827   21498 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0428 23:09:23.168841   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168870   21498 retry.go:31] will retry after 136.919143ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0428 23:09:23.168926   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.538349955s)

	I0428 23:09:23.168944   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.168952   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.168994   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (6.928854699s)

	I0428 23:09:23.169013   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169022   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.169377   21498 node_ready.go:35] waiting up to 6m0s for node "addons-971694" to be "Ready" ...

	I0428 23:09:23.169457   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169477   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169485   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169496   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169501   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169505   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169508   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169515   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.169533   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169543   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169548   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169550   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169564   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.169578   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169586   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169593   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169563   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169613   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169626   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169641   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169647   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169654   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169661   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.169704   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169710   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169717   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169725   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.169757   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169774   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169781   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169789   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169795   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.169835   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.169851   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169858   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169864   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.169872   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.170362   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.170378   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.170387   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.170393   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.171097   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.171134   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.171141   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.169516   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.171167   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.171476   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.171518   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.171526   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.171534   21498 addons.go:470] Verifying addon registry=true in "addons-971694"

	I0428 23:09:23.174706   21498 out.go:177] * Verifying registry addon...

	I0428 23:09:23.171789   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.171813   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.171832   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.171883   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.171901   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.171920   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.171934   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.171963   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.171980   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.171994   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.172916   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.172971   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.172997   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.173526   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.169599   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.176751   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.176763   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.176771   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.176793   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.176805   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.176813   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.176814   21498 addons.go:470] Verifying addon metrics-server=true in "addons-971694"

	I0428 23:09:23.176841   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.176848   21498 addons.go:470] Verifying addon ingress=true in "addons-971694"

	I0428 23:09:23.176865   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.178341   21498 out.go:177] * Verifying ingress addon...

	I0428 23:09:23.176797   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.177128   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.177129   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.177129   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.177159   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.177587   21498 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0428 23:09:23.179736   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.179761   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.181063   21498 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-971694 service yakd-dashboard -n yakd-dashboard

	I0428 23:09:23.180322   21498 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0428 23:09:23.258580   21498 node_ready.go:49] node "addons-971694" has status "Ready":"True"

	I0428 23:09:23.258614   21498 node_ready.go:38] duration metric: took 89.218218ms for node "addons-971694" to be "Ready" ...

	I0428 23:09:23.258627   21498 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0428 23:09:23.275597   21498 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0428 23:09:23.275621   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:23.276346   21498 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0428 23:09:23.276373   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:23.294185   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.294204   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.294474   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:23.294478   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.294502   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	W0428 23:09:23.294596   21498 out.go:239] ! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class standard as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "standard": the object has been modified; please apply your changes to the latest version and try again]

	! Enabling 'default-storageclass' returned an error: running callbacks: [Error making standard the default storage class: Error while marking storage class standard as default: Operation cannot be fulfilled on storageclasses.storage.k8s.io "standard": the object has been modified; please apply your changes to the latest version and try again]

	I0428 23:09:23.297026   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:23.297042   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:23.297302   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:23.297322   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:23.306267   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0428 23:09:23.328678   21498 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-n5mdf" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.390126   21498 pod_ready.go:92] pod "coredns-7db6d8ff4d-n5mdf" in "kube-system" namespace has status "Ready":"True"

	I0428 23:09:23.390151   21498 pod_ready.go:81] duration metric: took 61.439686ms for pod "coredns-7db6d8ff4d-n5mdf" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.390164   21498 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-r2lfm" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.424398   21498 pod_ready.go:92] pod "coredns-7db6d8ff4d-r2lfm" in "kube-system" namespace has status "Ready":"True"

	I0428 23:09:23.424433   21498 pod_ready.go:81] duration metric: took 34.259839ms for pod "coredns-7db6d8ff4d-r2lfm" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.424446   21498 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.442848   21498 pod_ready.go:92] pod "etcd-addons-971694" in "kube-system" namespace has status "Ready":"True"

	I0428 23:09:23.442873   21498 pod_ready.go:81] duration metric: took 18.419565ms for pod "etcd-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.442886   21498 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.484045   21498 pod_ready.go:92] pod "kube-apiserver-addons-971694" in "kube-system" namespace has status "Ready":"True"

	I0428 23:09:23.484072   21498 pod_ready.go:81] duration metric: took 41.176278ms for pod "kube-apiserver-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.484086   21498 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.572927   21498 pod_ready.go:92] pod "kube-controller-manager-addons-971694" in "kube-system" namespace has status "Ready":"True"

	I0428 23:09:23.572952   21498 pod_ready.go:81] duration metric: took 88.858818ms for pod "kube-controller-manager-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.572964   21498 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-7rzct" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.675780   21498 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-971694" context rescaled to 1 replicas

	I0428 23:09:23.686203   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:23.692016   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:23.972571   21498 pod_ready.go:92] pod "kube-proxy-7rzct" in "kube-system" namespace has status "Ready":"True"

	I0428 23:09:23.972604   21498 pod_ready.go:81] duration metric: took 399.632205ms for pod "kube-proxy-7rzct" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:23.972615   21498 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:24.185351   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:24.186659   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:24.373490   21498 pod_ready.go:92] pod "kube-scheduler-addons-971694" in "kube-system" namespace has status "Ready":"True"

	I0428 23:09:24.373517   21498 pod_ready.go:81] duration metric: took 400.894182ms for pod "kube-scheduler-addons-971694" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:24.373529   21498 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace to be "Ready" ...

	I0428 23:09:24.687780   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:24.688695   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:25.189129   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:25.197047   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:25.698741   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:25.698805   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:25.954864   21498 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (3.946159954s)

	I0428 23:09:25.956600   21498 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0428 23:09:25.954989   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.648689295s)

	I0428 23:09:25.957107   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (7.90237149s)

	I0428 23:09:25.958102   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:25.958122   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:25.959848   21498 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0428 23:09:25.958124   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:25.959882   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:25.958418   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:25.959932   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:25.959957   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:25.959972   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:25.958445   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:25.961723   21498 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0428 23:09:25.961745   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0428 23:09:25.960312   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:25.960319   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:25.960284   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:25.961794   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:25.961804   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:25.961811   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:25.960338   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:25.961857   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:25.961866   21498 addons.go:470] Verifying addon csi-hostpath-driver=true in "addons-971694"

	I0428 23:09:25.963994   21498 out.go:177] * Verifying csi-hostpath-driver addon...

	I0428 23:09:25.962038   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:25.962052   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:25.965291   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:25.965878   21498 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0428 23:09:26.006671   21498 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0428 23:09:26.006695   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:26.068603   21498 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0428 23:09:26.068637   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0428 23:09:26.122426   21498 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0428 23:09:26.122452   21498 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0428 23:09:26.174260   21498 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0428 23:09:26.184918   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:26.188302   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:26.380525   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:26.472551   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:26.684512   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:26.687449   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:26.971403   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:27.189400   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:27.191119   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:27.489763   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:27.601005   21498 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.426684753s)

	I0428 23:09:27.601060   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:27.601069   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:27.601308   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:27.601325   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:27.601335   21498 main.go:141] libmachine: Making call to close driver server

	I0428 23:09:27.601342   21498 main.go:141] libmachine: (addons-971694) Calling .Close

	I0428 23:09:27.601345   21498 main.go:141] libmachine: (addons-971694) DBG | Closing plugin on server side

	I0428 23:09:27.601610   21498 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:09:27.601624   21498 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:09:27.603410   21498 addons.go:470] Verifying addon gcp-auth=true in "addons-971694"

	I0428 23:09:27.605286   21498 out.go:177] * Verifying gcp-auth addon...

	I0428 23:09:27.606922   21498 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0428 23:09:27.624456   21498 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0428 23:09:27.624482   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:27.686553   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:27.688787   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:27.972394   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:28.110537   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:28.185382   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:28.187548   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:28.472052   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:28.611027   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:28.684679   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:28.687974   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:28.886141   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:28.971493   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:29.111582   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:29.185359   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:29.188102   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:29.472053   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:29.611066   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:29.684280   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:29.686875   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:29.971912   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:30.111242   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:30.185413   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:30.187434   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:30.472884   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:30.611374   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:30.688557   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:30.688706   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:30.903750   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:30.975608   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:31.110880   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:31.186159   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:31.188051   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:31.472297   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:31.611076   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:31.686600   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:31.688707   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:31.971776   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:32.110769   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:32.189454   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:32.189759   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:32.473019   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:32.611011   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:32.685357   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:32.688542   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:32.971940   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:33.111063   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:33.185733   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:33.187009   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:33.379209   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:33.472163   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:33.610291   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:33.685958   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:33.687866   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:33.971236   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:34.111088   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:34.185697   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:34.187240   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:34.471247   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:34.611406   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:34.686674   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:34.687098   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:34.971806   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:35.111159   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:35.184510   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:35.186988   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:35.476202   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:35.611383   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:35.684701   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:35.687497   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:35.883906   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:35.971494   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:36.111990   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:36.187859   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:36.189267   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:36.479736   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:36.610064   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:36.684395   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:36.687182   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:36.973128   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:37.110515   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:37.185619   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:37.193234   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:37.479674   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:37.610937   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:37.684263   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:37.688945   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:37.971406   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:38.111786   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:38.185341   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:38.186851   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:38.379392   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:38.472204   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:38.611256   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:38.685995   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:38.691268   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:38.971456   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:39.111539   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:39.186235   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:39.188284   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:39.472452   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:39.611434   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:39.834864   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:39.835146   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:39.972013   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:40.111683   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:40.186906   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:40.191481   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:40.380284   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:40.471986   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:40.611353   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:40.699494   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:40.714421   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:40.972285   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:41.110624   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:41.189441   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:41.191605   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:41.472353   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:41.613200   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:41.941371   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:41.944203   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:41.985761   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:42.111597   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:42.185847   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:42.188837   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:42.380776   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:42.474195   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:42.611263   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:42.687301   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:42.687688   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:42.973149   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:43.110656   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:43.184658   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:43.188294   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:43.471855   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:43.611373   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:43.685529   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:43.689010   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:43.974915   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:44.110781   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:44.191109   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:44.191463   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:44.381596   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:44.472185   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:44.615703   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:44.685984   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:44.688133   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:44.972287   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:45.111621   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:45.185268   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:45.188182   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:45.471207   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:45.612929   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:45.684840   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:45.690627   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:45.973270   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:46.111028   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:46.184531   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:46.187305   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:46.473479   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:46.611284   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:46.687853   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:46.689920   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:46.878789   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:46.972484   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:47.112142   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:47.184502   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:47.186903   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:47.472732   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:47.610735   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:47.686464   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:47.689540   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:47.972588   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:48.113137   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:48.184782   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:48.187286   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:48.471637   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:48.610621   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:48.686118   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:48.688051   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:48.879463   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:48.971505   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:49.110368   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:49.184962   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:49.187182   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:49.474192   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:49.611599   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:49.685141   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:49.688064   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:49.975731   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:50.499976   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:50.504311   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:50.505639   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:50.505820   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:50.611175   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:50.684473   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:50.687371   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:50.882690   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:50.972629   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:51.111424   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:51.186619   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:51.188703   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:51.472267   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:51.612592   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:51.686884   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:51.689376   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:51.972225   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:52.111407   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:52.185025   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:52.186514   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:52.472766   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:52.611098   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:52.684509   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:52.687361   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:52.971551   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:53.111118   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:53.184479   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:53.187887   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:53.380454   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:53.477484   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:53.611755   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:53.686821   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:53.689069   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:53.972273   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:54.110896   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:54.185579   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:54.187561   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:54.471538   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:54.611075   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:54.687509   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:54.692124   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:54.970783   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:55.110414   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:55.185000   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:55.187374   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:55.385952   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:55.474803   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:55.611187   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:55.685281   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:55.687534   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:55.971713   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:56.110462   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:56.184904   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:56.189396   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:56.473457   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:56.611390   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:56.687830   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:56.689327   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:56.976524   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:57.111352   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:57.188959   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:57.189494   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:57.471389   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:57.611772   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:57.684865   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:57.686847   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:57.880077   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:57.975684   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:58.110595   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:58.185724   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:58.187327   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:58.476175   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:58.617617   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:58.695843   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:58.696136   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:58.973255   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:59.112263   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:59.184929   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:59.187873   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:59.472380   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:09:59.610946   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:09:59.693244   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:09:59.694067   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:09:59.880292   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:09:59.974661   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:00.111088   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:00.184454   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:00.187208   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:00.474115   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:01.014645   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:01.016074   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:01.018387   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:01.020468   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:01.110716   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:01.184955   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:01.190997   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:01.472849   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:01.611009   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:01.685410   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:01.687271   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:01.971414   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:02.111809   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:02.186865   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:02.188786   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:02.380152   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:02.470839   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:02.610692   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:02.685374   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:02.687320   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:02.975581   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:03.354731   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:03.355246   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:03.355420   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:03.472749   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:03.611276   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:03.690089   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:03.690897   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:03.973873   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:04.121667   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:04.187421   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:04.192549   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:04.389855   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:04.472007   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:04.611680   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:04.685338   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:04.687255   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:04.972720   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:05.111981   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:05.187996   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:05.189718   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:05.472009   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:05.610925   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:05.686612   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:05.687729   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:05.972286   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:06.111697   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:06.186154   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:06.190878   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:06.471810   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:06.610628   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:06.685329   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:06.688596   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:06.881297   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:06.972457   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:07.112499   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:07.184969   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:07.187666   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:07.471940   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:07.611212   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:07.685232   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:07.687513   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:07.971883   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:08.111288   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:08.185119   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:08.188184   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:08.472334   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:08.611480   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:08.685812   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:08.694589   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:08.974686   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:09.110836   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:09.185459   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:09.188803   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:09.381551   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:09.472281   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:09.611242   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:09.685410   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:09.686978   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:09.980460   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:10.111597   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:10.186149   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:10.187840   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:10.476726   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:10.611725   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:10.686333   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:10.689051   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:10.972497   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:11.111781   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:11.187284   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:11.188809   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:11.384026   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:11.482480   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:11.612767   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:11.684865   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:11.687546   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:11.971945   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:12.111572   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:12.185935   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:12.187445   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:12.472625   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:12.611923   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:12.686915   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:12.688568   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:12.971784   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:13.110704   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:13.185620   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:13.187293   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:13.471866   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:13.614497   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:13.687162   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:13.688652   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:13.880795   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:13.972779   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:14.114172   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:14.185915   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:14.187946   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:14.472909   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:14.611556   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:14.686017   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:14.690328   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:14.973388   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:15.111518   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:15.196583   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:15.214578   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:15.472197   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:15.610996   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:15.684541   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:15.687036   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:15.881824   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:15.972756   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:16.111258   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:16.186623   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:16.188679   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:16.473530   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:16.612376   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:16.685820   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0428 23:10:16.687149   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:16.971261   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:17.115903   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:17.187187   21498 kapi.go:107] duration metric: took 54.009596475s to wait for kubernetes.io/minikube-addons=registry ...

	I0428 23:10:17.189679   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:17.481390   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:17.988003   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:17.988051   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:17.989176   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:17.992807   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:18.110899   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:18.187202   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:18.473685   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:18.611535   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:18.688731   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:18.972645   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:19.113840   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:19.187795   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:19.472672   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:19.612074   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:19.687945   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:19.972842   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:20.114766   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:20.187988   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:20.381371   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:20.472462   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:20.611107   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:20.687729   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:20.972132   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:21.111054   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:21.186721   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:21.472133   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:21.611129   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:21.687500   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:21.972648   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:22.111126   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:22.188091   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:22.473173   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:22.611121   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:22.687530   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:22.879966   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:22.972060   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:23.111308   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:23.187631   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:23.471887   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:23.910559   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:23.911465   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:23.971579   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:24.111154   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:24.186776   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:24.472151   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:24.612037   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:24.695095   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:24.881248   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:24.971456   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:25.111561   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:25.189887   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:25.474495   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:25.611694   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:25.686717   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:25.971591   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:26.112780   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:26.186473   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:26.471984   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:26.611297   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:26.687927   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:27.074017   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:27.077604   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:27.112202   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:27.187820   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:27.476333   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:27.612790   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:27.700190   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:27.985798   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:28.110239   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:28.187120   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:28.472915   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:28.611194   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:28.687676   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:28.972226   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:29.111250   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:29.187753   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:29.379477   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:29.471625   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:29.611258   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:29.688102   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:29.977674   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:30.110563   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:30.188005   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:30.471772   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:30.613480   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:30.695788   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:30.972226   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:31.111395   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:31.187293   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:31.484215   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:31.613139   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:31.688357   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:31.881165   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:31.975962   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:32.111550   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:32.187361   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:32.473624   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:32.611772   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:32.695913   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:32.972169   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:33.111321   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:33.187549   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:33.507783   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:33.616607   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:33.687531   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:33.889811   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:33.976961   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:34.114324   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:34.187524   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:34.472803   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:34.611580   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:34.686473   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:34.971941   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:35.111075   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:35.187057   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:35.472379   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:35.629066   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:35.703054   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:36.151123   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:36.186912   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:36.199317   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:36.200267   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:36.470843   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:36.610987   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:36.686420   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:36.971508   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:37.111730   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:37.187623   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:37.471996   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:37.617415   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:37.704991   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:37.972471   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:38.111675   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:38.187282   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:38.379500   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:38.498212   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:38.611172   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:38.687645   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:38.971204   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:39.110301   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:39.187679   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:39.472418   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:39.611017   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:39.688513   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:39.978031   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:40.111687   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:40.187797   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:40.381048   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:40.472385   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:40.611159   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:40.688289   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:40.972137   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:41.110841   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:41.187791   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:41.471066   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0428 23:10:41.611388   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:41.687486   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:41.972415   21498 kapi.go:107] duration metric: took 1m16.006533351s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0428 23:10:42.111231   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:42.187973   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:42.381370   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:42.610987   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:42.687891   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:43.110619   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:43.187943   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:43.610804   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:43.687395   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:44.110491   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:44.187806   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:44.611413   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:44.688083   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:44.879294   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:45.111063   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:45.187268   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:45.611811   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:45.687754   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:46.111700   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:46.186874   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:46.611996   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:46.687619   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:46.881614   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:47.110978   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:47.188011   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:47.610416   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:47.688839   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:48.112309   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:48.188894   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:48.611643   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:48.690109   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:48.882485   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:49.111622   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:49.187028   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:49.611129   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:49.688312   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:50.111761   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:50.186939   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:50.611464   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:50.688221   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:51.111688   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:51.187189   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:51.392915   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:51.614533   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:51.689277   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:52.112202   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:52.188165   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:52.610501   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:52.688379   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:53.110523   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:53.187882   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:53.611364   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:53.688302   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:53.880582   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:54.112007   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:54.188473   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:54.611651   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:54.688008   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:55.111904   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:55.187855   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:55.611408   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:55.687800   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:56.111715   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:56.188456   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:56.379708   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:56.611499   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:56.696128   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:57.311088   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:57.311617   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:57.611609   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:57.686439   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:58.112009   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:58.188453   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:58.380853   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:10:58.611568   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:58.687965   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:59.111131   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:59.187519   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:10:59.611126   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:10:59.687115   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:00.111547   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:00.188265   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:00.612473   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:00.687226   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:00.880039   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:11:01.110503   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:01.187948   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:01.610890   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:01.687962   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:02.112634   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:02.187033   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:02.610819   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:02.696977   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:02.881492   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:11:03.112099   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:03.188378   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:03.610946   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:03.686508   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:04.112354   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:04.187679   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:04.611329   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:04.689456   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:05.111987   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:05.188130   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:05.380238   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:11:05.610885   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:05.687134   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:06.111487   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:06.189605   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:06.612177   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:06.688051   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:07.111156   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:07.188883   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:07.610483   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:07.688207   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:07.879038   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:11:08.111135   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:08.187474   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:08.611486   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:08.688938   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:09.111141   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:09.187321   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:09.610565   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:09.686745   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:09.880390   21498 pod_ready.go:102] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"False"

	I0428 23:11:10.113495   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:10.187521   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:10.382870   21498 pod_ready.go:92] pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace has status "Ready":"True"

	I0428 23:11:10.382892   21498 pod_ready.go:81] duration metric: took 1m46.00935532s for pod "metrics-server-c59844bb4-7s9h6" in "kube-system" namespace to be "Ready" ...

	I0428 23:11:10.382901   21498 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-s5btm" in "kube-system" namespace to be "Ready" ...

	I0428 23:11:10.388513   21498 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-s5btm" in "kube-system" namespace has status "Ready":"True"

	I0428 23:11:10.388530   21498 pod_ready.go:81] duration metric: took 5.623589ms for pod "nvidia-device-plugin-daemonset-s5btm" in "kube-system" namespace to be "Ready" ...

	I0428 23:11:10.388545   21498 pod_ready.go:38] duration metric: took 1m47.129905854s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0428 23:11:10.388561   21498 api_server.go:52] waiting for apiserver process to appear ...

	I0428 23:11:10.388582   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0428 23:11:10.388627   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0428 23:11:10.472251   21498 cri.go:91] found id: "bb3ec6107ca73a6170ecae476773855cbeaaeda15e82a77a96df476fa00fe1d1"

	I0428 23:11:10.472274   21498 cri.go:91] found id: ""

	I0428 23:11:10.472281   21498 logs.go:276] 1 containers: [bb3ec6107ca73a6170ecae476773855cbeaaeda15e82a77a96df476fa00fe1d1]

	I0428 23:11:10.472337   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:10.477366   21498 cri.go:56] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0428 23:11:10.477413   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0428 23:11:10.560224   21498 cri.go:91] found id: "c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2"

	I0428 23:11:10.560252   21498 cri.go:91] found id: ""

	I0428 23:11:10.560261   21498 logs.go:276] 1 containers: [c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2]

	I0428 23:11:10.560316   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:10.566057   21498 cri.go:56] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0428 23:11:10.566134   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0428 23:11:10.604545   21498 cri.go:91] found id: "c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af"

	I0428 23:11:10.604570   21498 cri.go:91] found id: ""

	I0428 23:11:10.604579   21498 logs.go:276] 1 containers: [c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af]

	I0428 23:11:10.604637   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:10.611477   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:10.613408   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0428 23:11:10.613463   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0428 23:11:10.656567   21498 cri.go:91] found id: "fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b"

	I0428 23:11:10.656582   21498 cri.go:91] found id: ""

	I0428 23:11:10.656589   21498 logs.go:276] 1 containers: [fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b]

	I0428 23:11:10.656639   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:10.662048   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0428 23:11:10.662097   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0428 23:11:10.687276   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:10.721284   21498 cri.go:91] found id: "9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877"

	I0428 23:11:10.721307   21498 cri.go:91] found id: ""

	I0428 23:11:10.721315   21498 logs.go:276] 1 containers: [9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877]

	I0428 23:11:10.721370   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:10.726563   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0428 23:11:10.726627   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0428 23:11:10.772099   21498 cri.go:91] found id: "d714effcc4e35301c07ed693205f36a96d3bd7b7887fe9d5c77f28554a2b83f9"

	I0428 23:11:10.772121   21498 cri.go:91] found id: ""

	I0428 23:11:10.772129   21498 logs.go:276] 1 containers: [d714effcc4e35301c07ed693205f36a96d3bd7b7887fe9d5c77f28554a2b83f9]

	I0428 23:11:10.772177   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:10.777418   21498 cri.go:56] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0428 23:11:10.777492   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0428 23:11:10.824201   21498 cri.go:91] found id: ""

	I0428 23:11:10.824223   21498 logs.go:276] 0 containers: []

	W0428 23:11:10.824232   21498 logs.go:278] No container was found matching "kindnet"

	I0428 23:11:10.824243   21498 logs.go:123] Gathering logs for kube-controller-manager [d714effcc4e35301c07ed693205f36a96d3bd7b7887fe9d5c77f28554a2b83f9] ...

	I0428 23:11:10.824257   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 d714effcc4e35301c07ed693205f36a96d3bd7b7887fe9d5c77f28554a2b83f9"

	I0428 23:11:10.885481   21498 logs.go:123] Gathering logs for kubelet ...

	I0428 23:11:10.885514   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I0428 23:11:10.971574   21498 logs.go:123] Gathering logs for dmesg ...

	I0428 23:11:10.971612   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0428 23:11:10.988252   21498 logs.go:123] Gathering logs for describe nodes ...

	I0428 23:11:10.988281   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0428 23:11:11.110833   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:11.161576   21498 logs.go:123] Gathering logs for coredns [c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af] ...

	I0428 23:11:11.161603   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af"

	I0428 23:11:11.187657   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:11.206267   21498 logs.go:123] Gathering logs for kube-scheduler [fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b] ...

	I0428 23:11:11.206293   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b"

	I0428 23:11:11.256377   21498 logs.go:123] Gathering logs for kube-apiserver [bb3ec6107ca73a6170ecae476773855cbeaaeda15e82a77a96df476fa00fe1d1] ...

	I0428 23:11:11.256408   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 bb3ec6107ca73a6170ecae476773855cbeaaeda15e82a77a96df476fa00fe1d1"

	I0428 23:11:11.308143   21498 logs.go:123] Gathering logs for etcd [c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2] ...

	I0428 23:11:11.308175   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2"

	I0428 23:11:11.379511   21498 logs.go:123] Gathering logs for kube-proxy [9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877] ...

	I0428 23:11:11.379542   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877"

	I0428 23:11:11.433864   21498 logs.go:123] Gathering logs for CRI-O ...

	I0428 23:11:11.433893   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I0428 23:11:11.611664   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:11.686453   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:12.111557   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:12.188129   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:12.435998   21498 logs.go:123] Gathering logs for container status ...

	I0428 23:11:12.436037   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0428 23:11:12.611059   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:12.688776   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:13.113941   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:13.187938   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:13.613058   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:13.688401   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:14.110846   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:14.187715   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:14.611301   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:14.688771   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:14.994465   21498 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0428 23:11:15.015249   21498 api_server.go:72] duration metric: took 2m1.658575027s to wait for apiserver process to appear ...

	I0428 23:11:15.015281   21498 api_server.go:88] waiting for apiserver healthz status ...

	I0428 23:11:15.015317   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0428 23:11:15.015378   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0428 23:11:15.057622   21498 cri.go:91] found id: "bb3ec6107ca73a6170ecae476773855cbeaaeda15e82a77a96df476fa00fe1d1"

	I0428 23:11:15.057653   21498 cri.go:91] found id: ""

	I0428 23:11:15.057663   21498 logs.go:276] 1 containers: [bb3ec6107ca73a6170ecae476773855cbeaaeda15e82a77a96df476fa00fe1d1]

	I0428 23:11:15.057723   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:15.063917   21498 cri.go:56] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0428 23:11:15.063992   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0428 23:11:15.110582   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:15.114985   21498 cri.go:91] found id: "c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2"

	I0428 23:11:15.115001   21498 cri.go:91] found id: ""

	I0428 23:11:15.115008   21498 logs.go:276] 1 containers: [c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2]

	I0428 23:11:15.115050   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:15.124787   21498 cri.go:56] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0428 23:11:15.124859   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0428 23:11:15.172846   21498 cri.go:91] found id: "c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af"

	I0428 23:11:15.172865   21498 cri.go:91] found id: ""

	I0428 23:11:15.172872   21498 logs.go:276] 1 containers: [c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af]

	I0428 23:11:15.172917   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:15.177565   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0428 23:11:15.177630   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0428 23:11:15.188142   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:15.224112   21498 cri.go:91] found id: "fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b"

	I0428 23:11:15.224131   21498 cri.go:91] found id: ""

	I0428 23:11:15.224138   21498 logs.go:276] 1 containers: [fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b]

	I0428 23:11:15.224192   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:15.228717   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0428 23:11:15.228785   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0428 23:11:15.273650   21498 cri.go:91] found id: "9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877"

	I0428 23:11:15.273668   21498 cri.go:91] found id: ""

	I0428 23:11:15.273675   21498 logs.go:276] 1 containers: [9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877]

	I0428 23:11:15.273717   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:15.278646   21498 cri.go:56] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0428 23:11:15.278696   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0428 23:11:15.320984   21498 cri.go:91] found id: "d714effcc4e35301c07ed693205f36a96d3bd7b7887fe9d5c77f28554a2b83f9"

	I0428 23:11:15.320998   21498 cri.go:91] found id: ""

	I0428 23:11:15.321005   21498 logs.go:276] 1 containers: [d714effcc4e35301c07ed693205f36a96d3bd7b7887fe9d5c77f28554a2b83f9]

	I0428 23:11:15.321045   21498 ssh_runner.go:195] Run: which crictl

	I0428 23:11:15.325869   21498 cri.go:56] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0428 23:11:15.325930   21498 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0428 23:11:15.370746   21498 cri.go:91] found id: ""

	I0428 23:11:15.370780   21498 logs.go:276] 0 containers: []

	W0428 23:11:15.370791   21498 logs.go:278] No container was found matching "kindnet"

	I0428 23:11:15.370801   21498 logs.go:123] Gathering logs for kube-proxy [9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877] ...

	I0428 23:11:15.370819   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9afa18bdcc92af0e30babd9f4af0ab94774e29bafff6f344a2fa20e34f863877"

	I0428 23:11:15.411932   21498 logs.go:123] Gathering logs for dmesg ...

	I0428 23:11:15.411957   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0428 23:11:15.432524   21498 logs.go:123] Gathering logs for etcd [c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2] ...

	I0428 23:11:15.432553   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c0586470a89c04a40c0f62b71c006cbb1a9ce9bd9a90ce05bd635cbcb5cb45d2"

	I0428 23:11:15.501505   21498 logs.go:123] Gathering logs for coredns [c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af] ...

	I0428 23:11:15.501540   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 c0604f9db8c7c2f8ea765b357d006f270963bf6446d8efab4f93703659f405af"

	I0428 23:11:15.543068   21498 logs.go:123] Gathering logs for kube-scheduler [fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b] ...

	I0428 23:11:15.543101   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 fe73c801a68560ef3027515ab0e01a2661114504bef04858433810cf7013ee0b"

	I0428 23:11:15.588480   21498 logs.go:123] Gathering logs for CRI-O ...

	I0428 23:11:15.588518   21498 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

	I0428 23:11:15.610791   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:15.687986   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:16.113747   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:16.188438   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:16.611468   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:16.689763   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:17.110930   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:17.187932   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:17.611718   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:17.686874   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:18.114487   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:18.188273   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:18.611956   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:18.687329   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:19.111083   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:19.188079   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:19.611269   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:19.688187   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:20.111723   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:20.187038   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:20.610891   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:20.687461   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:21.110859   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:21.188186   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:21.611718   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:21.686897   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:22.112895   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:22.187418   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:22.611561   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:22.687813   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:23.111381   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:23.187389   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:23.610824   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:23.689105   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:24.112035   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:24.194995   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:24.614123   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:24.688316   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:25.111157   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:25.187546   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:25.611151   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:25.688408   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:26.112103   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:26.188259   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:26.610409   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:26.687855   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:27.112341   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:27.187805   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:27.610920   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:27.687577   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:28.111148   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:28.187602   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:28.611142   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:28.689417   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:29.112505   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:29.187854   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:29.611354   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:29.687716   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:30.111557   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:30.188129   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:30.610974   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:30.687299   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:31.111518   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:31.188551   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:31.610602   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:31.686966   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:32.111402   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:32.187698   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:32.610933   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:32.687528   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:33.111442   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:33.188830   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:33.611944   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:33.688032   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:34.112612   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:34.188080   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:34.611809   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:34.688850   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:35.111629   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:35.187645   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:35.611073   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:35.688577   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:36.112372   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:36.188863   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:36.611019   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:36.687734   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:37.111000   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:37.187360   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:37.611358   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:37.688206   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:38.112051   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:38.188896   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:38.610286   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:38.687622   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:39.112414   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:39.187796   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:39.611056   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:39.689783   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:40.111103   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:40.187489   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:40.611105   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:40.687759   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:41.111846   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:41.187855   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:41.610924   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:41.686795   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:42.111212   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:42.188037   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:42.611377   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:42.693230   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:43.111388   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:43.187670   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:43.612253   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:43.687589   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:44.111258   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:44.188130   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:44.611097   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:44.687230   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:45.111212   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:45.187616   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:45.611099   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:45.687405   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:46.110241   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:46.191504   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:46.615025   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:46.689206   21498 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0428 23:11:47.116214   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:47.189774   21498 kapi.go:107] duration metric: took 2m24.00944923s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0428 23:11:47.611422   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:48.115623   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:48.612975   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:49.110796   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:49.611529   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:50.111974   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:50.615222   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:51.111697   21498 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0428 23:11:51.610787   21498 kapi.go:107] duration metric: took 2m24.003864048s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0428 23:11:51.612345   21498 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-971694 cluster.

	I0428 23:11:51.613589   21498 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0428 23:11:51.614792   21498 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0428 23:11:51.616107   21498 out.go:177] * Enabled addons: ingress-dns, storage-provisioner, nvidia-device-plugin, helm-tiller, metrics-server, inspektor-gadget, cloud-spanner, yakd, storage-provisioner-rancher, volumesnapshots, registry, csi-hostpath-driver, ingress, gcp-auth

	I0428 23:11:51.617323   21498 addons.go:505] duration metric: took 2m38.260762629s for enable addons: enabled=[ingress-dns storage-provisioner nvidia-device-plugin helm-tiller metrics-server inspektor-gadget cloud-spanner yakd storage-provisioner-rancher volumesnapshots registry csi-hostpath-driver ingress gcp-auth]

** /stderr **

addons_test.go:111: out/minikube-linux-amd64 start -p addons-971694 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: signal: killed

--- FAIL: TestAddons/Setup (2400.06s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 node stop m02 -v=7 --alsologtostderr

E0429 00:02:10.552590   20727 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/functional-243137/client.crt: no such file or directory

ha_test.go:363: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.48810058s)

-- stdout --

	* Stopping node "ha-274394-m02"  ...

-- /stdout --

** stderr ** 

	I0429 00:01:31.280131   40429 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:01:31.280308   40429 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:01:31.280325   40429 out.go:304] Setting ErrFile to fd 2...

	I0429 00:01:31.280331   40429 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:01:31.280613   40429 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:01:31.280848   40429 mustload.go:65] Loading cluster: ha-274394

	I0429 00:01:31.282442   40429 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:01:31.282473   40429 stop.go:39] StopHost: ha-274394-m02

	I0429 00:01:31.282941   40429 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:01:31.282976   40429 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:01:31.298489   40429 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36775

	I0429 00:01:31.298994   40429 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:01:31.299630   40429 main.go:141] libmachine: Using API Version  1

	I0429 00:01:31.299656   40429 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:01:31.299963   40429 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:01:31.302121   40429 out.go:177] * Stopping node "ha-274394-m02"  ...

	I0429 00:01:31.303512   40429 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]

	I0429 00:01:31.303546   40429 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:01:31.303753   40429 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup

	I0429 00:01:31.303783   40429 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:01:31.306560   40429 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:01:31.307000   40429 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:01:31.307034   40429 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:01:31.307154   40429 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:01:31.307313   40429 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:01:31.307463   40429 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:01:31.307601   40429 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0429 00:01:31.391907   40429 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/cni /var/lib/minikube/backup

	I0429 00:01:31.447485   40429 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/kubernetes /var/lib/minikube/backup

	I0429 00:01:31.505601   40429 main.go:141] libmachine: Stopping "ha-274394-m02"...

	I0429 00:01:31.505639   40429 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:01:31.507231   40429 main.go:141] libmachine: (ha-274394-m02) Calling .Stop

	I0429 00:01:31.510227   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 0/120

	I0429 00:01:32.512498   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 1/120

	I0429 00:01:33.513919   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 2/120

	I0429 00:01:34.515132   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 3/120

	I0429 00:01:35.516643   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 4/120

	I0429 00:01:36.518259   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 5/120

	I0429 00:01:37.520611   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 6/120

	I0429 00:01:38.521999   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 7/120

	I0429 00:01:39.523282   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 8/120

	I0429 00:01:40.524636   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 9/120

	I0429 00:01:41.526579   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 10/120

	I0429 00:01:42.527825   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 11/120

	I0429 00:01:43.529315   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 12/120

	I0429 00:01:44.530719   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 13/120

	I0429 00:01:45.532103   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 14/120

	I0429 00:01:46.534384   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 15/120

	I0429 00:01:47.536515   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 16/120

	I0429 00:01:48.538628   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 17/120

	I0429 00:01:49.540387   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 18/120

	I0429 00:01:50.542213   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 19/120

	I0429 00:01:51.544328   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 20/120

	I0429 00:01:52.545706   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 21/120

	I0429 00:01:53.547019   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 22/120

	I0429 00:01:54.549138   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 23/120

	I0429 00:01:55.550570   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 24/120

	I0429 00:01:56.551941   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 25/120

	I0429 00:01:57.553444   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 26/120

	I0429 00:01:58.554986   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 27/120

	I0429 00:01:59.556549   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 28/120

	I0429 00:02:00.557994   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 29/120

	I0429 00:02:01.559525   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 30/120

	I0429 00:02:02.561214   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 31/120

	I0429 00:02:03.562570   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 32/120

	I0429 00:02:04.563947   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 33/120

	I0429 00:02:05.565385   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 34/120

	I0429 00:02:06.567528   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 35/120

	I0429 00:02:07.569160   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 36/120

	I0429 00:02:08.570548   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 37/120

	I0429 00:02:09.572666   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 38/120

	I0429 00:02:10.573983   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 39/120

	I0429 00:02:11.576073   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 40/120

	I0429 00:02:12.577630   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 41/120

	I0429 00:02:13.579759   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 42/120

	I0429 00:02:14.581215   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 43/120

	I0429 00:02:15.582537   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 44/120

	I0429 00:02:16.584785   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 45/120

	I0429 00:02:17.586200   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 46/120

	I0429 00:02:18.588636   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 47/120

	I0429 00:02:19.590276   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 48/120

	I0429 00:02:20.592733   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 49/120

	I0429 00:02:21.594984   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 50/120

	I0429 00:02:22.596284   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 51/120

	I0429 00:02:23.597595   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 52/120

	I0429 00:02:24.599152   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 53/120

	I0429 00:02:25.600748   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 54/120

	I0429 00:02:26.602668   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 55/120

	I0429 00:02:27.604749   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 56/120

	I0429 00:02:28.606482   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 57/120

	I0429 00:02:29.608015   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 58/120

	I0429 00:02:30.610159   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 59/120

	I0429 00:02:31.612353   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 60/120

	I0429 00:02:32.613575   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 61/120

	I0429 00:02:33.615633   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 62/120

	I0429 00:02:34.616877   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 63/120

	I0429 00:02:35.618638   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 64/120

	I0429 00:02:36.620582   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 65/120

	I0429 00:02:37.621882   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 66/120

	I0429 00:02:38.623126   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 67/120

	I0429 00:02:39.624646   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 68/120

	I0429 00:02:40.626143   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 69/120

	I0429 00:02:41.628252   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 70/120

	I0429 00:02:42.629707   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 71/120

	I0429 00:02:43.631072   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 72/120

	I0429 00:02:44.632490   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 73/120

	I0429 00:02:45.634574   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 74/120

	I0429 00:02:46.636611   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 75/120

	I0429 00:02:47.637899   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 76/120

	I0429 00:02:48.639539   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 77/120

	I0429 00:02:49.641390   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 78/120

	I0429 00:02:50.642862   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 79/120

	I0429 00:02:51.644660   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 80/120

	I0429 00:02:52.645890   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 81/120

	I0429 00:02:53.647759   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 82/120

	I0429 00:02:54.648927   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 83/120

	I0429 00:02:55.650383   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 84/120

	I0429 00:02:56.652306   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 85/120

	I0429 00:02:57.653701   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 86/120

	I0429 00:02:58.655536   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 87/120

	I0429 00:02:59.657121   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 88/120

	I0429 00:03:00.659073   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 89/120

	I0429 00:03:01.661354   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 90/120

	I0429 00:03:02.662886   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 91/120

	I0429 00:03:03.664406   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 92/120

	I0429 00:03:04.665993   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 93/120

	I0429 00:03:05.667605   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 94/120

	I0429 00:03:06.669095   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 95/120

	I0429 00:03:07.670733   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 96/120

	I0429 00:03:08.672157   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 97/120

	I0429 00:03:09.673612   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 98/120

	I0429 00:03:10.674900   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 99/120

	I0429 00:03:11.676528   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 100/120

	I0429 00:03:12.678351   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 101/120

	I0429 00:03:13.680563   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 102/120

	I0429 00:03:14.682157   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 103/120

	I0429 00:03:15.684577   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 104/120

	I0429 00:03:16.686743   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 105/120

	I0429 00:03:17.687987   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 106/120

	I0429 00:03:18.689663   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 107/120

	I0429 00:03:19.691027   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 108/120

	I0429 00:03:20.692562   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 109/120

	I0429 00:03:21.694740   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 110/120

	I0429 00:03:22.696516   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 111/120

	I0429 00:03:23.697788   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 112/120

	I0429 00:03:24.700004   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 113/120

	I0429 00:03:25.701371   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 114/120

	I0429 00:03:26.703088   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 115/120

	I0429 00:03:27.705344   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 116/120

	I0429 00:03:28.706744   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 117/120

	I0429 00:03:29.708415   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 118/120

	I0429 00:03:30.710277   40429 main.go:141] libmachine: (ha-274394-m02) Waiting for machine to stop 119/120

	I0429 00:03:31.711513   40429 stop.go:66] stop err: unable to stop vm, current state "Running"

	W0429 00:03:31.711646   40429 out.go:239] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

	X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

** /stderr **

ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-274394 node stop m02 -v=7 --alsologtostderr": exit status 30

ha_test.go:369: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

E0429 00:03:32.473145   20727 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/functional-243137/client.crt: no such file or directory

ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 3 (19.193704843s)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:03:31.767728   40871 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:03:31.767827   40871 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:03:31.767832   40871 out.go:304] Setting ErrFile to fd 2...

	I0429 00:03:31.767835   40871 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:03:31.768031   40871 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:03:31.768199   40871 out.go:298] Setting JSON to false

	I0429 00:03:31.768223   40871 mustload.go:65] Loading cluster: ha-274394

	I0429 00:03:31.768279   40871 notify.go:220] Checking for updates...

	I0429 00:03:31.768594   40871 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:03:31.768611   40871 status.go:255] checking status of ha-274394 ...

	I0429 00:03:31.768965   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:31.769019   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:31.785410   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36601

	I0429 00:03:31.785939   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:31.786545   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:31.786581   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:31.786895   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:31.787131   40871 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:03:31.788891   40871 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:03:31.788909   40871 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:03:31.789217   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:31.789258   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:31.803817   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44269

	I0429 00:03:31.804278   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:31.804751   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:31.804774   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:31.805169   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:31.805390   40871 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:03:31.808163   40871 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:31.808629   40871 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:03:31.808658   40871 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:31.808792   40871 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:03:31.809073   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:31.809118   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:31.825277   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37021

	I0429 00:03:31.825744   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:31.826287   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:31.826315   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:31.826612   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:31.826799   40871 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:03:31.827000   40871 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:03:31.827036   40871 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:03:31.829980   40871 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:31.830456   40871 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:03:31.830484   40871 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:31.830642   40871 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:03:31.830819   40871 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:03:31.830991   40871 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:03:31.831134   40871 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:03:31.916280   40871 ssh_runner.go:195] Run: systemctl --version

	I0429 00:03:31.924688   40871 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:03:31.944490   40871 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:03:31.944528   40871 api_server.go:166] Checking apiserver status ...

	I0429 00:03:31.944571   40871 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:03:31.965259   40871 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:03:31.976273   40871 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:03:31.976320   40871 ssh_runner.go:195] Run: ls

	I0429 00:03:31.981405   40871 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:03:31.988215   40871 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:03:31.988235   40871 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:03:31.988245   40871 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:03:31.988630   40871 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:03:31.989128   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:31.989164   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:32.004697   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37363

	I0429 00:03:32.005188   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:32.005615   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:32.005635   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:32.005971   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:32.006180   40871 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:03:32.007639   40871 status.go:330] ha-274394-m02 host status = "Running" (err=<nil>)

	I0429 00:03:32.007653   40871 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:03:32.007910   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:32.007940   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:32.022171   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42773

	I0429 00:03:32.022588   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:32.023056   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:32.023082   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:32.023414   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:32.023574   40871 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0429 00:03:32.026004   40871 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:32.026442   40871 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:03:32.026469   40871 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:32.026550   40871 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:03:32.026822   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:32.026858   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:32.041651   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43341

	I0429 00:03:32.042055   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:32.042502   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:32.042525   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:32.042801   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:32.042995   40871 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:03:32.043153   40871 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:03:32.043169   40871 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:03:32.045771   40871 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:32.046192   40871 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:03:32.046217   40871 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:32.046375   40871 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:03:32.046522   40871 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:03:32.046667   40871 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:03:32.046753   40871 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	W0429 00:03:50.534198   40871 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:03:50.534289   40871 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	E0429 00:03:50.534304   40871 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:03:50.534311   40871 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 00:03:50.534329   40871 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:03:50.534336   40871 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:03:50.534712   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:50.534760   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:50.549671   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41131

	I0429 00:03:50.550094   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:50.550585   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:50.550611   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:50.550927   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:50.551124   40871 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:03:50.552819   40871 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:03:50.552832   40871 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:03:50.553144   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:50.553186   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:50.567804   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38273

	I0429 00:03:50.568165   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:50.568667   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:50.568687   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:50.568957   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:50.569130   40871 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:03:50.571320   40871 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:50.571724   40871 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:03:50.571751   40871 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:50.571851   40871 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:03:50.572227   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:50.572296   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:50.585906   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36893

	I0429 00:03:50.586296   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:50.586747   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:50.586769   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:50.587030   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:50.587217   40871 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:03:50.587389   40871 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:03:50.587408   40871 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:03:50.589853   40871 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:50.590237   40871 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:03:50.590264   40871 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:50.590389   40871 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:03:50.590559   40871 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:03:50.590708   40871 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:03:50.590819   40871 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:03:50.679783   40871 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:03:50.699022   40871 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:03:50.699050   40871 api_server.go:166] Checking apiserver status ...

	I0429 00:03:50.699089   40871 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:03:50.717524   40871 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:03:50.727767   40871 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:03:50.727835   40871 ssh_runner.go:195] Run: ls

	I0429 00:03:50.732913   40871 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:03:50.738840   40871 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:03:50.738865   40871 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:03:50.738891   40871 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:03:50.738917   40871 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:03:50.739211   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:50.739258   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:50.754082   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44249

	I0429 00:03:50.754532   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:50.754951   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:50.754977   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:50.755258   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:50.755457   40871 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:03:50.757004   40871 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:03:50.757032   40871 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:03:50.757302   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:50.757350   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:50.772173   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44753

	I0429 00:03:50.772632   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:50.773137   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:50.773163   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:50.773474   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:50.773666   40871 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:03:50.776211   40871 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:03:50.776670   40871 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:03:50.776719   40871 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:03:50.776830   40871 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:03:50.777120   40871 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:50.777156   40871 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:50.792047   40871 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45355

	I0429 00:03:50.792534   40871 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:50.793111   40871 main.go:141] libmachine: Using API Version  1

	I0429 00:03:50.793140   40871 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:50.793482   40871 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:50.793727   40871 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:03:50.793923   40871 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:03:50.793942   40871 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:03:50.796778   40871 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:03:50.797177   40871 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:03:50.797204   40871 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:03:50.797285   40871 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:03:50.797450   40871 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:03:50.797624   40871 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:03:50.797754   40871 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:03:50.884394   40871 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:03:50.904289   40871 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:372: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr" : exit status 3

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-274394 -n ha-274394

helpers_test.go:244: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-274394 logs -n 25: (1.574243163s)

helpers_test.go:252: TestMultiControlPlane/serial/StopSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-274394 cp ha-274394-m03:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile3174175435/001/cp-test_ha-274394-m03.txt |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m03:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394:/home/docker/cp-test_ha-274394-m03_ha-274394.txt                       |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394 sudo cat                                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m03_ha-274394.txt                                 |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m03:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m02:/home/docker/cp-test_ha-274394-m03_ha-274394-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m02 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m03_ha-274394-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m03:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04:/home/docker/cp-test_ha-274394-m03_ha-274394-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m04 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m03_ha-274394-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-274394 cp testdata/cp-test.txt                                                | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile3174175435/001/cp-test_ha-274394-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394:/home/docker/cp-test_ha-274394-m04_ha-274394.txt                       |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394 sudo cat                                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m04_ha-274394.txt                                 |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m02:/home/docker/cp-test_ha-274394-m04_ha-274394-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m02 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m04_ha-274394-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03:/home/docker/cp-test_ha-274394-m04_ha-274394-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m03 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m04_ha-274394-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-274394 node stop m02 -v=7                                                     | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/04/28 23:56:44

	Running on machine: ubuntu-20-agent-10

	Binary: Built with gc go1.22.1 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0428 23:56:44.603247   36356 out.go:291] Setting OutFile to fd 1 ...

	I0428 23:56:44.603339   36356 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0428 23:56:44.603350   36356 out.go:304] Setting ErrFile to fd 2...

	I0428 23:56:44.603354   36356 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0428 23:56:44.603524   36356 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0428 23:56:44.604037   36356 out.go:298] Setting JSON to false

	I0428 23:56:44.604835   36356 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5949,"bootTime":1714342656,"procs":177,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0428 23:56:44.604886   36356 start.go:139] virtualization: kvm guest

	I0428 23:56:44.607006   36356 out.go:177] * [ha-274394] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	I0428 23:56:44.608416   36356 notify.go:220] Checking for updates...

	I0428 23:56:44.609889   36356 out.go:177]   - MINIKUBE_LOCATION=17977

	I0428 23:56:44.611307   36356 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0428 23:56:44.612625   36356 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:56:44.613862   36356 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:56:44.615062   36356 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0428 23:56:44.616343   36356 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0428 23:56:44.617967   36356 driver.go:392] Setting default libvirt URI to qemu:///system

	I0428 23:56:44.652686   36356 out.go:177] * Using the kvm2 driver based on user configuration

	I0428 23:56:44.653931   36356 start.go:297] selected driver: kvm2

	I0428 23:56:44.653943   36356 start.go:901] validating driver "kvm2" against <nil>

	I0428 23:56:44.653953   36356 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0428 23:56:44.654662   36356 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0428 23:56:44.654727   36356 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17977-13393/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0428 23:56:44.669647   36356 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0

	I0428 23:56:44.669711   36356 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0428 23:56:44.669935   36356 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0428 23:56:44.669992   36356 cni.go:84] Creating CNI manager for ""

	I0428 23:56:44.670004   36356 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0428 23:56:44.670008   36356 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0428 23:56:44.670095   36356 start.go:340] cluster config:

	{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0428 23:56:44.670188   36356 iso.go:125] acquiring lock: {Name:mkdac29be984af97898eb097bf04b319c0b5a23b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0428 23:56:44.672641   36356 out.go:177] * Starting "ha-274394" primary control-plane node in "ha-274394" cluster

	I0428 23:56:44.673990   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:56:44.674079   36356 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4

	I0428 23:56:44.674091   36356 cache.go:56] Caching tarball of preloaded images

	I0428 23:56:44.674167   36356 preload.go:173] Found /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0428 23:56:44.674177   36356 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0428 23:56:44.674499   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:56:44.674522   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json: {Name:mka29a6cba1291c4c68f145dccef6ba110940a93 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:56:44.674652   36356 start.go:360] acquireMachinesLock for ha-274394: {Name:mkf607109012ed2f4aeb283e90eb20782d746716 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0428 23:56:44.674679   36356 start.go:364] duration metric: took 14.805µs to acquireMachinesLock for "ha-274394"

	I0428 23:56:44.674692   36356 start.go:93] Provisioning new machine with config: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:56:44.674751   36356 start.go:125] createHost starting for "" (driver="kvm2")

	I0428 23:56:44.676337   36356 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0428 23:56:44.676466   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:56:44.676503   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:56:44.690945   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37491

	I0428 23:56:44.691290   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:56:44.691875   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:56:44.691902   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:56:44.692184   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:56:44.692373   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:56:44.692481   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:56:44.692639   36356 start.go:159] libmachine.API.Create for "ha-274394" (driver="kvm2")

	I0428 23:56:44.692672   36356 client.go:168] LocalClient.Create starting

	I0428 23:56:44.692707   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem

	I0428 23:56:44.692765   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:56:44.692791   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:56:44.692853   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem

	I0428 23:56:44.692882   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:56:44.692901   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:56:44.692925   36356 main.go:141] libmachine: Running pre-create checks...

	I0428 23:56:44.692937   36356 main.go:141] libmachine: (ha-274394) Calling .PreCreateCheck

	I0428 23:56:44.693213   36356 main.go:141] libmachine: (ha-274394) Calling .GetConfigRaw

	I0428 23:56:44.693560   36356 main.go:141] libmachine: Creating machine...

	I0428 23:56:44.693574   36356 main.go:141] libmachine: (ha-274394) Calling .Create

	I0428 23:56:44.693695   36356 main.go:141] libmachine: (ha-274394) Creating KVM machine...

	I0428 23:56:44.694900   36356 main.go:141] libmachine: (ha-274394) DBG | found existing default KVM network

	I0428 23:56:44.695582   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:44.695473   36379 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ac0}

	I0428 23:56:44.695617   36356 main.go:141] libmachine: (ha-274394) DBG | created network xml: 

	I0428 23:56:44.695637   36356 main.go:141] libmachine: (ha-274394) DBG | <network>

	I0428 23:56:44.695651   36356 main.go:141] libmachine: (ha-274394) DBG |   <name>mk-ha-274394</name>

	I0428 23:56:44.695670   36356 main.go:141] libmachine: (ha-274394) DBG |   <dns enable='no'/>

	I0428 23:56:44.695685   36356 main.go:141] libmachine: (ha-274394) DBG |   

	I0428 23:56:44.695695   36356 main.go:141] libmachine: (ha-274394) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0428 23:56:44.695714   36356 main.go:141] libmachine: (ha-274394) DBG |     <dhcp>

	I0428 23:56:44.695730   36356 main.go:141] libmachine: (ha-274394) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0428 23:56:44.695740   36356 main.go:141] libmachine: (ha-274394) DBG |     </dhcp>

	I0428 23:56:44.695758   36356 main.go:141] libmachine: (ha-274394) DBG |   </ip>

	I0428 23:56:44.695763   36356 main.go:141] libmachine: (ha-274394) DBG |   

	I0428 23:56:44.695767   36356 main.go:141] libmachine: (ha-274394) DBG | </network>

	I0428 23:56:44.695774   36356 main.go:141] libmachine: (ha-274394) DBG | 

	I0428 23:56:44.700784   36356 main.go:141] libmachine: (ha-274394) DBG | trying to create private KVM network mk-ha-274394 192.168.39.0/24...

	I0428 23:56:44.765647   36356 main.go:141] libmachine: (ha-274394) DBG | private KVM network mk-ha-274394 192.168.39.0/24 created

	I0428 23:56:44.765680   36356 main.go:141] libmachine: (ha-274394) Setting up store path in /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394 ...

	I0428 23:56:44.765707   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:44.765600   36379 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:56:44.765726   36356 main.go:141] libmachine: (ha-274394) Building disk image from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0428 23:56:44.765810   36356 main.go:141] libmachine: (ha-274394) Downloading /home/jenkins/minikube-integration/17977-13393/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0428 23:56:44.991025   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:44.990901   36379 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa...

	I0428 23:56:45.061669   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:45.061561   36379 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/ha-274394.rawdisk...

	I0428 23:56:45.061712   36356 main.go:141] libmachine: (ha-274394) DBG | Writing magic tar header

	I0428 23:56:45.061726   36356 main.go:141] libmachine: (ha-274394) DBG | Writing SSH key tar header

	I0428 23:56:45.061742   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:45.061686   36379 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394 ...

	I0428 23:56:45.061871   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394

	I0428 23:56:45.061933   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394 (perms=drwx------)

	I0428 23:56:45.061961   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines

	I0428 23:56:45.061982   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:56:45.061998   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393

	I0428 23:56:45.062011   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines (perms=drwxr-xr-x)

	I0428 23:56:45.062043   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube (perms=drwxr-xr-x)

	I0428 23:56:45.062056   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393 (perms=drwxrwxr-x)

	I0428 23:56:45.062068   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0428 23:56:45.062082   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0428 23:56:45.062094   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins

	I0428 23:56:45.062107   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home

	I0428 23:56:45.062116   36356 main.go:141] libmachine: (ha-274394) DBG | Skipping /home - not owner

	I0428 23:56:45.062127   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0428 23:56:45.062136   36356 main.go:141] libmachine: (ha-274394) Creating domain...

	I0428 23:56:45.062965   36356 main.go:141] libmachine: (ha-274394) define libvirt domain using xml: 

	I0428 23:56:45.062990   36356 main.go:141] libmachine: (ha-274394) <domain type='kvm'>

	I0428 23:56:45.063000   36356 main.go:141] libmachine: (ha-274394)   <name>ha-274394</name>

	I0428 23:56:45.063009   36356 main.go:141] libmachine: (ha-274394)   <memory unit='MiB'>2200</memory>

	I0428 23:56:45.063020   36356 main.go:141] libmachine: (ha-274394)   <vcpu>2</vcpu>

	I0428 23:56:45.063029   36356 main.go:141] libmachine: (ha-274394)   <features>

	I0428 23:56:45.063041   36356 main.go:141] libmachine: (ha-274394)     <acpi/>

	I0428 23:56:45.063045   36356 main.go:141] libmachine: (ha-274394)     <apic/>

	I0428 23:56:45.063053   36356 main.go:141] libmachine: (ha-274394)     <pae/>

	I0428 23:56:45.063058   36356 main.go:141] libmachine: (ha-274394)     

	I0428 23:56:45.063066   36356 main.go:141] libmachine: (ha-274394)   </features>

	I0428 23:56:45.063071   36356 main.go:141] libmachine: (ha-274394)   <cpu mode='host-passthrough'>

	I0428 23:56:45.063078   36356 main.go:141] libmachine: (ha-274394)   

	I0428 23:56:45.063085   36356 main.go:141] libmachine: (ha-274394)   </cpu>

	I0428 23:56:45.063111   36356 main.go:141] libmachine: (ha-274394)   <os>

	I0428 23:56:45.063132   36356 main.go:141] libmachine: (ha-274394)     <type>hvm</type>

	I0428 23:56:45.063145   36356 main.go:141] libmachine: (ha-274394)     <boot dev='cdrom'/>

	I0428 23:56:45.063156   36356 main.go:141] libmachine: (ha-274394)     <boot dev='hd'/>

	I0428 23:56:45.063168   36356 main.go:141] libmachine: (ha-274394)     <bootmenu enable='no'/>

	I0428 23:56:45.063177   36356 main.go:141] libmachine: (ha-274394)   </os>

	I0428 23:56:45.063188   36356 main.go:141] libmachine: (ha-274394)   <devices>

	I0428 23:56:45.063199   36356 main.go:141] libmachine: (ha-274394)     <disk type='file' device='cdrom'>

	I0428 23:56:45.063232   36356 main.go:141] libmachine: (ha-274394)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/boot2docker.iso'/>

	I0428 23:56:45.063257   36356 main.go:141] libmachine: (ha-274394)       <target dev='hdc' bus='scsi'/>

	I0428 23:56:45.063269   36356 main.go:141] libmachine: (ha-274394)       <readonly/>

	I0428 23:56:45.063287   36356 main.go:141] libmachine: (ha-274394)     </disk>

	I0428 23:56:45.063297   36356 main.go:141] libmachine: (ha-274394)     <disk type='file' device='disk'>

	I0428 23:56:45.063303   36356 main.go:141] libmachine: (ha-274394)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0428 23:56:45.063311   36356 main.go:141] libmachine: (ha-274394)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/ha-274394.rawdisk'/>

	I0428 23:56:45.063319   36356 main.go:141] libmachine: (ha-274394)       <target dev='hda' bus='virtio'/>

	I0428 23:56:45.063323   36356 main.go:141] libmachine: (ha-274394)     </disk>

	I0428 23:56:45.063332   36356 main.go:141] libmachine: (ha-274394)     <interface type='network'>

	I0428 23:56:45.063338   36356 main.go:141] libmachine: (ha-274394)       <source network='mk-ha-274394'/>

	I0428 23:56:45.063344   36356 main.go:141] libmachine: (ha-274394)       <model type='virtio'/>

	I0428 23:56:45.063349   36356 main.go:141] libmachine: (ha-274394)     </interface>

	I0428 23:56:45.063359   36356 main.go:141] libmachine: (ha-274394)     <interface type='network'>

	I0428 23:56:45.063379   36356 main.go:141] libmachine: (ha-274394)       <source network='default'/>

	I0428 23:56:45.063391   36356 main.go:141] libmachine: (ha-274394)       <model type='virtio'/>

	I0428 23:56:45.063403   36356 main.go:141] libmachine: (ha-274394)     </interface>

	I0428 23:56:45.063417   36356 main.go:141] libmachine: (ha-274394)     <serial type='pty'>

	I0428 23:56:45.063428   36356 main.go:141] libmachine: (ha-274394)       <target port='0'/>

	I0428 23:56:45.063437   36356 main.go:141] libmachine: (ha-274394)     </serial>

	I0428 23:56:45.063445   36356 main.go:141] libmachine: (ha-274394)     <console type='pty'>

	I0428 23:56:45.063455   36356 main.go:141] libmachine: (ha-274394)       <target type='serial' port='0'/>

	I0428 23:56:45.063474   36356 main.go:141] libmachine: (ha-274394)     </console>

	I0428 23:56:45.063484   36356 main.go:141] libmachine: (ha-274394)     <rng model='virtio'>

	I0428 23:56:45.063512   36356 main.go:141] libmachine: (ha-274394)       <backend model='random'>/dev/random</backend>

	I0428 23:56:45.063538   36356 main.go:141] libmachine: (ha-274394)     </rng>

	I0428 23:56:45.063550   36356 main.go:141] libmachine: (ha-274394)     

	I0428 23:56:45.063572   36356 main.go:141] libmachine: (ha-274394)     

	I0428 23:56:45.063584   36356 main.go:141] libmachine: (ha-274394)   </devices>

	I0428 23:56:45.063593   36356 main.go:141] libmachine: (ha-274394) </domain>

	I0428 23:56:45.063601   36356 main.go:141] libmachine: (ha-274394) 

	I0428 23:56:45.067836   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a6:1d:f8 in network default

	I0428 23:56:45.068304   36356 main.go:141] libmachine: (ha-274394) Ensuring networks are active...

	I0428 23:56:45.068323   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:45.068905   36356 main.go:141] libmachine: (ha-274394) Ensuring network default is active

	I0428 23:56:45.069173   36356 main.go:141] libmachine: (ha-274394) Ensuring network mk-ha-274394 is active

	I0428 23:56:45.069648   36356 main.go:141] libmachine: (ha-274394) Getting domain xml...

	I0428 23:56:45.070358   36356 main.go:141] libmachine: (ha-274394) Creating domain...

	I0428 23:56:46.229124   36356 main.go:141] libmachine: (ha-274394) Waiting to get IP...

	I0428 23:56:46.229873   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:46.230293   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:46.230321   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:46.230266   36379 retry.go:31] will retry after 256.079887ms: waiting for machine to come up

	I0428 23:56:46.487746   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:46.488167   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:46.488190   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:46.488135   36379 retry.go:31] will retry after 259.573037ms: waiting for machine to come up

	I0428 23:56:46.749564   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:46.749940   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:46.749971   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:46.749894   36379 retry.go:31] will retry after 421.248911ms: waiting for machine to come up

	I0428 23:56:47.172578   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:47.173101   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:47.173132   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:47.173077   36379 retry.go:31] will retry after 446.554138ms: waiting for machine to come up

	I0428 23:56:47.621636   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:47.622039   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:47.622068   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:47.621985   36379 retry.go:31] will retry after 623.05137ms: waiting for machine to come up

	I0428 23:56:48.246898   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:48.247325   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:48.247347   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:48.247304   36379 retry.go:31] will retry after 674.412309ms: waiting for machine to come up

	I0428 23:56:48.922759   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:48.923073   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:48.923103   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:48.923031   36379 retry.go:31] will retry after 750.488538ms: waiting for machine to come up

	I0428 23:56:49.675196   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:49.675579   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:49.675614   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:49.675525   36379 retry.go:31] will retry after 1.274430052s: waiting for machine to come up

	I0428 23:56:50.951373   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:50.951753   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:50.951780   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:50.951712   36379 retry.go:31] will retry after 1.440496033s: waiting for machine to come up

	I0428 23:56:52.393417   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:52.393792   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:52.393814   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:52.393746   36379 retry.go:31] will retry after 2.10240003s: waiting for machine to come up

	I0428 23:56:54.497430   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:54.497829   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:54.497858   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:54.497777   36379 retry.go:31] will retry after 1.935763747s: waiting for machine to come up

	I0428 23:56:56.434877   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:56.435313   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:56.435343   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:56.435254   36379 retry.go:31] will retry after 2.246149526s: waiting for machine to come up

	I0428 23:56:58.684702   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:58.685119   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:58.685143   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:58.685091   36379 retry.go:31] will retry after 2.753267841s: waiting for machine to come up

	I0428 23:57:01.439496   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:01.439726   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:57:01.439748   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:57:01.439695   36379 retry.go:31] will retry after 4.35224695s: waiting for machine to come up

	I0428 23:57:05.794060   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.794442   36356 main.go:141] libmachine: (ha-274394) Found IP for machine: 192.168.39.237

	I0428 23:57:05.794467   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has current primary IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.794476   36356 main.go:141] libmachine: (ha-274394) Reserving static IP address...

	I0428 23:57:05.794825   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find host DHCP lease matching {name: "ha-274394", mac: "52:54:00:a1:02:06", ip: "192.168.39.237"} in network mk-ha-274394

	I0428 23:57:05.865762   36356 main.go:141] libmachine: (ha-274394) DBG | Getting to WaitForSSH function...

	I0428 23:57:05.865787   36356 main.go:141] libmachine: (ha-274394) Reserved static IP address: 192.168.39.237

	I0428 23:57:05.865796   36356 main.go:141] libmachine: (ha-274394) Waiting for SSH to be available...

	I0428 23:57:05.868238   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.868679   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:minikube Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:05.868710   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.868753   36356 main.go:141] libmachine: (ha-274394) DBG | Using SSH client type: external

	I0428 23:57:05.868785   36356 main.go:141] libmachine: (ha-274394) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa (-rw-------)

	I0428 23:57:05.868821   36356 main.go:141] libmachine: (ha-274394) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.237 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:57:05.868837   36356 main.go:141] libmachine: (ha-274394) DBG | About to run SSH command:

	I0428 23:57:05.868862   36356 main.go:141] libmachine: (ha-274394) DBG | exit 0

	I0428 23:57:05.995181   36356 main.go:141] libmachine: (ha-274394) DBG | SSH cmd err, output: <nil>: 

	I0428 23:57:05.995442   36356 main.go:141] libmachine: (ha-274394) KVM machine creation complete!

	I0428 23:57:05.995758   36356 main.go:141] libmachine: (ha-274394) Calling .GetConfigRaw

	I0428 23:57:05.996317   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:05.996503   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:05.996642   36356 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0428 23:57:05.996686   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:05.998130   36356 main.go:141] libmachine: Detecting operating system of created instance...

	I0428 23:57:05.998147   36356 main.go:141] libmachine: Waiting for SSH to be available...

	I0428 23:57:05.998155   36356 main.go:141] libmachine: Getting to WaitForSSH function...

	I0428 23:57:05.998161   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.000506   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.000786   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.000807   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.001000   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.001156   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.001304   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.001400   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.001519   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.001696   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.001705   36356 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0428 23:57:06.105745   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:57:06.105775   36356 main.go:141] libmachine: Detecting the provisioner...

	I0428 23:57:06.105785   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.108180   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.108463   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.108483   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.108623   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.108837   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.108991   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.109095   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.109257   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.109433   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.109445   36356 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0428 23:57:06.219616   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0428 23:57:06.219678   36356 main.go:141] libmachine: found compatible host: buildroot

	I0428 23:57:06.219688   36356 main.go:141] libmachine: Provisioning with buildroot...

	I0428 23:57:06.219711   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:57:06.219970   36356 buildroot.go:166] provisioning hostname "ha-274394"

	I0428 23:57:06.219993   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:57:06.220152   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.222516   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.222928   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.222956   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.223088   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.223273   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.223400   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.223530   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.223732   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.223884   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.223895   36356 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-274394 && echo "ha-274394" | sudo tee /etc/hostname

	I0428 23:57:06.346120   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-274394

	I0428 23:57:06.346147   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.348916   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.349259   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.349290   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.349437   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.349605   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.349770   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.349918   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.350107   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.350259   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.350280   36356 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-274394' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-274394/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-274394' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0428 23:57:06.464092   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:57:06.464118   36356 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17977-13393/.minikube CaCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17977-13393/.minikube}

	I0428 23:57:06.464151   36356 buildroot.go:174] setting up certificates

	I0428 23:57:06.464163   36356 provision.go:84] configureAuth start

	I0428 23:57:06.464185   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:57:06.464469   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:06.467030   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.467355   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.467387   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.467540   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.470563   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.470888   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.470907   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.471082   36356 provision.go:143] copyHostCerts

	I0428 23:57:06.471126   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:57:06.471183   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem, removing ...

	I0428 23:57:06.471207   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:57:06.471291   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem (1675 bytes)

	I0428 23:57:06.471386   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:57:06.471410   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem, removing ...

	I0428 23:57:06.471420   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:57:06.471456   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem (1082 bytes)

	I0428 23:57:06.471517   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:57:06.471540   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem, removing ...

	I0428 23:57:06.471549   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:57:06.471584   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem (1123 bytes)

	I0428 23:57:06.471645   36356 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem org=jenkins.ha-274394 san=[127.0.0.1 192.168.39.237 ha-274394 localhost minikube]

	I0428 23:57:06.573643   36356 provision.go:177] copyRemoteCerts

	I0428 23:57:06.573696   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0428 23:57:06.573720   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.576152   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.576514   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.576544   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.576665   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.576843   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.577001   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.577123   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:06.663863   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0428 23:57:06.663955   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0428 23:57:06.694572   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0428 23:57:06.694632   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0428 23:57:06.722982   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0428 23:57:06.723037   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0428 23:57:06.751340   36356 provision.go:87] duration metric: took 287.163137ms to configureAuth

	I0428 23:57:06.751365   36356 buildroot.go:189] setting minikube options for container-runtime

	I0428 23:57:06.751508   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:57:06.751564   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.753881   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.754233   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.754262   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.754433   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.754591   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.754749   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.754852   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.754990   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.755149   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.755166   36356 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0428 23:57:07.035413   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0428 23:57:07.035450   36356 main.go:141] libmachine: Checking connection to Docker...

	I0428 23:57:07.035475   36356 main.go:141] libmachine: (ha-274394) Calling .GetURL

	I0428 23:57:07.036800   36356 main.go:141] libmachine: (ha-274394) DBG | Using libvirt version 6000000

	I0428 23:57:07.038840   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.039121   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.039148   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.039301   36356 main.go:141] libmachine: Docker is up and running!

	I0428 23:57:07.039313   36356 main.go:141] libmachine: Reticulating splines...

	I0428 23:57:07.039321   36356 client.go:171] duration metric: took 22.346638475s to LocalClient.Create

	I0428 23:57:07.039346   36356 start.go:167] duration metric: took 22.346709049s to libmachine.API.Create "ha-274394"

	I0428 23:57:07.039358   36356 start.go:293] postStartSetup for "ha-274394" (driver="kvm2")

	I0428 23:57:07.039372   36356 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0428 23:57:07.039392   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.039621   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0428 23:57:07.039654   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.041418   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.041695   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.041721   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.041838   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.042035   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.042193   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.042358   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:07.126553   36356 ssh_runner.go:195] Run: cat /etc/os-release

	I0428 23:57:07.131394   36356 info.go:137] Remote host: Buildroot 2023.02.9

	I0428 23:57:07.131418   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/addons for local assets ...

	I0428 23:57:07.131489   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/files for local assets ...

	I0428 23:57:07.131582   36356 filesync.go:149] local asset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> 207272.pem in /etc/ssl/certs

	I0428 23:57:07.131595   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /etc/ssl/certs/207272.pem

	I0428 23:57:07.131731   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0428 23:57:07.143264   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:57:07.169021   36356 start.go:296] duration metric: took 129.64708ms for postStartSetup

	I0428 23:57:07.169063   36356 main.go:141] libmachine: (ha-274394) Calling .GetConfigRaw

	I0428 23:57:07.169591   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:07.172044   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.172385   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.172414   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.172640   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:57:07.172823   36356 start.go:128] duration metric: took 22.49806301s to createHost

	I0428 23:57:07.172850   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.174730   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.175018   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.175039   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.175144   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.175354   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.175490   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.175622   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.175762   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:07.175912   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:07.175931   36356 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0428 23:57:07.283490   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714348627.250495573

	I0428 23:57:07.283513   36356 fix.go:216] guest clock: 1714348627.250495573

	I0428 23:57:07.283522   36356 fix.go:229] Guest: 2024-04-28 23:57:07.250495573 +0000 UTC Remote: 2024-04-28 23:57:07.172835932 +0000 UTC m=+22.618724383 (delta=77.659641ms)

	I0428 23:57:07.283564   36356 fix.go:200] guest clock delta is within tolerance: 77.659641ms

	I0428 23:57:07.283580   36356 start.go:83] releasing machines lock for "ha-274394", held for 22.608884768s

	I0428 23:57:07.283601   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.283905   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:07.286602   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.286951   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.286996   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.287152   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.287670   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.287826   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.287894   36356 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0428 23:57:07.287938   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.288038   36356 ssh_runner.go:195] Run: cat /version.json

	I0428 23:57:07.288059   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.290428   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.290560   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.290791   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.290816   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.290941   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.290945   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.291032   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.291107   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.291130   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.291298   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.291309   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.291469   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:07.291526   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.291680   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:07.367832   36356 ssh_runner.go:195] Run: systemctl --version

	I0428 23:57:07.389909   36356 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0428 23:57:07.553715   36356 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0428 23:57:07.560656   36356 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0428 23:57:07.560728   36356 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0428 23:57:07.580243   36356 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0428 23:57:07.580269   36356 start.go:494] detecting cgroup driver to use...

	I0428 23:57:07.580352   36356 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0428 23:57:07.597855   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0428 23:57:07.614447   36356 docker.go:217] disabling cri-docker service (if available) ...

	I0428 23:57:07.614507   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0428 23:57:07.630137   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0428 23:57:07.646659   36356 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0428 23:57:07.770067   36356 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0428 23:57:07.939717   36356 docker.go:233] disabling docker service ...

	I0428 23:57:07.939790   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0428 23:57:07.956532   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0428 23:57:07.970431   36356 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0428 23:57:08.090398   36356 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0428 23:57:08.208133   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0428 23:57:08.222537   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0428 23:57:08.243672   36356 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0428 23:57:08.243746   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.254760   36356 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0428 23:57:08.254827   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.265802   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.276580   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.287357   36356 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0428 23:57:08.298925   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.310180   36356 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.329330   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.340865   36356 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0428 23:57:08.350992   36356 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0428 23:57:08.351099   36356 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0428 23:57:08.365295   36356 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0428 23:57:08.375416   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:57:08.489130   36356 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0428 23:57:08.627175   36356 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0428 23:57:08.627252   36356 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0428 23:57:08.632940   36356 start.go:562] Will wait 60s for crictl version

	I0428 23:57:08.633035   36356 ssh_runner.go:195] Run: which crictl

	I0428 23:57:08.637726   36356 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0428 23:57:08.688300   36356 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0428 23:57:08.688414   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:57:08.718921   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:57:08.752722   36356 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0428 23:57:08.754156   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:08.756290   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:08.756627   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:08.756654   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:08.756870   36356 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0428 23:57:08.761473   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:57:08.776539   36356 kubeadm.go:877] updating cluster {Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cl

usterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0428 23:57:08.776707   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:57:08.776777   36356 ssh_runner.go:195] Run: sudo crictl images --output json

	I0428 23:57:08.813688   36356 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0". assuming images are not preloaded.

	I0428 23:57:08.813765   36356 ssh_runner.go:195] Run: which lz4

	I0428 23:57:08.818304   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0428 23:57:08.818436   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0428 23:57:08.823568   36356 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0428 23:57:08.823596   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394544937 bytes)

	I0428 23:57:10.542324   36356 crio.go:462] duration metric: took 1.723924834s to copy over tarball

	I0428 23:57:10.542410   36356 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0428 23:57:13.112112   36356 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.569667818s)

	I0428 23:57:13.112142   36356 crio.go:469] duration metric: took 2.569786929s to extract the tarball

	I0428 23:57:13.112149   36356 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0428 23:57:13.152213   36356 ssh_runner.go:195] Run: sudo crictl images --output json

	I0428 23:57:13.202989   36356 crio.go:514] all images are preloaded for cri-o runtime.

	I0428 23:57:13.203014   36356 cache_images.go:84] Images are preloaded, skipping loading

	I0428 23:57:13.203023   36356 kubeadm.go:928] updating node { 192.168.39.237 8443 v1.30.0 crio true true} ...

	I0428 23:57:13.203155   36356 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-274394 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.237

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0428 23:57:13.203239   36356 ssh_runner.go:195] Run: crio config

	I0428 23:57:13.256369   36356 cni.go:84] Creating CNI manager for ""

	I0428 23:57:13.256390   36356 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0428 23:57:13.256398   36356 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0428 23:57:13.256417   36356 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.237 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-274394 NodeName:ha-274394 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.237"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.237 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0428 23:57:13.256553   36356 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.237

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-274394"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.237

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.237"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0428 23:57:13.256576   36356 kube-vip.go:111] generating kube-vip config ...

	I0428 23:57:13.256610   36356 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0428 23:57:13.276673   36356 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0428 23:57:13.276754   36356 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0428 23:57:13.276809   36356 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0428 23:57:13.289710   36356 binaries.go:44] Found k8s binaries, skipping transfer

	I0428 23:57:13.289767   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0428 23:57:13.302563   36356 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0428 23:57:13.323639   36356 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0428 23:57:13.343843   36356 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0428 23:57:13.363730   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1352 bytes)

	I0428 23:57:13.384050   36356 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0428 23:57:13.388734   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:57:13.404951   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:57:13.547364   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:57:13.573283   36356 certs.go:68] Setting up /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394 for IP: 192.168.39.237

	I0428 23:57:13.573311   36356 certs.go:194] generating shared ca certs ...

	I0428 23:57:13.573326   36356 certs.go:226] acquiring lock for ca certs: {Name:mka5d31eea282c20e045cfb5e09273edc965e467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.573483   36356 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key

	I0428 23:57:13.573525   36356 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key

	I0428 23:57:13.573535   36356 certs.go:256] generating profile certs ...

	I0428 23:57:13.573586   36356 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key

	I0428 23:57:13.573615   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt with IP's: []

	I0428 23:57:13.648288   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt ...

	I0428 23:57:13.648320   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt: {Name:mk32ae7dfd9f9a702d9db8b5322b2bf08a48e9fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.648491   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key ...

	I0428 23:57:13.648503   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key: {Name:mk3088da440752b13c33384f2e40d936a105f5d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.648587   36356 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582

	I0428 23:57:13.648604   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.237 192.168.39.254]

	I0428 23:57:13.811379   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582 ...

	I0428 23:57:13.811407   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582: {Name:mkec37f4828f6d0d617a8817ad0cb65319dfc837 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.811571   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582 ...

	I0428 23:57:13.811589   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582: {Name:mk3bb5ee50351cf2b6f1de8651fd8346e52caf40 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.811694   36356 certs.go:381] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt

	I0428 23:57:13.811784   36356 certs.go:385] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key

	I0428 23:57:13.811836   36356 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key

	I0428 23:57:13.811856   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt with IP's: []

	I0428 23:57:14.027352   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt ...

	I0428 23:57:14.027379   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt: {Name:mkf2b62fd6e6eae93da857bc5cdce5be75eb4616 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:14.027538   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key ...

	I0428 23:57:14.027550   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key: {Name:mkca8eb4eb8045104b93c56b349092a4368aa735 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:14.027645   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0428 23:57:14.027664   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0428 23:57:14.027680   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0428 23:57:14.027695   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0428 23:57:14.027706   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0428 23:57:14.027720   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0428 23:57:14.027732   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0428 23:57:14.027743   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0428 23:57:14.027789   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem (1338 bytes)

	W0428 23:57:14.027820   36356 certs.go:480] ignoring /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727_empty.pem, impossibly tiny 0 bytes

	I0428 23:57:14.027829   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem (1675 bytes)

	I0428 23:57:14.027856   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem (1082 bytes)

	I0428 23:57:14.027877   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem (1123 bytes)

	I0428 23:57:14.027897   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem (1675 bytes)

	I0428 23:57:14.027934   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:57:14.027960   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.027974   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem -> /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.027986   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.028516   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0428 23:57:14.056477   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0428 23:57:14.083299   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0428 23:57:14.110784   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0428 23:57:14.138763   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0428 23:57:14.165666   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0428 23:57:14.193648   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0428 23:57:14.223287   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0428 23:57:14.253425   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0428 23:57:14.284140   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem --> /usr/share/ca-certificates/20727.pem (1338 bytes)

	I0428 23:57:14.314319   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /usr/share/ca-certificates/207272.pem (1708 bytes)

	I0428 23:57:14.343119   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0428 23:57:14.364726   36356 ssh_runner.go:195] Run: openssl version

	I0428 23:57:14.375141   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0428 23:57:14.395577   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.401302   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 28 23:08 /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.401384   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.410279   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0428 23:57:14.425476   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20727.pem && ln -fs /usr/share/ca-certificates/20727.pem /etc/ssl/certs/20727.pem"

	I0428 23:57:14.438080   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.442930   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 28 23:49 /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.442975   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.449030   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20727.pem /etc/ssl/certs/51391683.0"

	I0428 23:57:14.461177   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/207272.pem && ln -fs /usr/share/ca-certificates/207272.pem /etc/ssl/certs/207272.pem"

	I0428 23:57:14.473485   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.478398   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 28 23:49 /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.478444   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.484622   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/207272.pem /etc/ssl/certs/3ec20f2e.0"

	I0428 23:57:14.497144   36356 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0428 23:57:14.501613   36356 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0428 23:57:14.501664   36356 kubeadm.go:391] StartCluster: {Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Clust

erName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:57:14.501755   36356 cri.go:56] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0428 23:57:14.501787   36356 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0428 23:57:14.548339   36356 cri.go:91] found id: ""

	I0428 23:57:14.548426   36356 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0428 23:57:14.560473   36356 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0428 23:57:14.572795   36356 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0428 23:57:14.584608   36356 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0428 23:57:14.584629   36356 kubeadm.go:156] found existing configuration files:

	I0428 23:57:14.584677   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0428 23:57:14.595801   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0428 23:57:14.595872   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0428 23:57:14.608553   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0428 23:57:14.805450   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0428 23:57:14.805508   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0428 23:57:14.816940   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0428 23:57:14.827476   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0428 23:57:14.827533   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0428 23:57:14.838818   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0428 23:57:14.849316   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0428 23:57:14.849374   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0428 23:57:14.860533   36356 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0428 23:57:14.970911   36356 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0

	I0428 23:57:14.971092   36356 kubeadm.go:309] [preflight] Running pre-flight checks

	I0428 23:57:15.140642   36356 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0428 23:57:15.140791   36356 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0428 23:57:15.140938   36356 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0428 23:57:15.402735   36356 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0428 23:57:15.581497   36356 out.go:204]   - Generating certificates and keys ...

	I0428 23:57:15.581620   36356 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0428 23:57:15.581696   36356 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0428 23:57:15.581791   36356 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0428 23:57:15.742471   36356 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0428 23:57:15.880482   36356 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0428 23:57:16.079408   36356 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0428 23:57:16.265709   36356 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0428 23:57:16.265929   36356 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-274394 localhost] and IPs [192.168.39.237 127.0.0.1 ::1]

	I0428 23:57:16.377253   36356 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0428 23:57:16.377392   36356 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-274394 localhost] and IPs [192.168.39.237 127.0.0.1 ::1]

	I0428 23:57:16.568167   36356 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0428 23:57:16.755727   36356 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0428 23:57:17.068472   36356 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0428 23:57:17.068836   36356 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0428 23:57:17.224359   36356 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0428 23:57:17.587671   36356 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0428 23:57:17.762573   36356 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0428 23:57:17.944221   36356 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0428 23:57:18.245238   36356 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0428 23:57:18.245785   36356 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0428 23:57:18.249440   36356 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0428 23:57:18.251518   36356 out.go:204]   - Booting up control plane ...

	I0428 23:57:18.251619   36356 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0428 23:57:18.251797   36356 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0428 23:57:18.252676   36356 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0428 23:57:18.269919   36356 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0428 23:57:18.270872   36356 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0428 23:57:18.270967   36356 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0428 23:57:18.409785   36356 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0428 23:57:18.409916   36356 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0428 23:57:19.408097   36356 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.001619721s

	I0428 23:57:19.408195   36356 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0428 23:57:25.389394   36356 kubeadm.go:309] [api-check] The API server is healthy after 5.984864862s

	I0428 23:57:25.404982   36356 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0428 23:57:25.422266   36356 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0428 23:57:25.456777   36356 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0428 23:57:25.456979   36356 kubeadm.go:309] [mark-control-plane] Marking the node ha-274394 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0428 23:57:25.476230   36356 kubeadm.go:309] [bootstrap-token] Using token: p7cwcq.w3fzbiomge83y6x5

	I0428 23:57:25.477875   36356 out.go:204]   - Configuring RBAC rules ...

	I0428 23:57:25.478055   36356 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0428 23:57:25.485371   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0428 23:57:25.497525   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0428 23:57:25.502880   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0428 23:57:25.507998   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0428 23:57:25.515623   36356 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0428 23:57:25.797907   36356 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0428 23:57:26.231776   36356 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0428 23:57:26.796535   36356 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0428 23:57:26.797290   36356 kubeadm.go:309] 

	I0428 23:57:26.797374   36356 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0428 23:57:26.797385   36356 kubeadm.go:309] 

	I0428 23:57:26.797496   36356 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0428 23:57:26.797518   36356 kubeadm.go:309] 

	I0428 23:57:26.797583   36356 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0428 23:57:26.797662   36356 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0428 23:57:26.797737   36356 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0428 23:57:26.797770   36356 kubeadm.go:309] 

	I0428 23:57:26.797838   36356 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0428 23:57:26.797857   36356 kubeadm.go:309] 

	I0428 23:57:26.797939   36356 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0428 23:57:26.797950   36356 kubeadm.go:309] 

	I0428 23:57:26.798054   36356 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0428 23:57:26.798154   36356 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0428 23:57:26.798260   36356 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0428 23:57:26.798268   36356 kubeadm.go:309] 

	I0428 23:57:26.798355   36356 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0428 23:57:26.798421   36356 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0428 23:57:26.798427   36356 kubeadm.go:309] 

	I0428 23:57:26.798493   36356 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token p7cwcq.w3fzbiomge83y6x5 \

	I0428 23:57:26.798582   36356 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 \

	I0428 23:57:26.798602   36356 kubeadm.go:309] 	--control-plane 

	I0428 23:57:26.798608   36356 kubeadm.go:309] 

	I0428 23:57:26.798682   36356 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0428 23:57:26.798693   36356 kubeadm.go:309] 

	I0428 23:57:26.798806   36356 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token p7cwcq.w3fzbiomge83y6x5 \

	I0428 23:57:26.798954   36356 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 

	I0428 23:57:26.799378   36356 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0428 23:57:26.799459   36356 cni.go:84] Creating CNI manager for ""

	I0428 23:57:26.799472   36356 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0428 23:57:26.801505   36356 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0428 23:57:26.802707   36356 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0428 23:57:26.808925   36356 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.0/kubectl ...

	I0428 23:57:26.808943   36356 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0428 23:57:26.834378   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0428 23:57:27.201663   36356 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0428 23:57:27.201739   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:27.201741   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-274394 minikube.k8s.io/updated_at=2024_04_28T23_57_27_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328 minikube.k8s.io/name=ha-274394 minikube.k8s.io/primary=true

	I0428 23:57:27.218086   36356 ops.go:34] apiserver oom_adj: -16

	I0428 23:57:27.424076   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:27.925075   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:28.424356   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:28.924339   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:29.424513   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:29.924288   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:30.425076   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:30.924258   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:31.424755   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:31.924830   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:32.424739   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:32.924320   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:33.425053   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:33.924560   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:34.424815   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:34.924173   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:35.424207   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:35.924496   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:36.425172   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:36.924859   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:37.424869   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:37.924250   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:38.424267   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:38.924424   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:39.082874   36356 kubeadm.go:1107] duration metric: took 11.881195164s to wait for elevateKubeSystemPrivileges

	W0428 23:57:39.082918   36356 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0428 23:57:39.082928   36356 kubeadm.go:393] duration metric: took 24.581266215s to StartCluster

	I0428 23:57:39.082947   36356 settings.go:142] acquiring lock: {Name:mk4e6965347be51f4cd501030baea6b9cd2dbc9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:39.083032   36356 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:57:39.083795   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/kubeconfig: {Name:mk5412a370a0ddec304ff7697d6d137221e96742 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:39.083984   36356 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:57:39.084009   36356 start.go:240] waiting for startup goroutines ...

	I0428 23:57:39.083994   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0428 23:57:39.084007   36356 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]

	I0428 23:57:39.084098   36356 addons.go:69] Setting storage-provisioner=true in profile "ha-274394"

	I0428 23:57:39.084105   36356 addons.go:69] Setting default-storageclass=true in profile "ha-274394"

	I0428 23:57:39.084136   36356 addons.go:234] Setting addon storage-provisioner=true in "ha-274394"

	I0428 23:57:39.084173   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:57:39.084193   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:57:39.084174   36356 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-274394"

	I0428 23:57:39.084599   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.084626   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.084651   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.084660   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.099465   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40107

	I0428 23:57:39.099483   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38259

	I0428 23:57:39.099923   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.099924   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.100433   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.100461   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.100515   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.100531   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.100847   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.100870   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.101048   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:39.101480   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.101623   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.103124   36356 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:57:39.103379   36356 kapi.go:59] client config for ha-274394: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt", KeyFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key", CAFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0428 23:57:39.103792   36356 cert_rotation.go:137] Starting client certificate rotation controller

	I0428 23:57:39.103956   36356 addons.go:234] Setting addon default-storageclass=true in "ha-274394"

	I0428 23:57:39.103995   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:57:39.104250   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.104294   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.117517   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42057

	I0428 23:57:39.117990   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.118551   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.118583   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.118929   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.119159   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:39.119482   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44955

	I0428 23:57:39.119880   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.120375   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.120400   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.120739   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.120952   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:39.122980   36356 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0428 23:57:39.121312   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.124387   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.124487   36356 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0428 23:57:39.124512   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0428 23:57:39.124529   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:39.127583   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.128028   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:39.128055   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.128209   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:39.128392   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:39.128545   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:39.128689   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:39.140041   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43663

	I0428 23:57:39.140489   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.140944   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.140962   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.141257   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.141435   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:39.143020   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:39.143276   36356 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0428 23:57:39.143289   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0428 23:57:39.143301   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:39.146287   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.146694   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:39.146732   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.146972   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:39.147160   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:39.147331   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:39.147464   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:39.275667   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0428 23:57:39.307241   36356 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0428 23:57:39.452854   36356 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0428 23:57:39.886409   36356 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0428 23:57:40.144028   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144057   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144093   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144128   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144337   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144352   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144360   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144366   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144465   36356 main.go:141] libmachine: (ha-274394) DBG | Closing plugin on server side

	I0428 23:57:40.144477   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144503   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144521   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144529   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144593   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144632   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144616   36356 main.go:141] libmachine: (ha-274394) DBG | Closing plugin on server side

	I0428 23:57:40.144722   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144737   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144861   36356 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0428 23:57:40.144875   36356 round_trippers.go:469] Request Headers:

	I0428 23:57:40.144885   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:57:40.144889   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:57:40.159830   36356 round_trippers.go:574] Response Status: 200 OK in 14 milliseconds

	I0428 23:57:40.160397   36356 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0428 23:57:40.160413   36356 round_trippers.go:469] Request Headers:

	I0428 23:57:40.160420   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:57:40.160426   36356 round_trippers.go:473]     Content-Type: application/json

	I0428 23:57:40.160431   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:57:40.164030   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:57:40.164307   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.164329   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.164622   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.164645   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.166553   36356 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0428 23:57:40.168054   36356 addons.go:505] duration metric: took 1.084044252s for enable addons: enabled=[storage-provisioner default-storageclass]

	I0428 23:57:40.168092   36356 start.go:245] waiting for cluster config update ...

	I0428 23:57:40.168102   36356 start.go:254] writing updated cluster config ...

	I0428 23:57:40.170126   36356 out.go:177] 

	I0428 23:57:40.171839   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:57:40.171906   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:57:40.173902   36356 out.go:177] * Starting "ha-274394-m02" control-plane node in "ha-274394" cluster

	I0428 23:57:40.175173   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:57:40.175207   36356 cache.go:56] Caching tarball of preloaded images

	I0428 23:57:40.175324   36356 preload.go:173] Found /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0428 23:57:40.175343   36356 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0428 23:57:40.175453   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:57:40.175692   36356 start.go:360] acquireMachinesLock for ha-274394-m02: {Name:mkf607109012ed2f4aeb283e90eb20782d746716 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0428 23:57:40.175759   36356 start.go:364] duration metric: took 36.777µs to acquireMachinesLock for "ha-274394-m02"

	I0428 23:57:40.175784   36356 start.go:93] Provisioning new machine with config: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:57:40.175893   36356 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0428 23:57:40.177596   36356 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0428 23:57:40.177686   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:40.177716   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:40.192465   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33915

	I0428 23:57:40.192869   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:40.193339   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:40.193360   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:40.193660   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:40.193851   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:57:40.194005   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:57:40.194206   36356 start.go:159] libmachine.API.Create for "ha-274394" (driver="kvm2")

	I0428 23:57:40.194237   36356 client.go:168] LocalClient.Create starting

	I0428 23:57:40.194281   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem

	I0428 23:57:40.194325   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:57:40.194343   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:57:40.194395   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem

	I0428 23:57:40.194413   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:57:40.194423   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:57:40.194437   36356 main.go:141] libmachine: Running pre-create checks...

	I0428 23:57:40.194445   36356 main.go:141] libmachine: (ha-274394-m02) Calling .PreCreateCheck

	I0428 23:57:40.194610   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetConfigRaw

	I0428 23:57:40.194952   36356 main.go:141] libmachine: Creating machine...

	I0428 23:57:40.194964   36356 main.go:141] libmachine: (ha-274394-m02) Calling .Create

	I0428 23:57:40.195082   36356 main.go:141] libmachine: (ha-274394-m02) Creating KVM machine...

	I0428 23:57:40.196448   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found existing default KVM network

	I0428 23:57:40.196567   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found existing private KVM network mk-ha-274394

	I0428 23:57:40.196728   36356 main.go:141] libmachine: (ha-274394-m02) Setting up store path in /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02 ...

	I0428 23:57:40.196753   36356 main.go:141] libmachine: (ha-274394-m02) Building disk image from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0428 23:57:40.196818   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.196708   36756 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:57:40.196940   36356 main.go:141] libmachine: (ha-274394-m02) Downloading /home/jenkins/minikube-integration/17977-13393/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0428 23:57:40.430082   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.429932   36756 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa...

	I0428 23:57:40.583373   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.583223   36756 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/ha-274394-m02.rawdisk...

	I0428 23:57:40.583418   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Writing magic tar header

	I0428 23:57:40.583434   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Writing SSH key tar header

	I0428 23:57:40.583447   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.583383   36756 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02 ...

	I0428 23:57:40.583532   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02

	I0428 23:57:40.583555   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02 (perms=drwx------)

	I0428 23:57:40.583568   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines

	I0428 23:57:40.583584   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines (perms=drwxr-xr-x)

	I0428 23:57:40.583603   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:57:40.583619   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393

	I0428 23:57:40.583646   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube (perms=drwxr-xr-x)

	I0428 23:57:40.583660   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393 (perms=drwxrwxr-x)

	I0428 23:57:40.583673   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0428 23:57:40.583685   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins

	I0428 23:57:40.583696   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0428 23:57:40.583708   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0428 23:57:40.583716   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home

	I0428 23:57:40.583733   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Skipping /home - not owner

	I0428 23:57:40.583747   36356 main.go:141] libmachine: (ha-274394-m02) Creating domain...

	I0428 23:57:40.584643   36356 main.go:141] libmachine: (ha-274394-m02) define libvirt domain using xml: 

	I0428 23:57:40.584666   36356 main.go:141] libmachine: (ha-274394-m02) <domain type='kvm'>

	I0428 23:57:40.584679   36356 main.go:141] libmachine: (ha-274394-m02)   <name>ha-274394-m02</name>

	I0428 23:57:40.584692   36356 main.go:141] libmachine: (ha-274394-m02)   <memory unit='MiB'>2200</memory>

	I0428 23:57:40.584703   36356 main.go:141] libmachine: (ha-274394-m02)   <vcpu>2</vcpu>

	I0428 23:57:40.584718   36356 main.go:141] libmachine: (ha-274394-m02)   <features>

	I0428 23:57:40.584731   36356 main.go:141] libmachine: (ha-274394-m02)     <acpi/>

	I0428 23:57:40.584741   36356 main.go:141] libmachine: (ha-274394-m02)     <apic/>

	I0428 23:57:40.584750   36356 main.go:141] libmachine: (ha-274394-m02)     <pae/>

	I0428 23:57:40.584760   36356 main.go:141] libmachine: (ha-274394-m02)     

	I0428 23:57:40.584777   36356 main.go:141] libmachine: (ha-274394-m02)   </features>

	I0428 23:57:40.584788   36356 main.go:141] libmachine: (ha-274394-m02)   <cpu mode='host-passthrough'>

	I0428 23:57:40.584800   36356 main.go:141] libmachine: (ha-274394-m02)   

	I0428 23:57:40.584812   36356 main.go:141] libmachine: (ha-274394-m02)   </cpu>

	I0428 23:57:40.584825   36356 main.go:141] libmachine: (ha-274394-m02)   <os>

	I0428 23:57:40.584837   36356 main.go:141] libmachine: (ha-274394-m02)     <type>hvm</type>

	I0428 23:57:40.584848   36356 main.go:141] libmachine: (ha-274394-m02)     <boot dev='cdrom'/>

	I0428 23:57:40.584858   36356 main.go:141] libmachine: (ha-274394-m02)     <boot dev='hd'/>

	I0428 23:57:40.584869   36356 main.go:141] libmachine: (ha-274394-m02)     <bootmenu enable='no'/>

	I0428 23:57:40.584881   36356 main.go:141] libmachine: (ha-274394-m02)   </os>

	I0428 23:57:40.584889   36356 main.go:141] libmachine: (ha-274394-m02)   <devices>

	I0428 23:57:40.584903   36356 main.go:141] libmachine: (ha-274394-m02)     <disk type='file' device='cdrom'>

	I0428 23:57:40.584923   36356 main.go:141] libmachine: (ha-274394-m02)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/boot2docker.iso'/>

	I0428 23:57:40.584937   36356 main.go:141] libmachine: (ha-274394-m02)       <target dev='hdc' bus='scsi'/>

	I0428 23:57:40.584947   36356 main.go:141] libmachine: (ha-274394-m02)       <readonly/>

	I0428 23:57:40.584955   36356 main.go:141] libmachine: (ha-274394-m02)     </disk>

	I0428 23:57:40.584965   36356 main.go:141] libmachine: (ha-274394-m02)     <disk type='file' device='disk'>

	I0428 23:57:40.584977   36356 main.go:141] libmachine: (ha-274394-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0428 23:57:40.584989   36356 main.go:141] libmachine: (ha-274394-m02)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/ha-274394-m02.rawdisk'/>

	I0428 23:57:40.585019   36356 main.go:141] libmachine: (ha-274394-m02)       <target dev='hda' bus='virtio'/>

	I0428 23:57:40.585048   36356 main.go:141] libmachine: (ha-274394-m02)     </disk>

	I0428 23:57:40.585062   36356 main.go:141] libmachine: (ha-274394-m02)     <interface type='network'>

	I0428 23:57:40.585078   36356 main.go:141] libmachine: (ha-274394-m02)       <source network='mk-ha-274394'/>

	I0428 23:57:40.585090   36356 main.go:141] libmachine: (ha-274394-m02)       <model type='virtio'/>

	I0428 23:57:40.585100   36356 main.go:141] libmachine: (ha-274394-m02)     </interface>

	I0428 23:57:40.585112   36356 main.go:141] libmachine: (ha-274394-m02)     <interface type='network'>

	I0428 23:57:40.585122   36356 main.go:141] libmachine: (ha-274394-m02)       <source network='default'/>

	I0428 23:57:40.585133   36356 main.go:141] libmachine: (ha-274394-m02)       <model type='virtio'/>

	I0428 23:57:40.585143   36356 main.go:141] libmachine: (ha-274394-m02)     </interface>

	I0428 23:57:40.585193   36356 main.go:141] libmachine: (ha-274394-m02)     <serial type='pty'>

	I0428 23:57:40.585213   36356 main.go:141] libmachine: (ha-274394-m02)       <target port='0'/>

	I0428 23:57:40.585230   36356 main.go:141] libmachine: (ha-274394-m02)     </serial>

	I0428 23:57:40.585246   36356 main.go:141] libmachine: (ha-274394-m02)     <console type='pty'>

	I0428 23:57:40.585275   36356 main.go:141] libmachine: (ha-274394-m02)       <target type='serial' port='0'/>

	I0428 23:57:40.585293   36356 main.go:141] libmachine: (ha-274394-m02)     </console>

	I0428 23:57:40.585302   36356 main.go:141] libmachine: (ha-274394-m02)     <rng model='virtio'>

	I0428 23:57:40.585308   36356 main.go:141] libmachine: (ha-274394-m02)       <backend model='random'>/dev/random</backend>

	I0428 23:57:40.585314   36356 main.go:141] libmachine: (ha-274394-m02)     </rng>

	I0428 23:57:40.585321   36356 main.go:141] libmachine: (ha-274394-m02)     

	I0428 23:57:40.585326   36356 main.go:141] libmachine: (ha-274394-m02)     

	I0428 23:57:40.585333   36356 main.go:141] libmachine: (ha-274394-m02)   </devices>

	I0428 23:57:40.585338   36356 main.go:141] libmachine: (ha-274394-m02) </domain>

	I0428 23:57:40.585349   36356 main.go:141] libmachine: (ha-274394-m02) 

	I0428 23:57:40.591951   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:29:fa:a1 in network default

	I0428 23:57:40.592539   36356 main.go:141] libmachine: (ha-274394-m02) Ensuring networks are active...

	I0428 23:57:40.592572   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:40.593208   36356 main.go:141] libmachine: (ha-274394-m02) Ensuring network default is active

	I0428 23:57:40.593513   36356 main.go:141] libmachine: (ha-274394-m02) Ensuring network mk-ha-274394 is active

	I0428 23:57:40.593859   36356 main.go:141] libmachine: (ha-274394-m02) Getting domain xml...

	I0428 23:57:40.594509   36356 main.go:141] libmachine: (ha-274394-m02) Creating domain...

	I0428 23:57:41.836657   36356 main.go:141] libmachine: (ha-274394-m02) Waiting to get IP...

	I0428 23:57:41.837571   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:41.838045   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:41.838120   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:41.838015   36756 retry.go:31] will retry after 263.733241ms: waiting for machine to come up

	I0428 23:57:42.105185   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:42.105687   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:42.105724   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:42.105649   36756 retry.go:31] will retry after 331.1126ms: waiting for machine to come up

	I0428 23:57:42.438029   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:42.438463   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:42.438490   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:42.438436   36756 retry.go:31] will retry after 446.032628ms: waiting for machine to come up

	I0428 23:57:42.886123   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:42.886522   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:42.886551   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:42.886483   36756 retry.go:31] will retry after 461.928323ms: waiting for machine to come up

	I0428 23:57:43.350246   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:43.350746   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:43.350773   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:43.350696   36756 retry.go:31] will retry after 703.683282ms: waiting for machine to come up

	I0428 23:57:44.055920   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:44.056329   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:44.056361   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:44.056286   36756 retry.go:31] will retry after 903.640049ms: waiting for machine to come up

	I0428 23:57:44.961160   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:44.961635   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:44.961664   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:44.961581   36756 retry.go:31] will retry after 931.278913ms: waiting for machine to come up

	I0428 23:57:45.894066   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:45.894506   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:45.894535   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:45.894451   36756 retry.go:31] will retry after 1.279366183s: waiting for machine to come up

	I0428 23:57:47.174982   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:47.175538   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:47.175570   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:47.175475   36756 retry.go:31] will retry after 1.506197273s: waiting for machine to come up

	I0428 23:57:48.683913   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:48.684413   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:48.684452   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:48.684371   36756 retry.go:31] will retry after 2.323617854s: waiting for machine to come up

	I0428 23:57:51.009605   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:51.010052   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:51.010079   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:51.010011   36756 retry.go:31] will retry after 2.511993371s: waiting for machine to come up

	I0428 23:57:53.524618   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:53.524963   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:53.524989   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:53.524930   36756 retry.go:31] will retry after 2.984005541s: waiting for machine to come up

	I0428 23:57:56.510802   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:56.511159   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:56.511208   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:56.511109   36756 retry.go:31] will retry after 3.975363933s: waiting for machine to come up

	I0428 23:58:00.488249   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:00.488659   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:58:00.488699   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:58:00.488635   36756 retry.go:31] will retry after 4.708905436s: waiting for machine to come up

	I0428 23:58:05.199518   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:05.200038   36356 main.go:141] libmachine: (ha-274394-m02) Found IP for machine: 192.168.39.43

	I0428 23:58:05.200069   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has current primary IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:05.200075   36356 main.go:141] libmachine: (ha-274394-m02) Reserving static IP address...

	I0428 23:58:05.200401   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find host DHCP lease matching {name: "ha-274394-m02", mac: "52:54:00:94:ad:64", ip: "192.168.39.43"} in network mk-ha-274394

	I0428 23:58:05.271102   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Getting to WaitForSSH function...

	I0428 23:58:05.271136   36356 main.go:141] libmachine: (ha-274394-m02) Reserved static IP address: 192.168.39.43

	I0428 23:58:05.271154   36356 main.go:141] libmachine: (ha-274394-m02) Waiting for SSH to be available...

	I0428 23:58:05.273658   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:05.274071   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394

	I0428 23:58:05.274110   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find defined IP address of network mk-ha-274394 interface with MAC address 52:54:00:94:ad:64

	I0428 23:58:05.274190   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH client type: external

	I0428 23:58:05.274217   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa (-rw-------)

	I0428 23:58:05.274244   36356 main.go:141] libmachine: (ha-274394-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:58:05.274262   36356 main.go:141] libmachine: (ha-274394-m02) DBG | About to run SSH command:

	I0428 23:58:05.274279   36356 main.go:141] libmachine: (ha-274394-m02) DBG | exit 0

	I0428 23:58:05.277779   36356 main.go:141] libmachine: (ha-274394-m02) DBG | SSH cmd err, output: exit status 255: 

	I0428 23:58:05.277800   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0428 23:58:05.277808   36356 main.go:141] libmachine: (ha-274394-m02) DBG | command : exit 0

	I0428 23:58:05.277813   36356 main.go:141] libmachine: (ha-274394-m02) DBG | err     : exit status 255

	I0428 23:58:05.277834   36356 main.go:141] libmachine: (ha-274394-m02) DBG | output  : 

	I0428 23:58:08.279936   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Getting to WaitForSSH function...

	I0428 23:58:08.282287   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.282606   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.282638   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.282767   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH client type: external

	I0428 23:58:08.282790   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa (-rw-------)

	I0428 23:58:08.282817   36356 main.go:141] libmachine: (ha-274394-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.43 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:58:08.282831   36356 main.go:141] libmachine: (ha-274394-m02) DBG | About to run SSH command:

	I0428 23:58:08.282847   36356 main.go:141] libmachine: (ha-274394-m02) DBG | exit 0

	I0428 23:58:08.406493   36356 main.go:141] libmachine: (ha-274394-m02) DBG | SSH cmd err, output: <nil>: 

	I0428 23:58:08.406751   36356 main.go:141] libmachine: (ha-274394-m02) KVM machine creation complete!

	I0428 23:58:08.407023   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetConfigRaw

	I0428 23:58:08.407546   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:08.407752   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:08.407917   36356 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0428 23:58:08.407949   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0428 23:58:08.409148   36356 main.go:141] libmachine: Detecting operating system of created instance...

	I0428 23:58:08.409163   36356 main.go:141] libmachine: Waiting for SSH to be available...

	I0428 23:58:08.409170   36356 main.go:141] libmachine: Getting to WaitForSSH function...

	I0428 23:58:08.409176   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.411283   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.411639   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.411666   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.411790   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.411958   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.412074   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.412205   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.412341   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.412556   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.412567   36356 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0428 23:58:08.517856   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:58:08.517876   36356 main.go:141] libmachine: Detecting the provisioner...

	I0428 23:58:08.517884   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.520659   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.521074   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.521104   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.521249   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.521452   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.521595   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.521718   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.521891   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.522108   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.522122   36356 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0428 23:58:08.623755   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0428 23:58:08.623844   36356 main.go:141] libmachine: found compatible host: buildroot

	I0428 23:58:08.623859   36356 main.go:141] libmachine: Provisioning with buildroot...

	I0428 23:58:08.623869   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:58:08.624132   36356 buildroot.go:166] provisioning hostname "ha-274394-m02"

	I0428 23:58:08.624159   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:58:08.624360   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.626758   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.627168   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.627207   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.627320   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.627519   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.627679   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.627799   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.627986   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.628168   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.628185   36356 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-274394-m02 && echo "ha-274394-m02" | sudo tee /etc/hostname

	I0428 23:58:08.748721   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-274394-m02

	I0428 23:58:08.748751   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.751328   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.751725   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.751754   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.751921   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.752118   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.752289   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.752435   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.752591   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.752746   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.752761   36356 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-274394-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-274394-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-274394-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0428 23:58:08.865693   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:58:08.865735   36356 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17977-13393/.minikube CaCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17977-13393/.minikube}

	I0428 23:58:08.865752   36356 buildroot.go:174] setting up certificates

	I0428 23:58:08.865761   36356 provision.go:84] configureAuth start

	I0428 23:58:08.865770   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:58:08.866040   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:08.868779   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.869186   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.869215   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.869353   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.871473   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.871800   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.871832   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.871946   36356 provision.go:143] copyHostCerts

	I0428 23:58:08.871975   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:58:08.872008   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem, removing ...

	I0428 23:58:08.872018   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:58:08.872094   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem (1082 bytes)

	I0428 23:58:08.872213   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:58:08.872239   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem, removing ...

	I0428 23:58:08.872244   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:58:08.872278   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem (1123 bytes)

	I0428 23:58:08.872365   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:58:08.872389   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem, removing ...

	I0428 23:58:08.872398   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:58:08.872430   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem (1675 bytes)

	I0428 23:58:08.872508   36356 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem org=jenkins.ha-274394-m02 san=[127.0.0.1 192.168.39.43 ha-274394-m02 localhost minikube]

	I0428 23:58:09.052110   36356 provision.go:177] copyRemoteCerts

	I0428 23:58:09.052164   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0428 23:58:09.052184   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.054860   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.055216   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.055240   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.055399   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.055567   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.055717   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.055858   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:09.137022   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0428 23:58:09.137100   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0428 23:58:09.167033   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0428 23:58:09.167092   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0428 23:58:09.196003   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0428 23:58:09.196052   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0428 23:58:09.225865   36356 provision.go:87] duration metric: took 360.094398ms to configureAuth

	I0428 23:58:09.225900   36356 buildroot.go:189] setting minikube options for container-runtime

	I0428 23:58:09.226133   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:09.226208   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.228933   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.229315   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.229339   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.229568   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.229766   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.229900   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.230040   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.230170   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:09.230388   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:09.230411   36356 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0428 23:58:09.507505   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0428 23:58:09.507533   36356 main.go:141] libmachine: Checking connection to Docker...

	I0428 23:58:09.507544   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetURL

	I0428 23:58:09.508981   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using libvirt version 6000000

	I0428 23:58:09.511365   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.511820   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.511847   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.511983   36356 main.go:141] libmachine: Docker is up and running!

	I0428 23:58:09.511995   36356 main.go:141] libmachine: Reticulating splines...

	I0428 23:58:09.512002   36356 client.go:171] duration metric: took 29.317754136s to LocalClient.Create

	I0428 23:58:09.512028   36356 start.go:167] duration metric: took 29.317822967s to libmachine.API.Create "ha-274394"

	I0428 23:58:09.512041   36356 start.go:293] postStartSetup for "ha-274394-m02" (driver="kvm2")

	I0428 23:58:09.512058   36356 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0428 23:58:09.512081   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.512308   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0428 23:58:09.512333   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.514486   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.514786   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.514819   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.514890   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.515065   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.515222   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.515394   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:09.598106   36356 ssh_runner.go:195] Run: cat /etc/os-release

	I0428 23:58:09.603534   36356 info.go:137] Remote host: Buildroot 2023.02.9

	I0428 23:58:09.605400   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/addons for local assets ...

	I0428 23:58:09.605465   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/files for local assets ...

	I0428 23:58:09.605532   36356 filesync.go:149] local asset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> 207272.pem in /etc/ssl/certs

	I0428 23:58:09.605541   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /etc/ssl/certs/207272.pem

	I0428 23:58:09.605627   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0428 23:58:09.616520   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:58:09.648817   36356 start.go:296] duration metric: took 136.751105ms for postStartSetup

	I0428 23:58:09.648864   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetConfigRaw

	I0428 23:58:09.649443   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:09.651782   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.652097   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.652145   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.652400   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:58:09.652581   36356 start.go:128] duration metric: took 29.476676023s to createHost

	I0428 23:58:09.652603   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.654816   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.655121   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.655141   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.655311   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.655499   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.655654   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.655785   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.655923   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:09.656090   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:09.656101   36356 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0428 23:58:09.763749   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714348689.739838626

	I0428 23:58:09.763772   36356 fix.go:216] guest clock: 1714348689.739838626

	I0428 23:58:09.763782   36356 fix.go:229] Guest: 2024-04-28 23:58:09.739838626 +0000 UTC Remote: 2024-04-28 23:58:09.652593063 +0000 UTC m=+85.098481504 (delta=87.245563ms)

	I0428 23:58:09.763801   36356 fix.go:200] guest clock delta is within tolerance: 87.245563ms

	I0428 23:58:09.763808   36356 start.go:83] releasing machines lock for "ha-274394-m02", held for 29.58803473s

	I0428 23:58:09.763831   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.764088   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:09.766409   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.766722   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.766751   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.769042   36356 out.go:177] * Found network options:

	I0428 23:58:09.770388   36356 out.go:177]   - NO_PROXY=192.168.39.237

	W0428 23:58:09.771614   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:58:09.771670   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.772270   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.772475   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.772539   36356 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0428 23:58:09.772591   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	W0428 23:58:09.772706   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:58:09.772781   36356 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0428 23:58:09.772803   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.775069   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775442   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.775474   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775498   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775608   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.775788   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.775865   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.775888   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775969   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.776049   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.776112   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:09.776192   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.776354   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.776515   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:10.017919   36356 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0428 23:58:10.025250   36356 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0428 23:58:10.025319   36356 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0428 23:58:10.042207   36356 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0428 23:58:10.042227   36356 start.go:494] detecting cgroup driver to use...

	I0428 23:58:10.042298   36356 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0428 23:58:10.060095   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0428 23:58:10.074396   36356 docker.go:217] disabling cri-docker service (if available) ...

	I0428 23:58:10.074438   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0428 23:58:10.089348   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0428 23:58:10.105801   36356 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0428 23:58:10.231914   36356 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0428 23:58:10.370359   36356 docker.go:233] disabling docker service ...

	I0428 23:58:10.370433   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0428 23:58:10.387029   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0428 23:58:10.401713   36356 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0428 23:58:10.545671   36356 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0428 23:58:10.673835   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0428 23:58:10.690495   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0428 23:58:10.713136   36356 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0428 23:58:10.713195   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.724228   36356 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0428 23:58:10.724289   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.734841   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.745343   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.755951   36356 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0428 23:58:10.769464   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.780518   36356 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.800846   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.813387   36356 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0428 23:58:10.824342   36356 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0428 23:58:10.824386   36356 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0428 23:58:10.840504   36356 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0428 23:58:10.850816   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:58:11.002082   36356 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0428 23:58:11.150506   36356 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0428 23:58:11.150580   36356 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0428 23:58:11.155694   36356 start.go:562] Will wait 60s for crictl version

	I0428 23:58:11.155737   36356 ssh_runner.go:195] Run: which crictl

	I0428 23:58:11.159794   36356 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0428 23:58:11.198604   36356 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0428 23:58:11.198662   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:58:11.227554   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:58:11.259462   36356 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0428 23:58:11.261048   36356 out.go:177]   - env NO_PROXY=192.168.39.237

	I0428 23:58:11.262197   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:11.264686   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:11.265028   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:11.265066   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:11.265314   36356 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0428 23:58:11.269635   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:58:11.284122   36356 mustload.go:65] Loading cluster: ha-274394

	I0428 23:58:11.284320   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:11.284574   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:11.284606   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:11.299185   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43987

	I0428 23:58:11.299552   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:11.300015   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:11.300035   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:11.300322   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:11.300512   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:58:11.302241   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:58:11.302540   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:11.302569   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:11.316673   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34755

	I0428 23:58:11.317081   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:11.317581   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:11.317603   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:11.317957   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:11.318147   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:58:11.318306   36356 certs.go:68] Setting up /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394 for IP: 192.168.39.43

	I0428 23:58:11.318321   36356 certs.go:194] generating shared ca certs ...

	I0428 23:58:11.318343   36356 certs.go:226] acquiring lock for ca certs: {Name:mka5d31eea282c20e045cfb5e09273edc965e467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:58:11.318474   36356 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key

	I0428 23:58:11.318509   36356 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key

	I0428 23:58:11.318518   36356 certs.go:256] generating profile certs ...

	I0428 23:58:11.318589   36356 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key

	I0428 23:58:11.318612   36356 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c

	I0428 23:58:11.318627   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.237 192.168.39.43 192.168.39.254]

	I0428 23:58:11.545721   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c ...

	I0428 23:58:11.545748   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c: {Name:mkeed2aa96bd12faaef131331a07f70de364149a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:58:11.545910   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c ...

	I0428 23:58:11.545924   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c: {Name:mk7099ae4bf57427dc8efa8eca1c99f9dfbcfc1c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:58:11.545987   36356 certs.go:381] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt

	I0428 23:58:11.546128   36356 certs.go:385] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key

	I0428 23:58:11.546251   36356 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key

	I0428 23:58:11.546266   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0428 23:58:11.546283   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0428 23:58:11.546302   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0428 23:58:11.546314   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0428 23:58:11.546327   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0428 23:58:11.546339   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0428 23:58:11.546356   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0428 23:58:11.546367   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0428 23:58:11.546440   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem (1338 bytes)

	W0428 23:58:11.546474   36356 certs.go:480] ignoring /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727_empty.pem, impossibly tiny 0 bytes

	I0428 23:58:11.546484   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem (1675 bytes)

	I0428 23:58:11.546515   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem (1082 bytes)

	I0428 23:58:11.546544   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem (1123 bytes)

	I0428 23:58:11.546575   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem (1675 bytes)

	I0428 23:58:11.546612   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:58:11.546640   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /usr/share/ca-certificates/207272.pem

	I0428 23:58:11.546660   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:11.546673   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem -> /usr/share/ca-certificates/20727.pem

	I0428 23:58:11.546701   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:58:11.549269   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:11.549627   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:58:11.549651   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:11.549864   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:58:11.550078   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:58:11.550246   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:58:11.550386   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:58:11.626257   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0428 23:58:11.633493   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0428 23:58:11.648763   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0428 23:58:11.653913   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0428 23:58:11.666682   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0428 23:58:11.671203   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0428 23:58:11.683465   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0428 23:58:11.688416   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0428 23:58:11.700908   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0428 23:58:11.705691   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0428 23:58:11.718671   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0428 23:58:11.723458   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0428 23:58:11.736255   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0428 23:58:11.765294   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0428 23:58:11.790622   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0428 23:58:11.815237   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0428 23:58:11.840522   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0428 23:58:11.866184   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0428 23:58:11.892486   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0428 23:58:11.919387   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0428 23:58:11.945021   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /usr/share/ca-certificates/207272.pem (1708 bytes)

	I0428 23:58:11.971444   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0428 23:58:11.998626   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem --> /usr/share/ca-certificates/20727.pem (1338 bytes)

	I0428 23:58:12.027890   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0428 23:58:12.047360   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0428 23:58:12.066886   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0428 23:58:12.085348   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0428 23:58:12.103655   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0428 23:58:12.122468   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0428 23:58:12.140788   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0428 23:58:12.159242   36356 ssh_runner.go:195] Run: openssl version

	I0428 23:58:12.165224   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/207272.pem && ln -fs /usr/share/ca-certificates/207272.pem /etc/ssl/certs/207272.pem"

	I0428 23:58:12.177844   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/207272.pem

	I0428 23:58:12.183316   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 28 23:49 /usr/share/ca-certificates/207272.pem

	I0428 23:58:12.183365   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/207272.pem

	I0428 23:58:12.190660   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/207272.pem /etc/ssl/certs/3ec20f2e.0"

	I0428 23:58:12.204445   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0428 23:58:12.218304   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:12.223358   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 28 23:08 /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:12.223409   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:12.229577   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0428 23:58:12.243231   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20727.pem && ln -fs /usr/share/ca-certificates/20727.pem /etc/ssl/certs/20727.pem"

	I0428 23:58:12.256708   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20727.pem

	I0428 23:58:12.261981   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 28 23:49 /usr/share/ca-certificates/20727.pem

	I0428 23:58:12.262039   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20727.pem

	I0428 23:58:12.268393   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20727.pem /etc/ssl/certs/51391683.0"

	I0428 23:58:12.280239   36356 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0428 23:58:12.284658   36356 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0428 23:58:12.284714   36356 kubeadm.go:928] updating node {m02 192.168.39.43 8443 v1.30.0 crio true true} ...

	I0428 23:58:12.284819   36356 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-274394-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.43

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0428 23:58:12.284857   36356 kube-vip.go:111] generating kube-vip config ...

	I0428 23:58:12.284892   36356 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0428 23:58:12.305290   36356 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0428 23:58:12.305341   36356 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0428 23:58:12.305383   36356 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0428 23:58:12.316898   36356 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0428 23:58:12.316947   36356 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0428 23:58:12.329307   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0428 23:58:12.329324   36356 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet

	I0428 23:58:12.329342   36356 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm

	I0428 23:58:12.329329   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:58:12.329504   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:58:12.335405   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0428 23:58:12.335438   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0428 23:58:14.045229   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:58:14.045312   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:58:14.051404   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0428 23:58:14.051439   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0428 23:58:15.812706   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0428 23:58:15.829608   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:58:15.829706   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:58:15.834283   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0428 23:58:15.834318   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0428 23:58:16.307677   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0428 23:58:16.319127   36356 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0428 23:58:16.341843   36356 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0428 23:58:16.362469   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0428 23:58:16.382263   36356 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0428 23:58:16.386704   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:58:16.399847   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:58:16.542357   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:58:16.562649   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:58:16.563136   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:16.563183   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:16.578899   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45237

	I0428 23:58:16.579324   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:16.579790   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:16.579815   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:16.580113   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:16.580286   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:58:16.580432   36356 start.go:316] joinCluster: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration

:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:58:16.580525   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0428 23:58:16.580547   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:58:16.583320   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:16.583742   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:58:16.583771   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:16.583929   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:58:16.584086   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:58:16.584266   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:58:16.584415   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:58:16.761399   36356 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:58:16.761453   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token kta4yl.dkqb9qr4g4gf2lc7 --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m02 --control-plane --apiserver-advertise-address=192.168.39.43 --apiserver-bind-port=8443"

	I0428 23:58:38.387908   36356 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token kta4yl.dkqb9qr4g4gf2lc7 --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m02 --control-plane --apiserver-advertise-address=192.168.39.43 --apiserver-bind-port=8443": (21.626432622s)

	I0428 23:58:38.387953   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0428 23:58:39.010776   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-274394-m02 minikube.k8s.io/updated_at=2024_04_28T23_58_39_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328 minikube.k8s.io/name=ha-274394 minikube.k8s.io/primary=false

	I0428 23:58:39.142412   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-274394-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0428 23:58:39.293444   36356 start.go:318] duration metric: took 22.713007972s to joinCluster

	I0428 23:58:39.293513   36356 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:58:39.295333   36356 out.go:177] * Verifying Kubernetes components...

	I0428 23:58:39.293856   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:39.296894   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:58:39.590067   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:58:39.653930   36356 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:58:39.654223   36356 kapi.go:59] client config for ha-274394: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt", KeyFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key", CAFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0428 23:58:39.654290   36356 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.237:8443

	I0428 23:58:39.654479   36356 node_ready.go:35] waiting up to 6m0s for node "ha-274394-m02" to be "Ready" ...

	I0428 23:58:39.654555   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:39.654563   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:39.654570   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:39.654574   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:39.664649   36356 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0428 23:58:40.155296   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:40.155331   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:40.155342   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:40.155348   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:40.172701   36356 round_trippers.go:574] Response Status: 200 OK in 17 milliseconds

	I0428 23:58:40.655311   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:40.655338   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:40.655350   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:40.655361   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:40.661218   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:41.155679   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:41.155700   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:41.155710   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:41.155713   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:41.159217   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:41.654979   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:41.655002   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:41.655011   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:41.655017   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:41.658216   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:41.659155   36356 node_ready.go:53] node "ha-274394-m02" has status "Ready":"False"

	I0428 23:58:42.155563   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:42.155591   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:42.155602   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:42.155608   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:42.159309   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:42.655232   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:42.655250   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:42.655258   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:42.655262   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:42.658587   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:43.155324   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:43.155378   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:43.155392   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:43.155397   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:43.160299   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:43.655539   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:43.655559   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:43.655567   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:43.655570   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:43.659388   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:43.660385   36356 node_ready.go:53] node "ha-274394-m02" has status "Ready":"False"

	I0428 23:58:44.154684   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:44.154707   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:44.154715   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:44.154720   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:44.158344   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:44.655229   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:44.684950   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:44.684969   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:44.684976   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:44.689026   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:45.155245   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:45.155266   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:45.155273   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:45.155278   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:45.158906   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:45.655245   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:45.655265   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:45.655272   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:45.655277   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:45.659245   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:46.155290   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:46.155311   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:46.155322   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:46.155328   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:46.160353   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:46.161167   36356 node_ready.go:53] node "ha-274394-m02" has status "Ready":"False"

	I0428 23:58:46.654806   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:46.654828   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:46.654835   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:46.654839   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:46.658180   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:47.155464   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:47.155486   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:47.155494   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:47.155498   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:47.160773   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:47.654818   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:47.654843   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:47.654850   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:47.654855   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:47.658410   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.154672   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:48.154697   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.154706   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.154710   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.159615   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:48.160955   36356 node_ready.go:49] node "ha-274394-m02" has status "Ready":"True"

	I0428 23:58:48.160973   36356 node_ready.go:38] duration metric: took 8.506473788s for node "ha-274394-m02" to be "Ready" ...

	I0428 23:58:48.160982   36356 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0428 23:58:48.161046   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:48.161055   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.161062   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.161068   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.169896   36356 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0428 23:58:48.176675   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.176747   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rslhx

	I0428 23:58:48.176759   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.176765   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.176768   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.179899   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.180719   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:48.180735   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.180742   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.180747   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.184065   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.184638   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:48.184657   36356 pod_ready.go:81] duration metric: took 7.958913ms for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.184666   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.184714   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-xkdcv

	I0428 23:58:48.184722   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.184730   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.184736   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.195110   36356 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0428 23:58:48.195972   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:48.195992   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.195999   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.196003   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.199213   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.199713   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:48.199733   36356 pod_ready.go:81] duration metric: took 15.060231ms for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.199747   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.199805   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394

	I0428 23:58:48.199815   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.199821   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.199825   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.203469   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.204875   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:48.204891   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.204898   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.204902   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.208879   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.209993   36356 pod_ready.go:92] pod "etcd-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:48.210011   36356 pod_ready.go:81] duration metric: took 10.253451ms for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.210037   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.210104   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:48.210112   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.210118   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.210123   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.212475   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:48.213184   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:48.213196   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.213203   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.213206   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.216781   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.710847   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:48.710869   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.710877   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.710881   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.717464   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0428 23:58:48.718367   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:48.718385   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.718395   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.718402   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.721385   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:49.210458   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:49.210481   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.210488   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.210492   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.214589   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:49.215523   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:49.215538   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.215545   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.215549   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.218124   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:49.710303   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:49.710327   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.710334   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.710340   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.714259   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:49.715063   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:49.715080   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.715088   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.715092   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.718099   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:50.211244   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:50.211267   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.211277   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.211285   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.215809   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:50.216675   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:50.216695   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.216705   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.216711   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.220299   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:50.220861   36356 pod_ready.go:102] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"False"

	I0428 23:58:50.710227   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:50.710254   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.710266   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.710273   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.714777   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:50.715631   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:50.715647   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.715656   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.715661   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.718977   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:51.210455   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:51.210484   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.210492   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.210495   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.214863   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:51.215676   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:51.215695   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.215705   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.215711   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.219164   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:51.710844   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:51.710866   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.710874   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.710878   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.714505   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:51.715380   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:51.715395   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.715402   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.715405   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.718737   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.210936   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:52.210960   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.210969   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.210973   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.214315   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.215246   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:52.215264   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.215271   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.215276   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.217789   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:52.710926   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:52.710951   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.710960   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.710972   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.714784   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.715778   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:52.715797   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.715805   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.715810   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.718927   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.719705   36356 pod_ready.go:102] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"False"

	I0428 23:58:53.211232   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:53.211273   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.211284   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.211289   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.215284   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:53.215955   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:53.215970   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.215976   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.215980   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.218518   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:53.710221   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:53.710244   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.710254   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.710259   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.713769   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:53.714799   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:53.714816   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.714826   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.714831   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.717753   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:54.210997   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:54.211027   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.211035   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.211039   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.214689   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:54.215567   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:54.215581   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.215587   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.215592   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.219396   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:54.710980   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:54.710999   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.711006   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.711010   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.714596   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:54.715401   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:54.715416   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.715421   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.715425   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.718723   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:55.211159   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:55.211186   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.211199   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.211207   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.215703   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:55.216484   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:55.216501   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.216507   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.216511   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.219394   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:55.220002   36356 pod_ready.go:102] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"False"

	I0428 23:58:55.710286   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:55.710320   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.710330   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.710335   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.714152   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:55.715422   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:55.715435   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.715442   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.715446   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.718421   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:56.210425   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:56.210447   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.210455   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.210459   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.214208   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:56.215146   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:56.215160   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.215167   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.215171   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.217756   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:56.710994   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:56.711013   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.711021   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.711024   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.713949   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:56.714853   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:56.714867   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.714872   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.714876   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.717415   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.210188   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:57.210211   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.210219   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.210223   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.213897   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:57.215006   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.215024   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.215033   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.215039   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.217552   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.218220   36356 pod_ready.go:92] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.218236   36356 pod_ready.go:81] duration metric: took 9.008187231s for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.218250   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.218295   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394

	I0428 23:58:57.218302   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.218308   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.218315   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.220629   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.221425   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:57.221443   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.221453   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.221462   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.223509   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.224113   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.224133   36356 pod_ready.go:81] duration metric: took 5.873511ms for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.224144   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.224215   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394-m02

	I0428 23:58:57.224227   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.224236   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.224244   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.226285   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.227060   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.227075   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.227082   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.227087   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.229206   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.229767   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.229788   36356 pod_ready.go:81] duration metric: took 5.632505ms for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.229799   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.229849   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394

	I0428 23:58:57.229858   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.229864   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.229868   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.232892   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:57.233655   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:57.233670   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.233676   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.233682   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.235860   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.236478   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.236500   36356 pod_ready.go:81] duration metric: took 6.69293ms for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.236513   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.236567   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m02

	I0428 23:58:57.236582   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.236591   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.236603   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.239009   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.239661   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.239676   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.239684   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.239691   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.242103   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.242658   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.242674   36356 pod_ready.go:81] duration metric: took 6.151599ms for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.242681   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.411103   36356 request.go:629] Waited for 168.362894ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0428 23:58:57.411156   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0428 23:58:57.411161   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.411169   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.411174   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.414521   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:57.610626   36356 request.go:629] Waited for 195.367099ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.610752   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.610822   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.610833   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.610846   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.615056   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:57.615713   36356 pod_ready.go:92] pod "kube-proxy-g95c9" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.615731   36356 pod_ready.go:81] duration metric: took 373.044367ms for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.615740   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.811010   36356 request.go:629] Waited for 195.183352ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0428 23:58:57.811064   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0428 23:58:57.811068   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.811076   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.811081   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.815095   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:58.010219   36356 request.go:629] Waited for 194.281833ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.010339   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.010358   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.010365   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.010370   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.014383   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:58.015289   36356 pod_ready.go:92] pod "kube-proxy-pwbfs" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:58.015307   36356 pod_ready.go:81] duration metric: took 399.560892ms for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.015315   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.210510   36356 request.go:629] Waited for 195.105309ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0428 23:58:58.210572   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0428 23:58:58.210577   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.210583   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.210588   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.215302   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:58.410679   36356 request.go:629] Waited for 194.371002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.410749   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.410755   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.410764   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.410770   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.414880   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:58.415576   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:58.415594   36356 pod_ready.go:81] duration metric: took 400.27299ms for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.415604   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.610680   36356 request.go:629] Waited for 195.022143ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0428 23:58:58.610745   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0428 23:58:58.610751   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.610756   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.610760   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.615040   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:58.811088   36356 request.go:629] Waited for 195.345352ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:58.811150   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:58.811156   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.811167   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.811171   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.814458   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:58.815300   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:58.815317   36356 pod_ready.go:81] duration metric: took 399.706734ms for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.815328   36356 pod_ready.go:38] duration metric: took 10.654327215s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0428 23:58:58.815340   36356 api_server.go:52] waiting for apiserver process to appear ...

	I0428 23:58:58.815386   36356 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0428 23:58:58.831473   36356 api_server.go:72] duration metric: took 19.537927218s to wait for apiserver process to appear ...

	I0428 23:58:58.831505   36356 api_server.go:88] waiting for apiserver healthz status ...

	I0428 23:58:58.831530   36356 api_server.go:253] Checking apiserver healthz at https://192.168.39.237:8443/healthz ...

	I0428 23:58:58.836498   36356 api_server.go:279] https://192.168.39.237:8443/healthz returned 200:

	ok

	I0428 23:58:58.836579   36356 round_trippers.go:463] GET https://192.168.39.237:8443/version

	I0428 23:58:58.836595   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.836613   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.836621   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.837583   36356 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0428 23:58:58.837822   36356 api_server.go:141] control plane version: v1.30.0

	I0428 23:58:58.837849   36356 api_server.go:131] duration metric: took 6.335764ms to wait for apiserver health ...

	I0428 23:58:58.837859   36356 system_pods.go:43] waiting for kube-system pods to appear ...

	I0428 23:58:59.010251   36356 request.go:629] Waited for 172.319916ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.010324   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.010354   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.010369   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.010377   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.016252   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:59.023090   36356 system_pods.go:59] 17 kube-system pods found

	I0428 23:58:59.023126   36356 system_pods.go:61] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0428 23:58:59.023132   36356 system_pods.go:61] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0428 23:58:59.023136   36356 system_pods.go:61] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0428 23:58:59.023140   36356 system_pods.go:61] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0428 23:58:59.023143   36356 system_pods.go:61] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0428 23:58:59.023146   36356 system_pods.go:61] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0428 23:58:59.023150   36356 system_pods.go:61] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0428 23:58:59.023155   36356 system_pods.go:61] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0428 23:58:59.023158   36356 system_pods.go:61] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0428 23:58:59.023161   36356 system_pods.go:61] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0428 23:58:59.023167   36356 system_pods.go:61] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0428 23:58:59.023172   36356 system_pods.go:61] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0428 23:58:59.023175   36356 system_pods.go:61] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0428 23:58:59.023180   36356 system_pods.go:61] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0428 23:58:59.023183   36356 system_pods.go:61] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0428 23:58:59.023186   36356 system_pods.go:61] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0428 23:58:59.023189   36356 system_pods.go:61] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0428 23:58:59.023194   36356 system_pods.go:74] duration metric: took 185.326461ms to wait for pod list to return data ...

	I0428 23:58:59.023207   36356 default_sa.go:34] waiting for default service account to be created ...

	I0428 23:58:59.210913   36356 request.go:629] Waited for 187.648663ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0428 23:58:59.210979   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0428 23:58:59.210993   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.211002   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.211013   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.214865   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:59.215086   36356 default_sa.go:45] found service account: "default"

	I0428 23:58:59.215102   36356 default_sa.go:55] duration metric: took 191.890036ms for default service account to be created ...

	I0428 23:58:59.215110   36356 system_pods.go:116] waiting for k8s-apps to be running ...

	I0428 23:58:59.410522   36356 request.go:629] Waited for 195.32449ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.410587   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.410592   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.410599   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.410603   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.416485   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:59.422169   36356 system_pods.go:86] 17 kube-system pods found

	I0428 23:58:59.422199   36356 system_pods.go:89] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0428 23:58:59.422207   36356 system_pods.go:89] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0428 23:58:59.422214   36356 system_pods.go:89] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0428 23:58:59.422220   36356 system_pods.go:89] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0428 23:58:59.422226   36356 system_pods.go:89] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0428 23:58:59.422232   36356 system_pods.go:89] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0428 23:58:59.422237   36356 system_pods.go:89] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0428 23:58:59.422243   36356 system_pods.go:89] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0428 23:58:59.422251   36356 system_pods.go:89] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0428 23:58:59.422265   36356 system_pods.go:89] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0428 23:58:59.422275   36356 system_pods.go:89] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0428 23:58:59.422283   36356 system_pods.go:89] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0428 23:58:59.422293   36356 system_pods.go:89] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0428 23:58:59.422300   36356 system_pods.go:89] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0428 23:58:59.422310   36356 system_pods.go:89] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0428 23:58:59.422316   36356 system_pods.go:89] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0428 23:58:59.422325   36356 system_pods.go:89] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0428 23:58:59.422337   36356 system_pods.go:126] duration metric: took 207.21932ms to wait for k8s-apps to be running ...

	I0428 23:58:59.422349   36356 system_svc.go:44] waiting for kubelet service to be running ....

	I0428 23:58:59.422404   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0428 23:58:59.441950   36356 system_svc.go:56] duration metric: took 19.591591ms WaitForService to wait for kubelet

	I0428 23:58:59.441982   36356 kubeadm.go:576] duration metric: took 20.148438728s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0428 23:58:59.442004   36356 node_conditions.go:102] verifying NodePressure condition ...

	I0428 23:58:59.610455   36356 request.go:629] Waited for 168.364577ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes

	I0428 23:58:59.610505   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes

	I0428 23:58:59.610515   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.610522   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.610526   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.614523   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:59.615695   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0428 23:58:59.615718   36356 node_conditions.go:123] node cpu capacity is 2

	I0428 23:58:59.615731   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0428 23:58:59.615735   36356 node_conditions.go:123] node cpu capacity is 2

	I0428 23:58:59.615741   36356 node_conditions.go:105] duration metric: took 173.731434ms to run NodePressure ...

	I0428 23:58:59.615756   36356 start.go:240] waiting for startup goroutines ...

	I0428 23:58:59.615797   36356 start.go:254] writing updated cluster config ...

	I0428 23:58:59.617862   36356 out.go:177] 

	I0428 23:58:59.619360   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:59.619475   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:58:59.621275   36356 out.go:177] * Starting "ha-274394-m03" control-plane node in "ha-274394" cluster

	I0428 23:58:59.622428   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:58:59.622455   36356 cache.go:56] Caching tarball of preloaded images

	I0428 23:58:59.622553   36356 preload.go:173] Found /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0428 23:58:59.622565   36356 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0428 23:58:59.622681   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:58:59.622874   36356 start.go:360] acquireMachinesLock for ha-274394-m03: {Name:mkf607109012ed2f4aeb283e90eb20782d746716 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0428 23:58:59.622929   36356 start.go:364] duration metric: took 33.665µs to acquireMachinesLock for "ha-274394-m03"

	I0428 23:58:59.622950   36356 start.go:93] Provisioning new machine with config: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-d

ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimi

zations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:58:59.623064   36356 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0428 23:58:59.624667   36356 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0428 23:58:59.624758   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:59.624802   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:59.641214   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42821

	I0428 23:58:59.641727   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:59.642309   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:59.642334   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:59.642611   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:59.642804   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:58:59.642927   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:58:59.643066   36356 start.go:159] libmachine.API.Create for "ha-274394" (driver="kvm2")

	I0428 23:58:59.643091   36356 client.go:168] LocalClient.Create starting

	I0428 23:58:59.643121   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem

	I0428 23:58:59.643154   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:58:59.643179   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:58:59.643227   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem

	I0428 23:58:59.643249   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:58:59.643260   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:58:59.643281   36356 main.go:141] libmachine: Running pre-create checks...

	I0428 23:58:59.643296   36356 main.go:141] libmachine: (ha-274394-m03) Calling .PreCreateCheck

	I0428 23:58:59.643479   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetConfigRaw

	I0428 23:58:59.643879   36356 main.go:141] libmachine: Creating machine...

	I0428 23:58:59.643892   36356 main.go:141] libmachine: (ha-274394-m03) Calling .Create

	I0428 23:58:59.644001   36356 main.go:141] libmachine: (ha-274394-m03) Creating KVM machine...

	I0428 23:58:59.645183   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found existing default KVM network

	I0428 23:58:59.645266   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found existing private KVM network mk-ha-274394

	I0428 23:58:59.645383   36356 main.go:141] libmachine: (ha-274394-m03) Setting up store path in /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03 ...

	I0428 23:58:59.645406   36356 main.go:141] libmachine: (ha-274394-m03) Building disk image from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0428 23:58:59.645459   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.645378   37169 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:58:59.645569   36356 main.go:141] libmachine: (ha-274394-m03) Downloading /home/jenkins/minikube-integration/17977-13393/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0428 23:58:59.868035   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.867896   37169 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa...

	I0428 23:58:59.956656   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.956555   37169 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/ha-274394-m03.rawdisk...

	I0428 23:58:59.956683   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Writing magic tar header

	I0428 23:58:59.956697   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Writing SSH key tar header

	I0428 23:58:59.956708   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.956666   37169 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03 ...

	I0428 23:58:59.956777   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03

	I0428 23:58:59.956822   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines

	I0428 23:58:59.956840   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03 (perms=drwx------)

	I0428 23:58:59.956859   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines (perms=drwxr-xr-x)

	I0428 23:58:59.956873   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube (perms=drwxr-xr-x)

	I0428 23:58:59.956887   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393 (perms=drwxrwxr-x)

	I0428 23:58:59.956902   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:58:59.956914   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0428 23:58:59.956933   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0428 23:58:59.956960   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393

	I0428 23:58:59.956971   36356 main.go:141] libmachine: (ha-274394-m03) Creating domain...

	I0428 23:58:59.956990   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0428 23:58:59.957007   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins

	I0428 23:58:59.957021   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home

	I0428 23:58:59.957038   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Skipping /home - not owner

	I0428 23:58:59.957806   36356 main.go:141] libmachine: (ha-274394-m03) define libvirt domain using xml: 

	I0428 23:58:59.957828   36356 main.go:141] libmachine: (ha-274394-m03) <domain type='kvm'>

	I0428 23:58:59.957838   36356 main.go:141] libmachine: (ha-274394-m03)   <name>ha-274394-m03</name>

	I0428 23:58:59.957853   36356 main.go:141] libmachine: (ha-274394-m03)   <memory unit='MiB'>2200</memory>

	I0428 23:58:59.957866   36356 main.go:141] libmachine: (ha-274394-m03)   <vcpu>2</vcpu>

	I0428 23:58:59.957877   36356 main.go:141] libmachine: (ha-274394-m03)   <features>

	I0428 23:58:59.957887   36356 main.go:141] libmachine: (ha-274394-m03)     <acpi/>

	I0428 23:58:59.957898   36356 main.go:141] libmachine: (ha-274394-m03)     <apic/>

	I0428 23:58:59.957909   36356 main.go:141] libmachine: (ha-274394-m03)     <pae/>

	I0428 23:58:59.957920   36356 main.go:141] libmachine: (ha-274394-m03)     

	I0428 23:58:59.957929   36356 main.go:141] libmachine: (ha-274394-m03)   </features>

	I0428 23:58:59.957941   36356 main.go:141] libmachine: (ha-274394-m03)   <cpu mode='host-passthrough'>

	I0428 23:58:59.957968   36356 main.go:141] libmachine: (ha-274394-m03)   

	I0428 23:58:59.957989   36356 main.go:141] libmachine: (ha-274394-m03)   </cpu>

	I0428 23:58:59.958001   36356 main.go:141] libmachine: (ha-274394-m03)   <os>

	I0428 23:58:59.958017   36356 main.go:141] libmachine: (ha-274394-m03)     <type>hvm</type>

	I0428 23:58:59.958046   36356 main.go:141] libmachine: (ha-274394-m03)     <boot dev='cdrom'/>

	I0428 23:58:59.958059   36356 main.go:141] libmachine: (ha-274394-m03)     <boot dev='hd'/>

	I0428 23:58:59.958069   36356 main.go:141] libmachine: (ha-274394-m03)     <bootmenu enable='no'/>

	I0428 23:58:59.958080   36356 main.go:141] libmachine: (ha-274394-m03)   </os>

	I0428 23:58:59.958092   36356 main.go:141] libmachine: (ha-274394-m03)   <devices>

	I0428 23:58:59.958105   36356 main.go:141] libmachine: (ha-274394-m03)     <disk type='file' device='cdrom'>

	I0428 23:58:59.958119   36356 main.go:141] libmachine: (ha-274394-m03)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/boot2docker.iso'/>

	I0428 23:58:59.958132   36356 main.go:141] libmachine: (ha-274394-m03)       <target dev='hdc' bus='scsi'/>

	I0428 23:58:59.958144   36356 main.go:141] libmachine: (ha-274394-m03)       <readonly/>

	I0428 23:58:59.958155   36356 main.go:141] libmachine: (ha-274394-m03)     </disk>

	I0428 23:58:59.958169   36356 main.go:141] libmachine: (ha-274394-m03)     <disk type='file' device='disk'>

	I0428 23:58:59.958187   36356 main.go:141] libmachine: (ha-274394-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0428 23:58:59.958206   36356 main.go:141] libmachine: (ha-274394-m03)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/ha-274394-m03.rawdisk'/>

	I0428 23:58:59.958218   36356 main.go:141] libmachine: (ha-274394-m03)       <target dev='hda' bus='virtio'/>

	I0428 23:58:59.958230   36356 main.go:141] libmachine: (ha-274394-m03)     </disk>

	I0428 23:58:59.958242   36356 main.go:141] libmachine: (ha-274394-m03)     <interface type='network'>

	I0428 23:58:59.958274   36356 main.go:141] libmachine: (ha-274394-m03)       <source network='mk-ha-274394'/>

	I0428 23:58:59.958300   36356 main.go:141] libmachine: (ha-274394-m03)       <model type='virtio'/>

	I0428 23:58:59.958313   36356 main.go:141] libmachine: (ha-274394-m03)     </interface>

	I0428 23:58:59.958329   36356 main.go:141] libmachine: (ha-274394-m03)     <interface type='network'>

	I0428 23:58:59.958342   36356 main.go:141] libmachine: (ha-274394-m03)       <source network='default'/>

	I0428 23:58:59.958350   36356 main.go:141] libmachine: (ha-274394-m03)       <model type='virtio'/>

	I0428 23:58:59.958363   36356 main.go:141] libmachine: (ha-274394-m03)     </interface>

	I0428 23:58:59.958371   36356 main.go:141] libmachine: (ha-274394-m03)     <serial type='pty'>

	I0428 23:58:59.958382   36356 main.go:141] libmachine: (ha-274394-m03)       <target port='0'/>

	I0428 23:58:59.958390   36356 main.go:141] libmachine: (ha-274394-m03)     </serial>

	I0428 23:58:59.958401   36356 main.go:141] libmachine: (ha-274394-m03)     <console type='pty'>

	I0428 23:58:59.958417   36356 main.go:141] libmachine: (ha-274394-m03)       <target type='serial' port='0'/>

	I0428 23:58:59.958433   36356 main.go:141] libmachine: (ha-274394-m03)     </console>

	I0428 23:58:59.958450   36356 main.go:141] libmachine: (ha-274394-m03)     <rng model='virtio'>

	I0428 23:58:59.958464   36356 main.go:141] libmachine: (ha-274394-m03)       <backend model='random'>/dev/random</backend>

	I0428 23:58:59.958474   36356 main.go:141] libmachine: (ha-274394-m03)     </rng>

	I0428 23:58:59.958483   36356 main.go:141] libmachine: (ha-274394-m03)     

	I0428 23:58:59.958497   36356 main.go:141] libmachine: (ha-274394-m03)     

	I0428 23:58:59.958508   36356 main.go:141] libmachine: (ha-274394-m03)   </devices>

	I0428 23:58:59.958517   36356 main.go:141] libmachine: (ha-274394-m03) </domain>

	I0428 23:58:59.958532   36356 main.go:141] libmachine: (ha-274394-m03) 

	I0428 23:58:59.965013   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:ba:70:2d in network default

	I0428 23:58:59.965465   36356 main.go:141] libmachine: (ha-274394-m03) Ensuring networks are active...

	I0428 23:58:59.965490   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:58:59.966174   36356 main.go:141] libmachine: (ha-274394-m03) Ensuring network default is active

	I0428 23:58:59.966465   36356 main.go:141] libmachine: (ha-274394-m03) Ensuring network mk-ha-274394 is active

	I0428 23:58:59.966765   36356 main.go:141] libmachine: (ha-274394-m03) Getting domain xml...

	I0428 23:58:59.967422   36356 main.go:141] libmachine: (ha-274394-m03) Creating domain...

	I0428 23:59:01.202748   36356 main.go:141] libmachine: (ha-274394-m03) Waiting to get IP...

	I0428 23:59:01.203443   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:01.203897   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:01.203938   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:01.203872   37169 retry.go:31] will retry after 282.787142ms: waiting for machine to come up

	I0428 23:59:01.488289   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:01.488845   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:01.488880   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:01.488821   37169 retry.go:31] will retry after 311.074996ms: waiting for machine to come up

	I0428 23:59:01.801101   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:01.801590   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:01.801615   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:01.801538   37169 retry.go:31] will retry after 333.347197ms: waiting for machine to come up

	I0428 23:59:02.136222   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:02.136685   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:02.136722   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:02.136662   37169 retry.go:31] will retry after 515.127499ms: waiting for machine to come up

	I0428 23:59:02.652873   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:02.653262   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:02.653290   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:02.653217   37169 retry.go:31] will retry after 472.600429ms: waiting for machine to come up

	I0428 23:59:03.127829   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:03.128260   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:03.128285   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:03.128216   37169 retry.go:31] will retry after 918.328461ms: waiting for machine to come up

	I0428 23:59:04.047989   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:04.048469   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:04.048501   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:04.048401   37169 retry.go:31] will retry after 1.054046887s: waiting for machine to come up

	I0428 23:59:05.104188   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:05.104616   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:05.104654   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:05.104563   37169 retry.go:31] will retry after 1.317728284s: waiting for machine to come up

	I0428 23:59:06.424099   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:06.424567   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:06.424603   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:06.424502   37169 retry.go:31] will retry after 1.54429179s: waiting for machine to come up

	I0428 23:59:07.971097   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:07.971619   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:07.971640   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:07.971572   37169 retry.go:31] will retry after 1.943348331s: waiting for machine to come up

	I0428 23:59:09.916650   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:09.917110   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:09.917138   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:09.917059   37169 retry.go:31] will retry after 2.643143471s: waiting for machine to come up

	I0428 23:59:12.563295   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:12.563756   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:12.563783   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:12.563719   37169 retry.go:31] will retry after 3.420586328s: waiting for machine to come up

	I0428 23:59:15.986099   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:15.986542   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:15.986573   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:15.986487   37169 retry.go:31] will retry after 3.581143816s: waiting for machine to come up

	I0428 23:59:19.571466   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:19.571889   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:19.571918   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:19.571850   37169 retry.go:31] will retry after 5.55088001s: waiting for machine to come up

	I0428 23:59:25.124118   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:25.124562   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has current primary IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:25.124584   36356 main.go:141] libmachine: (ha-274394-m03) Found IP for machine: 192.168.39.250

	I0428 23:59:25.124598   36356 main.go:141] libmachine: (ha-274394-m03) Reserving static IP address...

	I0428 23:59:25.124921   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find host DHCP lease matching {name: "ha-274394-m03", mac: "52:54:00:0d:4c:dd", ip: "192.168.39.250"} in network mk-ha-274394

	I0428 23:59:25.197142   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Getting to WaitForSSH function...

	I0428 23:59:25.197166   36356 main.go:141] libmachine: (ha-274394-m03) Reserved static IP address: 192.168.39.250

	I0428 23:59:25.197212   36356 main.go:141] libmachine: (ha-274394-m03) Waiting for SSH to be available...

	I0428 23:59:25.199898   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:25.200254   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394

	I0428 23:59:25.200280   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find defined IP address of network mk-ha-274394 interface with MAC address 52:54:00:0d:4c:dd

	I0428 23:59:25.200392   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH client type: external

	I0428 23:59:25.200415   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa (-rw-------)

	I0428 23:59:25.200454   36356 main.go:141] libmachine: (ha-274394-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:59:25.200480   36356 main.go:141] libmachine: (ha-274394-m03) DBG | About to run SSH command:

	I0428 23:59:25.200505   36356 main.go:141] libmachine: (ha-274394-m03) DBG | exit 0

	I0428 23:59:25.204174   36356 main.go:141] libmachine: (ha-274394-m03) DBG | SSH cmd err, output: exit status 255: 

	I0428 23:59:25.204192   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0428 23:59:25.204202   36356 main.go:141] libmachine: (ha-274394-m03) DBG | command : exit 0

	I0428 23:59:25.204210   36356 main.go:141] libmachine: (ha-274394-m03) DBG | err     : exit status 255

	I0428 23:59:25.204221   36356 main.go:141] libmachine: (ha-274394-m03) DBG | output  : 

	I0428 23:59:28.206195   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Getting to WaitForSSH function...

	I0428 23:59:28.209965   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.210449   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.210480   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.210638   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH client type: external

	I0428 23:59:28.210667   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa (-rw-------)

	I0428 23:59:28.210707   36356 main.go:141] libmachine: (ha-274394-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.250 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:59:28.210727   36356 main.go:141] libmachine: (ha-274394-m03) DBG | About to run SSH command:

	I0428 23:59:28.210742   36356 main.go:141] libmachine: (ha-274394-m03) DBG | exit 0

	I0428 23:59:28.338185   36356 main.go:141] libmachine: (ha-274394-m03) DBG | SSH cmd err, output: <nil>: 

	I0428 23:59:28.338430   36356 main.go:141] libmachine: (ha-274394-m03) KVM machine creation complete!

	I0428 23:59:28.338791   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetConfigRaw

	I0428 23:59:28.339377   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:28.339584   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:28.339791   36356 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0428 23:59:28.339811   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0428 23:59:28.341407   36356 main.go:141] libmachine: Detecting operating system of created instance...

	I0428 23:59:28.341426   36356 main.go:141] libmachine: Waiting for SSH to be available...

	I0428 23:59:28.341433   36356 main.go:141] libmachine: Getting to WaitForSSH function...

	I0428 23:59:28.341441   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.343848   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.344223   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.344248   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.344376   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.344530   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.344668   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.344809   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.344963   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.345166   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.345177   36356 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0428 23:59:28.457369   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:59:28.457393   36356 main.go:141] libmachine: Detecting the provisioner...

	I0428 23:59:28.457401   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.459831   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.460234   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.460254   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.460462   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.460635   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.460795   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.460929   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.461110   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.461319   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.461334   36356 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0428 23:59:28.575513   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0428 23:59:28.575577   36356 main.go:141] libmachine: found compatible host: buildroot

	I0428 23:59:28.575591   36356 main.go:141] libmachine: Provisioning with buildroot...

	I0428 23:59:28.575599   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:59:28.575836   36356 buildroot.go:166] provisioning hostname "ha-274394-m03"

	I0428 23:59:28.575863   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:59:28.576068   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.578532   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.578931   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.578960   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.579060   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.579211   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.579335   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.579444   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.579637   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.579820   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.579837   36356 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-274394-m03 && echo "ha-274394-m03" | sudo tee /etc/hostname

	I0428 23:59:28.712688   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-274394-m03

	I0428 23:59:28.712717   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.715733   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.716152   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.716191   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.716417   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.716624   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.716814   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.716966   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.717155   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.717357   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.717380   36356 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-274394-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-274394-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-274394-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0428 23:59:28.841508   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:59:28.841559   36356 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17977-13393/.minikube CaCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17977-13393/.minikube}

	I0428 23:59:28.841576   36356 buildroot.go:174] setting up certificates

	I0428 23:59:28.841586   36356 provision.go:84] configureAuth start

	I0428 23:59:28.841595   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:59:28.841879   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:28.845193   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.845548   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.845578   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.845693   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.847976   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.848368   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.848393   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.848514   36356 provision.go:143] copyHostCerts

	I0428 23:59:28.848537   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:59:28.848565   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem, removing ...

	I0428 23:59:28.848573   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:59:28.848635   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem (1123 bytes)

	I0428 23:59:28.848714   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:59:28.848732   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem, removing ...

	I0428 23:59:28.848739   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:59:28.848762   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem (1675 bytes)

	I0428 23:59:28.848811   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:59:28.848827   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem, removing ...

	I0428 23:59:28.848833   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:59:28.848853   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem (1082 bytes)

	I0428 23:59:28.848903   36356 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem org=jenkins.ha-274394-m03 san=[127.0.0.1 192.168.39.250 ha-274394-m03 localhost minikube]

	I0428 23:59:29.012952   36356 provision.go:177] copyRemoteCerts

	I0428 23:59:29.013023   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0428 23:59:29.013055   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.015566   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.015904   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.015935   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.016127   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.016358   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.016550   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.016710   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:29.109376   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0428 23:59:29.109447   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0428 23:59:29.140078   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0428 23:59:29.140132   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0428 23:59:29.170421   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0428 23:59:29.170498   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0428 23:59:29.196503   36356 provision.go:87] duration metric: took 354.905712ms to configureAuth

	I0428 23:59:29.196530   36356 buildroot.go:189] setting minikube options for container-runtime

	I0428 23:59:29.196783   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:59:29.196853   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.199543   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.199885   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.199907   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.200083   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.200254   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.200404   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.200525   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.200690   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:29.200838   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:29.200853   36356 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0428 23:59:29.503246   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0428 23:59:29.503276   36356 main.go:141] libmachine: Checking connection to Docker...

	I0428 23:59:29.503287   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetURL

	I0428 23:59:29.504495   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using libvirt version 6000000

	I0428 23:59:29.506850   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.507214   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.507241   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.507419   36356 main.go:141] libmachine: Docker is up and running!

	I0428 23:59:29.507439   36356 main.go:141] libmachine: Reticulating splines...

	I0428 23:59:29.507446   36356 client.go:171] duration metric: took 29.864346558s to LocalClient.Create

	I0428 23:59:29.507469   36356 start.go:167] duration metric: took 29.864403952s to libmachine.API.Create "ha-274394"

	I0428 23:59:29.507478   36356 start.go:293] postStartSetup for "ha-274394-m03" (driver="kvm2")

	I0428 23:59:29.507488   36356 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0428 23:59:29.507509   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.507729   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0428 23:59:29.507746   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.510131   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.510522   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.510563   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.510678   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.510845   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.511001   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.511156   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:29.596901   36356 ssh_runner.go:195] Run: cat /etc/os-release

	I0428 23:59:29.601706   36356 info.go:137] Remote host: Buildroot 2023.02.9

	I0428 23:59:29.601727   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/addons for local assets ...

	I0428 23:59:29.601789   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/files for local assets ...

	I0428 23:59:29.601886   36356 filesync.go:149] local asset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> 207272.pem in /etc/ssl/certs

	I0428 23:59:29.601896   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /etc/ssl/certs/207272.pem

	I0428 23:59:29.602001   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0428 23:59:29.612235   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:59:29.639858   36356 start.go:296] duration metric: took 132.371288ms for postStartSetup

	I0428 23:59:29.639898   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetConfigRaw

	I0428 23:59:29.640442   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:29.643445   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.643832   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.643857   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.644181   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:59:29.644406   36356 start.go:128] duration metric: took 30.021329967s to createHost

	I0428 23:59:29.644432   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.646565   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.646909   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.646939   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.647052   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.647200   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.647366   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.647477   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.647640   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:29.647806   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:29.647818   36356 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0428 23:59:29.767512   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714348769.755757207

	I0428 23:59:29.767540   36356 fix.go:216] guest clock: 1714348769.755757207

	I0428 23:59:29.767552   36356 fix.go:229] Guest: 2024-04-28 23:59:29.755757207 +0000 UTC Remote: 2024-04-28 23:59:29.644418148 +0000 UTC m=+165.090306589 (delta=111.339059ms)

	I0428 23:59:29.767569   36356 fix.go:200] guest clock delta is within tolerance: 111.339059ms

	I0428 23:59:29.767575   36356 start.go:83] releasing machines lock for "ha-274394-m03", held for 30.144638005s

	I0428 23:59:29.767599   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.767844   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:29.770233   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.770627   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.770658   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.772993   36356 out.go:177] * Found network options:

	I0428 23:59:29.774437   36356 out.go:177]   - NO_PROXY=192.168.39.237,192.168.39.43

	W0428 23:59:29.775869   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	W0428 23:59:29.775892   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:59:29.775908   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.776440   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.776628   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.776720   36356 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0428 23:59:29.776749   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	W0428 23:59:29.776986   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	W0428 23:59:29.777012   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:59:29.777072   36356 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0428 23:59:29.777091   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.779588   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.779789   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.780023   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.780062   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.780288   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.780325   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.780341   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.780487   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.780497   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.780688   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.780693   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.780882   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.780886   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:29.781047   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:30.022766   36356 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0428 23:59:30.029806   36356 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0428 23:59:30.029872   36356 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0428 23:59:30.049513   36356 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0428 23:59:30.049537   36356 start.go:494] detecting cgroup driver to use...

	I0428 23:59:30.049602   36356 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0428 23:59:30.067833   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0428 23:59:30.084419   36356 docker.go:217] disabling cri-docker service (if available) ...

	I0428 23:59:30.084490   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0428 23:59:30.101260   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0428 23:59:30.118454   36356 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0428 23:59:30.245117   36356 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0428 23:59:30.402173   36356 docker.go:233] disabling docker service ...

	I0428 23:59:30.402240   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0428 23:59:30.419742   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0428 23:59:30.434799   36356 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0428 23:59:30.586310   36356 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0428 23:59:30.701297   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0428 23:59:30.717873   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0428 23:59:30.740576   36356 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0428 23:59:30.740637   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.755747   36356 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0428 23:59:30.755821   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.769519   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.783158   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.800160   36356 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0428 23:59:30.812526   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.824663   36356 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.845871   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.858527   36356 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0428 23:59:30.871070   36356 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0428 23:59:30.871116   36356 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0428 23:59:30.892560   36356 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0428 23:59:30.906892   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:59:31.047857   36356 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0428 23:59:31.608180   36356 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0428 23:59:31.608258   36356 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0428 23:59:31.613650   36356 start.go:562] Will wait 60s for crictl version

	I0428 23:59:31.613712   36356 ssh_runner.go:195] Run: which crictl

	I0428 23:59:31.618572   36356 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0428 23:59:31.667744   36356 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0428 23:59:31.667841   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:59:31.698887   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:59:31.732978   36356 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0428 23:59:31.734467   36356 out.go:177]   - env NO_PROXY=192.168.39.237

	I0428 23:59:31.735737   36356 out.go:177]   - env NO_PROXY=192.168.39.237,192.168.39.43

	I0428 23:59:31.736997   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:31.739814   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:31.740186   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:31.740216   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:31.740374   36356 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0428 23:59:31.745539   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:59:31.759169   36356 mustload.go:65] Loading cluster: ha-274394

	I0428 23:59:31.759367   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:59:31.759592   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:59:31.759625   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:59:31.774099   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36133

	I0428 23:59:31.774493   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:59:31.774982   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:59:31.775008   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:59:31.775303   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:59:31.775488   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:59:31.777010   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:59:31.777277   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:59:31.777308   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:59:31.791488   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37067

	I0428 23:59:31.791874   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:59:31.792798   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:59:31.792816   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:59:31.793108   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:59:31.793289   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:59:31.793448   36356 certs.go:68] Setting up /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394 for IP: 192.168.39.250

	I0428 23:59:31.793462   36356 certs.go:194] generating shared ca certs ...

	I0428 23:59:31.793482   36356 certs.go:226] acquiring lock for ca certs: {Name:mka5d31eea282c20e045cfb5e09273edc965e467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:59:31.793619   36356 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key

	I0428 23:59:31.793657   36356 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key

	I0428 23:59:31.793665   36356 certs.go:256] generating profile certs ...

	I0428 23:59:31.793730   36356 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key

	I0428 23:59:31.793754   36356 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005

	I0428 23:59:31.793767   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.237 192.168.39.43 192.168.39.250 192.168.39.254]

	I0428 23:59:31.935877   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005 ...

	I0428 23:59:31.935910   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005: {Name:mkb1d55f40172ee8436492fe8f68a99e68fc03c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:59:31.936096   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005 ...

	I0428 23:59:31.936114   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005: {Name:mka939da220f505a93b36da1922b3c1aa6b40303 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:59:31.936219   36356 certs.go:381] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt

	I0428 23:59:31.936357   36356 certs.go:385] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key

	I0428 23:59:31.936484   36356 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key

	I0428 23:59:31.936501   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0428 23:59:31.936513   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0428 23:59:31.936526   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0428 23:59:31.936537   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0428 23:59:31.936547   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0428 23:59:31.936557   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0428 23:59:31.936567   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0428 23:59:31.936577   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0428 23:59:31.936618   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem (1338 bytes)

	W0428 23:59:31.936644   36356 certs.go:480] ignoring /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727_empty.pem, impossibly tiny 0 bytes

	I0428 23:59:31.936653   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem (1675 bytes)

	I0428 23:59:31.936674   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem (1082 bytes)

	I0428 23:59:31.936698   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem (1123 bytes)

	I0428 23:59:31.936718   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem (1675 bytes)

	I0428 23:59:31.936753   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:59:31.936778   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /usr/share/ca-certificates/207272.pem

	I0428 23:59:31.936791   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:31.936803   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem -> /usr/share/ca-certificates/20727.pem

	I0428 23:59:31.936841   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:59:31.939693   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:31.940099   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:59:31.940126   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:31.940327   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:59:31.940489   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:59:31.940610   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:59:31.940730   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:59:32.014500   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0428 23:59:32.019823   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0428 23:59:32.035881   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0428 23:59:32.040779   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0428 23:59:32.057077   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0428 23:59:32.062345   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0428 23:59:32.076399   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0428 23:59:32.083489   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0428 23:59:32.100707   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0428 23:59:32.105612   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0428 23:59:32.119597   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0428 23:59:32.124604   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0428 23:59:32.138154   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0428 23:59:32.170086   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0428 23:59:32.198963   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0428 23:59:32.226907   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0428 23:59:32.253636   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0428 23:59:32.278554   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0428 23:59:32.304986   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0428 23:59:32.331547   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0428 23:59:32.359245   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /usr/share/ca-certificates/207272.pem (1708 bytes)

	I0428 23:59:32.388215   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0428 23:59:32.415247   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem --> /usr/share/ca-certificates/20727.pem (1338 bytes)

	I0428 23:59:32.442937   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0428 23:59:32.462088   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0428 23:59:32.485219   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0428 23:59:32.505466   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0428 23:59:32.524971   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0428 23:59:32.543452   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0428 23:59:32.561866   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0428 23:59:32.580866   36356 ssh_runner.go:195] Run: openssl version

	I0428 23:59:32.587281   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/207272.pem && ln -fs /usr/share/ca-certificates/207272.pem /etc/ssl/certs/207272.pem"

	I0428 23:59:32.599497   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/207272.pem

	I0428 23:59:32.604579   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 28 23:49 /usr/share/ca-certificates/207272.pem

	I0428 23:59:32.604620   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/207272.pem

	I0428 23:59:32.610534   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/207272.pem /etc/ssl/certs/3ec20f2e.0"

	I0428 23:59:32.622113   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0428 23:59:32.633898   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:32.639105   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 28 23:08 /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:32.639152   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:32.645086   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0428 23:59:32.656327   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20727.pem && ln -fs /usr/share/ca-certificates/20727.pem /etc/ssl/certs/20727.pem"

	I0428 23:59:32.667538   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20727.pem

	I0428 23:59:32.672551   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 28 23:49 /usr/share/ca-certificates/20727.pem

	I0428 23:59:32.672585   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20727.pem

	I0428 23:59:32.679007   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20727.pem /etc/ssl/certs/51391683.0"

	I0428 23:59:32.691035   36356 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0428 23:59:32.695662   36356 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0428 23:59:32.695716   36356 kubeadm.go:928] updating node {m03 192.168.39.250 8443 v1.30.0 crio true true} ...

	I0428 23:59:32.695808   36356 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-274394-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.250

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0428 23:59:32.695835   36356 kube-vip.go:111] generating kube-vip config ...

	I0428 23:59:32.695872   36356 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0428 23:59:32.712399   36356 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0428 23:59:32.712452   36356 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0428 23:59:32.712493   36356 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0428 23:59:32.722354   36356 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0428 23:59:32.722390   36356 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0428 23:59:32.733638   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0428 23:59:32.733661   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:59:32.733670   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256

	I0428 23:59:32.733674   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256

	I0428 23:59:32.733720   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0428 23:59:32.733727   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:59:32.733688   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:59:32.733893   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:59:32.743978   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0428 23:59:32.744010   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0428 23:59:32.754412   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:59:32.754479   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0428 23:59:32.754511   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0428 23:59:32.754529   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:59:32.811837   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0428 23:59:32.811888   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0428 23:59:33.742700   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0428 23:59:33.754911   36356 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0428 23:59:33.775851   36356 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0428 23:59:33.794540   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0428 23:59:33.812285   36356 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0428 23:59:33.816564   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:59:33.831086   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:59:33.959822   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:59:33.979990   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:59:33.980339   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:59:33.980381   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:59:33.995673   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39919

	I0428 23:59:33.996168   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:59:33.996792   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:59:33.996826   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:59:33.997145   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:59:33.997356   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:59:33.997488   36356 start.go:316] joinCluster: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false i

nspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fa

lse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:59:33.997595   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0428 23:59:33.997609   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:59:34.000823   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:34.001251   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:59:34.001282   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:34.001440   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:59:34.001603   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:59:34.001747   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:59:34.001869   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:59:34.163965   36356 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:59:34.164013   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token xjl1hv.qr8jswflfz5d4crm --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443"

	I0428 23:59:57.753188   36356 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token xjl1hv.qr8jswflfz5d4crm --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443": (23.589146569s)

	I0428 23:59:57.753234   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0428 23:59:58.433673   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-274394-m03 minikube.k8s.io/updated_at=2024_04_28T23_59_58_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328 minikube.k8s.io/name=ha-274394 minikube.k8s.io/primary=false

	I0428 23:59:58.575531   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-274394-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0428 23:59:58.699252   36356 start.go:318] duration metric: took 24.701760658s to joinCluster

	I0428 23:59:58.699325   36356 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:59:58.700772   36356 out.go:177] * Verifying Kubernetes components...

	I0428 23:59:58.699710   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:59:58.702011   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:59:58.992947   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:59:59.039022   36356 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:59:59.039347   36356 kapi.go:59] client config for ha-274394: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt", KeyFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key", CAFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0428 23:59:59.039423   36356 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.237:8443

	I0428 23:59:59.039662   36356 node_ready.go:35] waiting up to 6m0s for node "ha-274394-m03" to be "Ready" ...

	I0428 23:59:59.039739   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0428 23:59:59.039749   36356 round_trippers.go:469] Request Headers:

	I0428 23:59:59.039761   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:59:59.039769   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:59:59.044215   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:59:59.540563   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0428 23:59:59.540595   36356 round_trippers.go:469] Request Headers:

	I0428 23:59:59.540605   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:59:59.540611   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:59:59.545042   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:00.040363   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:00.040387   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:00.040395   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:00.040399   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:00.052445   36356 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I0429 00:00:00.540532   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:00.540560   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:00.540570   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:00.540575   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:00.544839   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:01.040082   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:01.040105   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:01.040113   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:01.040116   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:01.043721   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:01.044695   36356 node_ready.go:53] node "ha-274394-m03" has status "Ready":"False"

	I0429 00:00:01.540152   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:01.540175   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:01.540182   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:01.540185   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:01.544113   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:02.040892   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:02.040915   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:02.040926   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:02.040933   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:02.045818   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:02.539953   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:02.539976   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:02.539983   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:02.539988   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:02.544199   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:03.040237   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:03.040265   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:03.040276   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:03.040282   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:03.045325   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:03.046199   36356 node_ready.go:53] node "ha-274394-m03" has status "Ready":"False"

	I0429 00:00:03.540612   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:03.540637   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:03.540650   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:03.540654   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:03.545488   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:04.040836   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:04.040868   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:04.040887   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:04.040895   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:04.046280   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:04.540501   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:04.540527   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:04.540544   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:04.540551   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:04.544986   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:05.040393   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:05.040420   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:05.040429   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:05.040437   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:05.045045   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:05.046512   36356 node_ready.go:53] node "ha-274394-m03" has status "Ready":"False"

	I0429 00:00:05.540289   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:05.540310   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:05.540316   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:05.540320   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:05.545290   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:06.040177   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:06.040197   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:06.040203   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:06.040207   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:06.051024   36356 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0429 00:00:06.540102   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:06.540136   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:06.540144   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:06.540148   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:06.544263   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.039962   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.039982   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.039990   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.039995   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.044076   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.540106   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.540132   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.540145   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.540151   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.543779   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.544580   36356 node_ready.go:49] node "ha-274394-m03" has status "Ready":"True"

	I0429 00:00:07.544602   36356 node_ready.go:38] duration metric: took 8.504923556s for node "ha-274394-m03" to be "Ready" ...

	I0429 00:00:07.544611   36356 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 00:00:07.544667   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:07.544677   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.544684   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.544687   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.553653   36356 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 00:00:07.561698   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.561817   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rslhx

	I0429 00:00:07.561827   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.561838   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.561847   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.565506   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.566518   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:07.566534   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.566540   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.566545   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.569905   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.570543   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.570562   36356 pod_ready.go:81] duration metric: took 8.831944ms for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.570571   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.570622   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-xkdcv

	I0429 00:00:07.570630   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.570636   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.570640   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.574999   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.576125   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:07.576146   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.576157   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.576161   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.580599   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.581239   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.581256   36356 pod_ready.go:81] duration metric: took 10.67917ms for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.581274   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.581333   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394

	I0429 00:00:07.581342   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.581394   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.581408   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.589396   36356 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 00:00:07.590368   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:07.590389   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.590396   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.590401   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.593754   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.594461   36356 pod_ready.go:92] pod "etcd-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.594479   36356 pod_ready.go:81] duration metric: took 13.196822ms for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.594491   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.594550   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0429 00:00:07.594561   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.594571   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.594579   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.598205   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.598968   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:07.598989   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.598997   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.599003   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.602493   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.603262   36356 pod_ready.go:92] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.603287   36356 pod_ready.go:81] duration metric: took 8.787518ms for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.603300   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.740735   36356 request.go:629] Waited for 137.335456ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:07.740793   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:07.740799   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.740806   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.740810   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.744904   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.940222   36356 request.go:629] Waited for 194.103628ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.940293   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.940300   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.940311   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.940320   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.944388   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:08.140733   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:08.140759   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.140768   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.140772   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.146200   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:08.340435   36356 request.go:629] Waited for 193.229978ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.340527   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.340535   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.340548   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.340554   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.348074   36356 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 00:00:08.603651   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:08.603675   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.603684   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.603690   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.607841   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:08.740178   36356 request.go:629] Waited for 131.240032ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.740243   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.740251   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.740262   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.740269   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.744106   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:09.104560   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:09.104580   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.104587   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.104593   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.109646   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:09.141091   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:09.141121   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.141133   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.141140   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.145148   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:09.604524   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:09.606661   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.606683   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.606690   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.612435   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:09.614907   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:09.614925   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.614932   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.614936   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.618703   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:09.619548   36356 pod_ready.go:102] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 00:00:10.103536   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:10.103614   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.103630   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.103638   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.109798   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 00:00:10.111485   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:10.111504   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.111515   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.111522   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.115064   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:10.604281   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:10.604310   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.604320   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.604325   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.609142   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:10.610464   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:10.610484   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.610495   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.610500   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.616566   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 00:00:11.103607   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:11.103632   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.103642   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.103646   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.107835   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:11.108744   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:11.108761   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.108768   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.108772   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.111862   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:11.603444   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:11.603463   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.603470   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.603475   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.607641   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:11.608655   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:11.608670   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.608682   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.608686   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.612140   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:12.104123   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:12.104145   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.104152   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.104156   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.108430   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:12.109205   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:12.109221   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.109228   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.109234   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.113119   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:12.113849   36356 pod_ready.go:102] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 00:00:12.604327   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:12.604352   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.604363   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.604367   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.609419   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:12.610396   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:12.610415   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.610424   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.610429   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.613931   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:13.103988   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:13.104013   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.104020   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.104024   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.108252   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:13.109306   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:13.109326   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.109336   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.109342   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.113607   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:13.603763   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:13.603785   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.603795   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.603800   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.608023   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:13.608911   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:13.608963   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.608978   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.608983   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.612695   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.104203   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:14.104224   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.104233   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.104238   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.110775   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 00:00:14.111901   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.111922   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.111932   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.111937   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.124604   36356 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I0429 00:00:14.125329   36356 pod_ready.go:102] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 00:00:14.603835   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:14.605874   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.605892   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.605898   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.610827   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:14.611910   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.611925   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.611932   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.611936   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.616291   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:14.616947   36356 pod_ready.go:92] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.616966   36356 pod_ready.go:81] duration metric: took 7.0136586s for pod "etcd-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.616984   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.617056   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394

	I0429 00:00:14.617065   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.617072   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.617077   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.620266   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.620999   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:14.621015   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.621022   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.621028   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.624239   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.624743   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.624766   36356 pod_ready.go:81] duration metric: took 7.774137ms for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.624778   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.624845   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394-m02

	I0429 00:00:14.624856   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.624864   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.624868   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.628427   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.629157   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:14.629170   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.629177   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.629180   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.632260   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.632852   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.632874   36356 pod_ready.go:81] duration metric: took 8.087549ms for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.632887   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.632958   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394-m03

	I0429 00:00:14.632969   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.632979   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.632988   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.636284   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.740734   36356 request.go:629] Waited for 103.678901ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.740817   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.740831   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.740841   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.740846   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.773084   36356 round_trippers.go:574] Response Status: 200 OK in 32 milliseconds

	I0429 00:00:14.773907   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.773924   36356 pod_ready.go:81] duration metric: took 141.027444ms for pod "kube-apiserver-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.773933   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.940281   36356 request.go:629] Waited for 166.264237ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394

	I0429 00:00:14.940343   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394

	I0429 00:00:14.940349   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.940360   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.940365   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.944365   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:15.140345   36356 request.go:629] Waited for 195.163934ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:15.140423   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:15.140431   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.140439   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.140444   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.144062   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:15.144848   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:15.144866   36356 pod_ready.go:81] duration metric: took 370.926651ms for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.144875   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.340256   36356 request.go:629] Waited for 195.311171ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m02

	I0429 00:00:15.340322   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m02

	I0429 00:00:15.340327   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.340355   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.340361   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.347923   36356 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 00:00:15.540947   36356 request.go:629] Waited for 191.397388ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:15.541007   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:15.541019   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.541026   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.541034   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.545131   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:15.545894   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:15.545917   36356 pod_ready.go:81] duration metric: took 401.034522ms for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.545930   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.740918   36356 request.go:629] Waited for 194.911345ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m03

	I0429 00:00:15.741006   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m03

	I0429 00:00:15.741012   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.741021   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.741028   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.746377   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:15.940547   36356 request.go:629] Waited for 193.382908ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:15.940633   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:15.940646   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.940656   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.940661   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.946477   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:15.947225   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:15.947250   36356 pod_ready.go:81] duration metric: took 401.3069ms for pod "kube-controller-manager-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.947264   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4rb7k" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.140188   36356 request.go:629] Waited for 192.839853ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4rb7k

	I0429 00:00:16.140294   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4rb7k

	I0429 00:00:16.140312   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.140324   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.140332   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.145774   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:16.340228   36356 request.go:629] Waited for 193.697798ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:16.340310   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:16.340317   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.340329   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.340339   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.344612   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:16.345393   36356 pod_ready.go:92] pod "kube-proxy-4rb7k" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:16.345411   36356 pod_ready.go:81] duration metric: took 398.139664ms for pod "kube-proxy-4rb7k" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.345423   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.540629   36356 request.go:629] Waited for 195.13398ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0429 00:00:16.540716   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0429 00:00:16.540728   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.540738   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.540747   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.545764   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:16.740862   36356 request.go:629] Waited for 194.341193ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:16.740912   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:16.740917   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.740924   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.740928   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.744945   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:16.745580   36356 pod_ready.go:92] pod "kube-proxy-g95c9" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:16.745613   36356 pod_ready.go:81] duration metric: took 400.179822ms for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.745629   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.940209   36356 request.go:629] Waited for 194.512821ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0429 00:00:16.940295   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0429 00:00:16.940311   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.940321   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.940332   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.944152   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:17.140530   36356 request.go:629] Waited for 195.395948ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.140617   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.140631   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.140641   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.140648   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.146669   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:17.147419   36356 pod_ready.go:92] pod "kube-proxy-pwbfs" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:17.147443   36356 pod_ready.go:81] duration metric: took 401.8052ms for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.147454   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.340500   36356 request.go:629] Waited for 192.965416ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0429 00:00:17.340634   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0429 00:00:17.340647   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.340655   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.340670   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.344716   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:17.540937   36356 request.go:629] Waited for 195.33873ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.541019   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.541031   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.541042   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.541052   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.545973   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:17.546666   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:17.546694   36356 pod_ready.go:81] duration metric: took 399.233302ms for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.546708   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.740796   36356 request.go:629] Waited for 193.996654ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0429 00:00:17.740856   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0429 00:00:17.740862   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.740869   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.740872   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.745935   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:17.940323   36356 request.go:629] Waited for 193.289642ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:17.940410   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:17.940419   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.940429   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.940440   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.945223   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:17.946163   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:17.946184   36356 pod_ready.go:81] duration metric: took 399.468104ms for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.946193   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:18.140175   36356 request.go:629] Waited for 193.91684ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m03

	I0429 00:00:18.140243   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m03

	I0429 00:00:18.140248   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.140276   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.140289   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.145196   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:18.340751   36356 request.go:629] Waited for 194.401601ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:18.340842   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:18.340851   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.340862   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.340873   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.344942   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:18.345590   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:18.345611   36356 pod_ready.go:81] duration metric: took 399.411796ms for pod "kube-scheduler-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:18.345623   36356 pod_ready.go:38] duration metric: took 10.801003405s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 00:00:18.345641   36356 api_server.go:52] waiting for apiserver process to appear ...

	I0429 00:00:18.345710   36356 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:00:18.374589   36356 api_server.go:72] duration metric: took 19.675227263s to wait for apiserver process to appear ...

	I0429 00:00:18.374620   36356 api_server.go:88] waiting for apiserver healthz status ...

	I0429 00:00:18.374648   36356 api_server.go:253] Checking apiserver healthz at https://192.168.39.237:8443/healthz ...

	I0429 00:00:18.379661   36356 api_server.go:279] https://192.168.39.237:8443/healthz returned 200:

	ok

	I0429 00:00:18.379729   36356 round_trippers.go:463] GET https://192.168.39.237:8443/version

	I0429 00:00:18.379740   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.379754   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.379761   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.380937   36356 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I0429 00:00:18.381043   36356 api_server.go:141] control plane version: v1.30.0

	I0429 00:00:18.381061   36356 api_server.go:131] duration metric: took 6.434791ms to wait for apiserver health ...

	I0429 00:00:18.381069   36356 system_pods.go:43] waiting for kube-system pods to appear ...

	I0429 00:00:18.540471   36356 request.go:629] Waited for 159.310973ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.540534   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.540539   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.540546   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.540552   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.553803   36356 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0429 00:00:18.561130   36356 system_pods.go:59] 24 kube-system pods found

	I0429 00:00:18.561159   36356 system_pods.go:61] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0429 00:00:18.561164   36356 system_pods.go:61] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0429 00:00:18.561167   36356 system_pods.go:61] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0429 00:00:18.561171   36356 system_pods.go:61] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0429 00:00:18.561174   36356 system_pods.go:61] "etcd-ha-274394-m03" [64d0cf43-d3cd-4054-b44a-e8b4f8a70b06] Running

	I0429 00:00:18.561176   36356 system_pods.go:61] "kindnet-29qlf" [915875ab-c1aa-46d6-b5e1-b6a7eff8dd64] Running

	I0429 00:00:18.561179   36356 system_pods.go:61] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0429 00:00:18.561182   36356 system_pods.go:61] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0429 00:00:18.561185   36356 system_pods.go:61] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0429 00:00:18.561188   36356 system_pods.go:61] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0429 00:00:18.561191   36356 system_pods.go:61] "kube-apiserver-ha-274394-m03" [a9546d9d-7c2a-45c4-a0a5-a5efea4a04d9] Running

	I0429 00:00:18.561194   36356 system_pods.go:61] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0429 00:00:18.561197   36356 system_pods.go:61] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0429 00:00:18.561200   36356 system_pods.go:61] "kube-controller-manager-ha-274394-m03" [f4094095-5c0c-4fb7-9c76-fb63e6c6eeb2] Running

	I0429 00:00:18.561203   36356 system_pods.go:61] "kube-proxy-4rb7k" [de261499-d4f2-44b0-869b-28ae3505f19f] Running

	I0429 00:00:18.561205   36356 system_pods.go:61] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0429 00:00:18.561209   36356 system_pods.go:61] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0429 00:00:18.561212   36356 system_pods.go:61] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0429 00:00:18.561214   36356 system_pods.go:61] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0429 00:00:18.561217   36356 system_pods.go:61] "kube-scheduler-ha-274394-m03" [7084f6de-4070-4d9b-b313-4b52f51123c7] Running

	I0429 00:00:18.561220   36356 system_pods.go:61] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0429 00:00:18.561222   36356 system_pods.go:61] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0429 00:00:18.561225   36356 system_pods.go:61] "kube-vip-ha-274394-m03" [bd6c2740-2068-4849-a23b-56d9ce0ac21c] Running

	I0429 00:00:18.561227   36356 system_pods.go:61] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0429 00:00:18.561232   36356 system_pods.go:74] duration metric: took 180.158592ms to wait for pod list to return data ...

	I0429 00:00:18.561240   36356 default_sa.go:34] waiting for default service account to be created ...

	I0429 00:00:18.740670   36356 request.go:629] Waited for 179.356953ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0429 00:00:18.740727   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0429 00:00:18.740739   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.740746   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.740750   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.745356   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:18.745474   36356 default_sa.go:45] found service account: "default"

	I0429 00:00:18.745492   36356 default_sa.go:55] duration metric: took 184.245419ms for default service account to be created ...

	I0429 00:00:18.745502   36356 system_pods.go:116] waiting for k8s-apps to be running ...

	I0429 00:00:18.940811   36356 request.go:629] Waited for 195.241974ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.940863   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.940868   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.940874   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.940886   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.950591   36356 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0429 00:00:18.957766   36356 system_pods.go:86] 24 kube-system pods found

	I0429 00:00:18.957805   36356 system_pods.go:89] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0429 00:00:18.957815   36356 system_pods.go:89] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0429 00:00:18.957821   36356 system_pods.go:89] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0429 00:00:18.957830   36356 system_pods.go:89] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0429 00:00:18.957836   36356 system_pods.go:89] "etcd-ha-274394-m03" [64d0cf43-d3cd-4054-b44a-e8b4f8a70b06] Running

	I0429 00:00:18.957844   36356 system_pods.go:89] "kindnet-29qlf" [915875ab-c1aa-46d6-b5e1-b6a7eff8dd64] Running

	I0429 00:00:18.957851   36356 system_pods.go:89] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0429 00:00:18.957859   36356 system_pods.go:89] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0429 00:00:18.957872   36356 system_pods.go:89] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0429 00:00:18.957880   36356 system_pods.go:89] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0429 00:00:18.957897   36356 system_pods.go:89] "kube-apiserver-ha-274394-m03" [a9546d9d-7c2a-45c4-a0a5-a5efea4a04d9] Running

	I0429 00:00:18.957905   36356 system_pods.go:89] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0429 00:00:18.957913   36356 system_pods.go:89] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0429 00:00:18.957924   36356 system_pods.go:89] "kube-controller-manager-ha-274394-m03" [f4094095-5c0c-4fb7-9c76-fb63e6c6eeb2] Running

	I0429 00:00:18.957932   36356 system_pods.go:89] "kube-proxy-4rb7k" [de261499-d4f2-44b0-869b-28ae3505f19f] Running

	I0429 00:00:18.957940   36356 system_pods.go:89] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0429 00:00:18.957947   36356 system_pods.go:89] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0429 00:00:18.957956   36356 system_pods.go:89] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0429 00:00:18.957968   36356 system_pods.go:89] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0429 00:00:18.957976   36356 system_pods.go:89] "kube-scheduler-ha-274394-m03" [7084f6de-4070-4d9b-b313-4b52f51123c7] Running

	I0429 00:00:18.957987   36356 system_pods.go:89] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0429 00:00:18.957996   36356 system_pods.go:89] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0429 00:00:18.958005   36356 system_pods.go:89] "kube-vip-ha-274394-m03" [bd6c2740-2068-4849-a23b-56d9ce0ac21c] Running

	I0429 00:00:18.958014   36356 system_pods.go:89] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0429 00:00:18.958039   36356 system_pods.go:126] duration metric: took 212.530081ms to wait for k8s-apps to be running ...

	I0429 00:00:18.958053   36356 system_svc.go:44] waiting for kubelet service to be running ....

	I0429 00:00:18.958113   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:00:18.980447   36356 system_svc.go:56] duration metric: took 22.384449ms WaitForService to wait for kubelet

	I0429 00:00:18.980482   36356 kubeadm.go:576] duration metric: took 20.281123012s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 00:00:18.980513   36356 node_conditions.go:102] verifying NodePressure condition ...

	I0429 00:00:19.140458   36356 request.go:629] Waited for 159.863326ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes

	I0429 00:00:19.140539   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes

	I0429 00:00:19.140546   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:19.140556   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:19.140562   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:19.145258   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:19.146414   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 00:00:19.146436   36356 node_conditions.go:123] node cpu capacity is 2

	I0429 00:00:19.146451   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 00:00:19.146457   36356 node_conditions.go:123] node cpu capacity is 2

	I0429 00:00:19.146462   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 00:00:19.146466   36356 node_conditions.go:123] node cpu capacity is 2

	I0429 00:00:19.146472   36356 node_conditions.go:105] duration metric: took 165.952797ms to run NodePressure ...

	I0429 00:00:19.146487   36356 start.go:240] waiting for startup goroutines ...

	I0429 00:00:19.146521   36356 start.go:254] writing updated cluster config ...

	I0429 00:00:19.146849   36356 ssh_runner.go:195] Run: rm -f paused

	I0429 00:00:19.201608   36356 start.go:600] kubectl: 1.30.0, cluster: 1.30.0 (minor skew: 0)

	I0429 00:00:19.204410   36356 out.go:177] * Done! kubectl is now configured to use "ha-274394" cluster and "default" namespace by default

	==> CRI-O <==

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.700779802Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349031700748842,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=8cce4929-83ef-4a9d-a821-40d33cb16add name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.703388752Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=38196304-8235-470b-a4b9-9001f627a350 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.703479686Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=38196304-8235-470b-a4b9-9001f627a350 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.703798784Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=38196304-8235-470b-a4b9-9001f627a350 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.760179536Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=e325ac5c-c163-4821-b825-7ce79374aa4f name=/runtime.v1.RuntimeService/Version

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.760312715Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=e325ac5c-c163-4821-b825-7ce79374aa4f name=/runtime.v1.RuntimeService/Version

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.762259793Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=478bf059-8844-4358-b660-ba8789dfe194 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.762882912Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349031762856169,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=478bf059-8844-4358-b660-ba8789dfe194 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.764042861Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=11027ab6-b2a8-4a5f-b38b-f1085d277508 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.764148088Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=11027ab6-b2a8-4a5f-b38b-f1085d277508 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.765086498Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=11027ab6-b2a8-4a5f-b38b-f1085d277508 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.825544162Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=bb81217a-b284-4f44-bf29-86a0b20c38fe name=/runtime.v1.RuntimeService/Version

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.825640838Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=bb81217a-b284-4f44-bf29-86a0b20c38fe name=/runtime.v1.RuntimeService/Version

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.828131945Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=7613cc29-0916-4060-bd4e-b055ed72bd34 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.829415816Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349031829388876,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=7613cc29-0916-4060-bd4e-b055ed72bd34 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.830033443Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=7b9ace68-c043-4a3d-9d85-d5285e37b6e5 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.830115521Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=7b9ace68-c043-4a3d-9d85-d5285e37b6e5 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.830355576Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=7b9ace68-c043-4a3d-9d85-d5285e37b6e5 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.879106749Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=ca668e6a-2e30-409d-8069-2b79c4ceaa0f name=/runtime.v1.RuntimeService/Version

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.879200770Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=ca668e6a-2e30-409d-8069-2b79c4ceaa0f name=/runtime.v1.RuntimeService/Version

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.880342234Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=b805b342-3fbd-4d2d-a385-0a8cfc1710bd name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.880812752Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349031880787506,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=b805b342-3fbd-4d2d-a385-0a8cfc1710bd name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.881506599Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=60011752-d923-4685-89bf-4e377a35b5d8 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.881556151Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=60011752-d923-4685-89bf-4e377a35b5d8 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:03:51 ha-274394 crio[683]: time="2024-04-29 00:03:51.881778796Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=60011752-d923-4685-89bf-4e377a35b5d8 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	6191db59237ab       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   7dc34422a092b       busybox-fc5497c4f-wwl6p

	39cef99138b5e       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   86b45c3768b5c       coredns-7db6d8ff4d-rslhx

	4b75dd2cf8167       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   0a16b0222b334       coredns-7db6d8ff4d-xkdcv

	2c766c3729b06       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      6 minutes ago       Running             storage-provisioner       0                   f1817cc9d2fb2       storage-provisioner

	229d446ccd2c1       4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5                                      6 minutes ago       Running             kindnet-cni               0                   24061593c71f1       kindnet-p6qmw

	10c90fba42aa7       a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b                                      6 minutes ago       Running             kube-proxy                0                   fe59c57afd7dc       kube-proxy-pwbfs

	1144436f5b67a       ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a     6 minutes ago       Running             kube-vip                  0                   f4f6e257f8d6f       kube-vip-ha-274394

	a2665b4434106       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      6 minutes ago       Running             etcd                      0                   9792afe7047da       etcd-ha-274394

	cd7d63b0cf58d       259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced                                      6 minutes ago       Running             kube-scheduler            0                   fb9c09a8e5609       kube-scheduler-ha-274394

	d4d50ed07ba22       c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0                                      6 minutes ago       Running             kube-apiserver            0                   974770f9d2d8d       kube-apiserver-ha-274394

	ec35813faf9fb       c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b                                      6 minutes ago       Running             kube-controller-manager   0                   d6f56935776d1       kube-controller-manager-ha-274394

	==> coredns [39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e] <==

	[INFO] 10.244.2.2:36735 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000169991s

	[INFO] 10.244.1.2:33891 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000130376s

	[INFO] 10.244.1.2:52014 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000135334s

	[INFO] 10.244.1.2:38829 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00166462s

	[INFO] 10.244.1.2:60722 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000098874s

	[INFO] 10.244.0.4:48543 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000092957s

	[INFO] 10.244.0.4:57804 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001823584s

	[INFO] 10.244.0.4:33350 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000106647s

	[INFO] 10.244.0.4:39835 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000220436s

	[INFO] 10.244.0.4:34474 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000060725s

	[INFO] 10.244.0.4:42677 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000076278s

	[INFO] 10.244.2.2:41566 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146322s

	[INFO] 10.244.2.2:39633 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000160447s

	[INFO] 10.244.2.2:36533 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000123881s

	[INFO] 10.244.1.2:54710 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000162932s

	[INFO] 10.244.1.2:59010 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000096219s

	[INFO] 10.244.1.2:39468 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000158565s

	[INFO] 10.244.0.4:45378 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000179168s

	[INFO] 10.244.0.4:52678 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000091044s

	[INFO] 10.244.2.2:46078 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000195018s

	[INFO] 10.244.2.2:47504 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000268349s

	[INFO] 10.244.1.2:34168 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000161101s

	[INFO] 10.244.0.4:52891 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000148878s

	[INFO] 10.244.0.4:43079 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000155917s

	[INFO] 10.244.0.4:46898 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000114218s

	==> coredns [4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a] <==

	[INFO] 10.244.2.2:46937 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.035529764s

	[INFO] 10.244.2.2:48074 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.014240201s

	[INFO] 10.244.1.2:36196 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.000184659s

	[INFO] 10.244.1.2:52009 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000114923s

	[INFO] 10.244.0.4:54740 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000078827s

	[INFO] 10.244.0.4:52614 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.00194917s

	[INFO] 10.244.2.2:33162 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000162402s

	[INFO] 10.244.2.2:57592 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.023066556s

	[INFO] 10.244.2.2:57043 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000235049s

	[INFO] 10.244.1.2:47075 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00014599s

	[INFO] 10.244.1.2:60870 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002072779s

	[INFO] 10.244.1.2:46861 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000094825s

	[INFO] 10.244.1.2:46908 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000186676s

	[INFO] 10.244.0.4:60188 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001709235s

	[INFO] 10.244.0.4:43834 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000109382s

	[INFO] 10.244.2.2:42186 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000296079s

	[INFO] 10.244.1.2:44715 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000184251s

	[INFO] 10.244.0.4:45543 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000116414s

	[INFO] 10.244.0.4:47556 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000083226s

	[INFO] 10.244.2.2:59579 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000198403s

	[INFO] 10.244.2.2:42196 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000278968s

	[INFO] 10.244.1.2:34121 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000222019s

	[INFO] 10.244.1.2:54334 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00016838s

	[INFO] 10.244.1.2:37434 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000099473s

	[INFO] 10.244.0.4:58711 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000413259s

	==> describe nodes <==

	Name:               ha-274394

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_04_28T23_57_27_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sun, 28 Apr 2024 23:57:23 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:03:44 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:22 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:22 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:22 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:41 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.237

	  Hostname:    ha-274394

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 bbc86a402e5548caa48d259a39be78de

	  System UUID:                bbc86a40-2e55-48ca-a48d-259a39be78de

	  Boot ID:                    b8dfffb5-63e7-4c7e-8e52-3cf4873fed01

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-wwl6p              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m32s

	  kube-system                 coredns-7db6d8ff4d-rslhx             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m13s

	  kube-system                 coredns-7db6d8ff4d-xkdcv             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m13s

	  kube-system                 etcd-ha-274394                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m27s

	  kube-system                 kindnet-p6qmw                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m14s

	  kube-system                 kube-apiserver-ha-274394             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m26s

	  kube-system                 kube-controller-manager-ha-274394    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m28s

	  kube-system                 kube-proxy-pwbfs                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m14s

	  kube-system                 kube-scheduler-ha-274394             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m26s

	  kube-system                 kube-vip-ha-274394                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m28s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m12s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 6m12s                  kube-proxy       

	  Normal  NodeHasSufficientPID     6m33s (x6 over 6m33s)  kubelet          Node ha-274394 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  6m33s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 6m33s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  6m33s (x7 over 6m33s)  kubelet          Node ha-274394 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m33s (x6 over 6m33s)  kubelet          Node ha-274394 status is now: NodeHasNoDiskPressure

	  Normal  Starting                 6m26s                  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m26s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m26s                  kubelet          Node ha-274394 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m26s                  kubelet          Node ha-274394 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m26s                  kubelet          Node ha-274394 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m14s                  node-controller  Node ha-274394 event: Registered Node ha-274394 in Controller

	  Normal  NodeReady                6m11s                  kubelet          Node ha-274394 status is now: NodeReady

	  Normal  RegisteredNode           4m59s                  node-controller  Node ha-274394 event: Registered Node ha-274394 in Controller

	  Normal  RegisteredNode           3m39s                  node-controller  Node ha-274394 event: Registered Node ha-274394 in Controller

	Name:               ha-274394-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_28T23_58_39_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sun, 28 Apr 2024 23:58:36 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:01:29 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.43

	  Hostname:    ha-274394-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 b55609ff590f4bdba17fff0e954879c9

	  System UUID:                b55609ff-590f-4bdb-a17f-ff0e954879c9

	  Boot ID:                    855b13e2-38c0-4157-be3d-1ab6ccd7558c

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-tmk6v                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m32s

	  kube-system                 etcd-ha-274394-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         5m14s

	  kube-system                 kindnet-6qf7q                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      5m16s

	  kube-system                 kube-apiserver-ha-274394-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m14s

	  kube-system                 kube-controller-manager-ha-274394-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m12s

	  kube-system                 kube-proxy-g95c9                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m16s

	  kube-system                 kube-scheduler-ha-274394-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m12s

	  kube-system                 kube-vip-ha-274394-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m11s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 5m11s                  kube-proxy       

	  Normal  NodeAllocatableEnforced  5m17s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  5m16s (x8 over 5m17s)  kubelet          Node ha-274394-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m16s (x8 over 5m17s)  kubelet          Node ha-274394-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m16s (x7 over 5m17s)  kubelet          Node ha-274394-m02 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           5m14s                  node-controller  Node ha-274394-m02 event: Registered Node ha-274394-m02 in Controller

	  Normal  RegisteredNode           4m59s                  node-controller  Node ha-274394-m02 event: Registered Node ha-274394-m02 in Controller

	  Normal  RegisteredNode           3m39s                  node-controller  Node ha-274394-m02 event: Registered Node ha-274394-m02 in Controller

	  Normal  NodeNotReady             103s                   node-controller  Node ha-274394-m02 status is now: NodeNotReady

	Name:               ha-274394-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_28T23_59_58_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sun, 28 Apr 2024 23:59:54 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:03:49 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 00:00:25 +0000   Sun, 28 Apr 2024 23:59:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 00:00:25 +0000   Sun, 28 Apr 2024 23:59:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 00:00:25 +0000   Sun, 28 Apr 2024 23:59:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 00:00:25 +0000   Mon, 29 Apr 2024 00:00:07 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.250

	  Hostname:    ha-274394-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 d93714f0c10b4313b4406039da06a844

	  System UUID:                d93714f0-c10b-4313-b440-6039da06a844

	  Boot ID:                    f3fcc183-a68b-4912-a90c-8983fd2d233d

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-kjcqn                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m32s

	  kube-system                 etcd-ha-274394-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         3m56s

	  kube-system                 kindnet-29qlf                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m58s

	  kube-system                 kube-apiserver-ha-274394-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m56s

	  kube-system                 kube-controller-manager-ha-274394-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m56s

	  kube-system                 kube-proxy-4rb7k                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m58s

	  kube-system                 kube-scheduler-ha-274394-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m56s

	  kube-system                 kube-vip-ha-274394-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m53s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m52s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  3m58s (x8 over 3m58s)  kubelet          Node ha-274394-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m58s (x8 over 3m58s)  kubelet          Node ha-274394-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m58s (x7 over 3m58s)  kubelet          Node ha-274394-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m58s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m54s                  node-controller  Node ha-274394-m03 event: Registered Node ha-274394-m03 in Controller

	  Normal  RegisteredNode           3m54s                  node-controller  Node ha-274394-m03 event: Registered Node ha-274394-m03 in Controller

	  Normal  RegisteredNode           3m39s                  node-controller  Node ha-274394-m03 event: Registered Node ha-274394-m03 in Controller

	Name:               ha-274394-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T00_00_59_0700

	                    minikube.k8s.io/version=v1.33.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 00:00:58 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:03:42 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:00:58 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:00:58 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:00:58 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:01:10 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.106

	  Hostname:    ha-274394-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 eda4c6845a404536baab34c56e482672

	  System UUID:                eda4c684-5a40-4536-baab-34c56e482672

	  Boot ID:                    3678260a-6c98-4396-a49b-11d148407cb5

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-r7wp2       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      2m54s

	  kube-system                 kube-proxy-4h24n    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m54s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 2m47s                  kube-proxy       

	  Normal  RegisteredNode           2m54s                  node-controller  Node ha-274394-m04 event: Registered Node ha-274394-m04 in Controller

	  Normal  NodeHasSufficientMemory  2m54s (x2 over 2m54s)  kubelet          Node ha-274394-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m54s (x2 over 2m54s)  kubelet          Node ha-274394-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m54s (x2 over 2m54s)  kubelet          Node ha-274394-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m54s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m49s                  node-controller  Node ha-274394-m04 event: Registered Node ha-274394-m04 in Controller

	  Normal  RegisteredNode           2m49s                  node-controller  Node ha-274394-m04 event: Registered Node ha-274394-m04 in Controller

	  Normal  NodeReady                2m42s                  kubelet          Node ha-274394-m04 status is now: NodeReady

	==> dmesg <==

	[Apr28 23:56] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.052234] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.044810] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.652996] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +3.522934] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[Apr28 23:57] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000008] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +6.108939] systemd-fstab-generator[600]: Ignoring "noauto" option for root device

	[  +0.062174] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.072067] systemd-fstab-generator[612]: Ignoring "noauto" option for root device

	[  +0.188727] systemd-fstab-generator[626]: Ignoring "noauto" option for root device

	[  +0.118445] systemd-fstab-generator[638]: Ignoring "noauto" option for root device

	[  +0.277590] systemd-fstab-generator[668]: Ignoring "noauto" option for root device

	[  +5.051195] systemd-fstab-generator[769]: Ignoring "noauto" option for root device

	[  +0.066175] kauditd_printk_skb: 130 callbacks suppressed

	[  +4.782579] systemd-fstab-generator[952]: Ignoring "noauto" option for root device

	[  +0.939635] kauditd_printk_skb: 46 callbacks suppressed

	[  +6.597447] systemd-fstab-generator[1372]: Ignoring "noauto" option for root device

	[  +0.110049] kauditd_printk_skb: 51 callbacks suppressed

	[ +13.496389] kauditd_printk_skb: 21 callbacks suppressed

	[Apr28 23:58] kauditd_printk_skb: 74 callbacks suppressed

	==> etcd [a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6] <==

	{"level":"warn","ts":"2024-04-29T00:03:52.177382Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.192003Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.196627Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.219201Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.227273Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.227438Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.234726Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.238253Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.241975Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.25032Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.252561Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.255628Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.259548Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.266105Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.269366Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.273414Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.281894Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.288065Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.294407Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.298105Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.302526Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.307541Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.313296Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.319491Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:03:52.327272Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 00:03:52 up 7 min,  0 users,  load average: 0.16, 0.24, 0.11

	Linux ha-274394 5.10.207 #1 SMP Mon Apr 22 03:02:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627] <==

	I0429 00:03:21.359106       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	I0429 00:03:31.377267       1 main.go:223] Handling node with IPs: map[192.168.39.237:{}]

	I0429 00:03:31.377359       1 main.go:227] handling current node

	I0429 00:03:31.377384       1 main.go:223] Handling node with IPs: map[192.168.39.43:{}]

	I0429 00:03:31.377402       1 main.go:250] Node ha-274394-m02 has CIDR [10.244.1.0/24] 

	I0429 00:03:31.377574       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0429 00:03:31.377605       1 main.go:250] Node ha-274394-m03 has CIDR [10.244.2.0/24] 

	I0429 00:03:31.377659       1 main.go:223] Handling node with IPs: map[192.168.39.106:{}]

	I0429 00:03:31.377676       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	I0429 00:03:41.387289       1 main.go:223] Handling node with IPs: map[192.168.39.237:{}]

	I0429 00:03:41.387346       1 main.go:227] handling current node

	I0429 00:03:41.387361       1 main.go:223] Handling node with IPs: map[192.168.39.43:{}]

	I0429 00:03:41.387369       1 main.go:250] Node ha-274394-m02 has CIDR [10.244.1.0/24] 

	I0429 00:03:41.387501       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0429 00:03:41.387542       1 main.go:250] Node ha-274394-m03 has CIDR [10.244.2.0/24] 

	I0429 00:03:41.387657       1 main.go:223] Handling node with IPs: map[192.168.39.106:{}]

	I0429 00:03:41.387668       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	I0429 00:03:51.395746       1 main.go:223] Handling node with IPs: map[192.168.39.237:{}]

	I0429 00:03:51.395827       1 main.go:227] handling current node

	I0429 00:03:51.395845       1 main.go:223] Handling node with IPs: map[192.168.39.43:{}]

	I0429 00:03:51.395854       1 main.go:250] Node ha-274394-m02 has CIDR [10.244.1.0/24] 

	I0429 00:03:51.396062       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0429 00:03:51.396108       1 main.go:250] Node ha-274394-m03 has CIDR [10.244.2.0/24] 

	I0429 00:03:51.396181       1 main.go:223] Handling node with IPs: map[192.168.39.106:{}]

	I0429 00:03:51.396191       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f] <==

	E0428 23:58:36.868759       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0428 23:58:36.868653       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 13.607µs, panicked: false, err: context canceled, panic-reason: <nil>

	E0428 23:58:36.870554       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0428 23:58:36.870719       1 timeout.go:142] post-timeout activity - time-elapsed: 2.339766ms, POST "/api/v1/namespaces/kube-system/events" result: <nil>

	E0429 00:00:25.137040       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40050: use of closed network connection

	E0429 00:00:25.379481       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40060: use of closed network connection

	E0429 00:00:25.604805       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40076: use of closed network connection

	E0429 00:00:25.871777       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40096: use of closed network connection

	E0429 00:00:26.091618       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40108: use of closed network connection

	E0429 00:00:26.341033       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40122: use of closed network connection

	E0429 00:00:26.594661       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40132: use of closed network connection

	E0429 00:00:26.812137       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40148: use of closed network connection

	E0429 00:00:27.039810       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40166: use of closed network connection

	E0429 00:00:27.395521       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40194: use of closed network connection

	E0429 00:00:27.600587       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33016: use of closed network connection

	E0429 00:00:27.822892       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33036: use of closed network connection

	E0429 00:00:28.227332       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33060: use of closed network connection

	E0429 00:00:28.448673       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33082: use of closed network connection

	I0429 00:01:04.494213       1 trace.go:236] Trace[1312671356]: "Get" accept:application/json, */*,audit-id:59ccec51-1525-472a-acd9-d032d2c2bfbf,client:127.0.0.1,api-group:coordination.k8s.io,api-version:v1,name:plndr-cp-lock,subresource:,namespace:kube-system,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Apr-2024 00:01:03.965) (total time: 528ms):

	Trace[1312671356]: ---"About to write a response" 528ms (00:01:04.494)

	Trace[1312671356]: [528.544822ms] [528.544822ms] END

	I0429 00:01:04.494822       1 trace.go:236] Trace[213141482]: "Update" accept:application/json, */*,audit-id:7b71b3b8-6c51-4af0-b485-7eb34cb112ec,client:192.168.39.237,api-group:,api-version:v1,name:k8s.io-minikube-hostpath,subresource:,namespace:kube-system,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Apr-2024 00:01:03.939) (total time: 555ms):

	Trace[213141482]: ["GuaranteedUpdate etcd3" audit-id:7b71b3b8-6c51-4af0-b485-7eb34cb112ec,key:/services/endpoints/kube-system/k8s.io-minikube-hostpath,type:*core.Endpoints,resource:endpoints 555ms (00:01:03.939)

	Trace[213141482]:  ---"Txn call completed" 554ms (00:01:04.494)]

	Trace[213141482]: [555.360928ms] [555.360928ms] END

	==> kube-controller-manager [ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9] <==

	I0428 23:58:38.037991       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-274394-m02"

	E0428 23:59:54.803847       1 certificate_controller.go:146] Sync csr-wdx26 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-wdx26": the object has been modified; please apply your changes to the latest version and try again

	I0428 23:59:54.892346       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-274394-m03\" does not exist"

	I0428 23:59:54.940848       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-274394-m03" podCIDRs=["10.244.2.0/24"]

	I0428 23:59:58.081684       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-274394-m03"

	I0429 00:00:20.257387       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="141.850346ms"

	I0429 00:00:20.462634       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="204.923458ms"

	I0429 00:00:20.642183       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="179.010358ms"

	E0429 00:00:20.642327       1 replica_set.go:557] sync "default/busybox-fc5497c4f" failed with Operation cannot be fulfilled on replicasets.apps "busybox-fc5497c4f": the object has been modified; please apply your changes to the latest version and try again

	I0429 00:00:20.663485       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="21.009121ms"

	I0429 00:00:20.664416       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="60.99µs"

	I0429 00:00:24.116794       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="47.639622ms"

	I0429 00:00:24.116983       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="121.564µs"

	I0429 00:00:24.173133       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="48.902432ms"

	I0429 00:00:24.173525       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="101.207µs"

	I0429 00:00:24.532136       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="19.587076ms"

	I0429 00:00:24.534021       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="133.27µs"

	E0429 00:00:58.696735       1 certificate_controller.go:146] Sync csr-9ztb7 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-9ztb7": the object has been modified; please apply your changes to the latest version and try again

	I0429 00:00:58.906478       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-274394-m04\" does not exist"

	I0429 00:00:59.000800       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-274394-m04" podCIDRs=["10.244.3.0/24"]

	I0429 00:01:03.130368       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-274394-m04"

	I0429 00:01:10.233626       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-274394-m04"

	I0429 00:02:09.531221       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-274394-m04"

	I0429 00:02:09.671054       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="15.148922ms"

	I0429 00:02:09.671354       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="69.538µs"

	==> kube-proxy [10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a] <==

	I0428 23:57:40.051962       1 server_linux.go:69] "Using iptables proxy"

	I0428 23:57:40.064077       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.237"]

	I0428 23:57:40.189337       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0428 23:57:40.189412       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0428 23:57:40.189431       1 server_linux.go:165] "Using iptables Proxier"

	I0428 23:57:40.192878       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0428 23:57:40.193163       1 server.go:872] "Version info" version="v1.30.0"

	I0428 23:57:40.193199       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0428 23:57:40.194579       1 config.go:192] "Starting service config controller"

	I0428 23:57:40.194626       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0428 23:57:40.194648       1 config.go:101] "Starting endpoint slice config controller"

	I0428 23:57:40.194651       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0428 23:57:40.195219       1 config.go:319] "Starting node config controller"

	I0428 23:57:40.195253       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0428 23:57:40.301194       1 shared_informer.go:320] Caches are synced for node config

	I0428 23:57:40.301247       1 shared_informer.go:320] Caches are synced for service config

	I0428 23:57:40.301268       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1] <==

	W0428 23:57:23.781454       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0428 23:57:23.781572       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0428 23:57:23.911255       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0428 23:57:23.911314       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0428 23:57:23.977138       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0428 23:57:23.977200       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0428 23:57:24.127191       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0428 23:57:24.127258       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0428 23:57:24.129643       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0428 23:57:24.129701       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0428 23:57:24.145975       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0428 23:57:24.146030       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0428 23:57:24.181216       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0428 23:57:24.181243       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0428 23:57:24.192501       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0428 23:57:24.192554       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0428 23:57:26.404129       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0429 00:00:20.266398       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-wwl6p\": pod busybox-fc5497c4f-wwl6p is already assigned to node \"ha-274394\"" plugin="DefaultBinder" pod="default/busybox-fc5497c4f-wwl6p" node="ha-274394"

	E0429 00:00:20.266508       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-kjcqn\": pod busybox-fc5497c4f-kjcqn is already assigned to node \"ha-274394-m03\"" plugin="DefaultBinder" pod="default/busybox-fc5497c4f-kjcqn" node="ha-274394-m03"

	E0429 00:00:20.271638       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod a6a06956-e991-47ab-986f-34d9467a7dec(default/busybox-fc5497c4f-wwl6p) wasn't assumed so cannot be forgotten" pod="default/busybox-fc5497c4f-wwl6p"

	E0429 00:00:20.272546       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-wwl6p\": pod busybox-fc5497c4f-wwl6p is already assigned to node \"ha-274394\"" pod="default/busybox-fc5497c4f-wwl6p"

	I0429 00:00:20.273228       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-fc5497c4f-wwl6p" node="ha-274394"

	E0429 00:00:20.271544       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 76314c87-6b7d-4bfa-83ce-3ace75fa7aee(default/busybox-fc5497c4f-kjcqn) wasn't assumed so cannot be forgotten" pod="default/busybox-fc5497c4f-kjcqn"

	E0429 00:00:20.273888       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-kjcqn\": pod busybox-fc5497c4f-kjcqn is already assigned to node \"ha-274394-m03\"" pod="default/busybox-fc5497c4f-kjcqn"

	I0429 00:00:20.274053       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-fc5497c4f-kjcqn" node="ha-274394-m03"

	==> kubelet <==

	Apr 28 23:59:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 28 23:59:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:00:20 ha-274394 kubelet[1379]: I0429 00:00:20.232784    1379 topology_manager.go:215] "Topology Admit Handler" podUID="a6a06956-e991-47ab-986f-34d9467a7dec" podNamespace="default" podName="busybox-fc5497c4f-wwl6p"

	Apr 29 00:00:20 ha-274394 kubelet[1379]: I0429 00:00:20.358052    1379 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbb9\" (UniqueName: \"kubernetes.io/projected/a6a06956-e991-47ab-986f-34d9467a7dec-kube-api-access-wvbb9\") pod \"busybox-fc5497c4f-wwl6p\" (UID: \"a6a06956-e991-47ab-986f-34d9467a7dec\") " pod="default/busybox-fc5497c4f-wwl6p"

	Apr 29 00:00:26 ha-274394 kubelet[1379]: E0429 00:00:26.208715    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:00:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:00:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:00:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:00:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:00:28 ha-274394 kubelet[1379]: E0429 00:00:28.227727    1379 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:52374->127.0.0.1:41399: write tcp 127.0.0.1:52374->127.0.0.1:41399: write: broken pipe

	Apr 29 00:01:26 ha-274394 kubelet[1379]: E0429 00:01:26.204575    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:01:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:01:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:01:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:01:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:02:26 ha-274394 kubelet[1379]: E0429 00:02:26.204755    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:02:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:02:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:02:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:02:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:03:26 ha-274394 kubelet[1379]: E0429 00:03:26.207355    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:03:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:03:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:03:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:03:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-274394 -n ha-274394

helpers_test.go:261: (dbg) Run:  kubectl --context ha-274394 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (142.18s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 node start m02 -v=7 --alsologtostderr

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 3 (3.200069784s)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:03:57.045690   41210 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:03:57.045916   41210 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:03:57.045924   41210 out.go:304] Setting ErrFile to fd 2...

	I0429 00:03:57.045929   41210 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:03:57.046145   41210 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:03:57.046338   41210 out.go:298] Setting JSON to false

	I0429 00:03:57.046361   41210 mustload.go:65] Loading cluster: ha-274394

	I0429 00:03:57.046422   41210 notify.go:220] Checking for updates...

	I0429 00:03:57.046768   41210 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:03:57.046783   41210 status.go:255] checking status of ha-274394 ...

	I0429 00:03:57.047351   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:57.047387   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:57.063341   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33031

	I0429 00:03:57.063829   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:57.064316   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:57.064338   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:57.064730   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:57.064911   41210 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:03:57.066779   41210 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:03:57.066799   41210 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:03:57.067072   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:57.067107   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:57.083817   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42217

	I0429 00:03:57.084445   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:57.084907   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:57.084926   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:57.085283   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:57.085465   41210 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:03:57.088287   41210 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:57.088802   41210 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:03:57.088835   41210 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:57.088956   41210 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:03:57.089239   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:57.089272   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:57.103574   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42333

	I0429 00:03:57.103977   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:57.104453   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:57.104473   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:57.104778   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:57.104961   41210 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:03:57.105129   41210 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:03:57.105149   41210 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:03:57.107936   41210 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:57.108323   41210 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:03:57.108354   41210 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:03:57.108500   41210 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:03:57.108701   41210 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:03:57.108861   41210 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:03:57.109004   41210 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:03:57.190460   41210 ssh_runner.go:195] Run: systemctl --version

	I0429 00:03:57.197385   41210 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:03:57.215591   41210 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:03:57.215616   41210 api_server.go:166] Checking apiserver status ...

	I0429 00:03:57.215648   41210 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:03:57.232259   41210 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:03:57.246959   41210 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:03:57.247018   41210 ssh_runner.go:195] Run: ls

	I0429 00:03:57.252118   41210 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:03:57.258004   41210 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:03:57.258044   41210 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:03:57.258058   41210 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:03:57.258073   41210 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:03:57.258383   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:57.258431   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:57.274425   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35379

	I0429 00:03:57.274875   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:57.275411   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:57.275442   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:57.275820   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:57.276045   41210 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:03:57.277740   41210 status.go:330] ha-274394-m02 host status = "Running" (err=<nil>)

	I0429 00:03:57.277756   41210 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:03:57.278223   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:57.278266   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:57.295606   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42199

	I0429 00:03:57.296096   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:57.296548   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:57.296573   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:57.296844   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:57.297015   41210 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0429 00:03:57.299526   41210 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:57.299945   41210 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:03:57.299979   41210 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:57.300091   41210 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:03:57.300377   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:57.300406   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:57.316075   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36371

	I0429 00:03:57.316463   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:57.316936   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:57.316960   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:57.317262   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:57.317440   41210 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:03:57.317624   41210 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:03:57.317642   41210 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:03:57.319997   41210 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:57.320345   41210 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:03:57.320373   41210 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:03:57.320508   41210 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:03:57.320685   41210 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:03:57.320842   41210 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:03:57.320999   41210 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	W0429 00:03:59.818293   41210 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:03:59.818414   41210 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	E0429 00:03:59.818438   41210 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:03:59.818445   41210 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 00:03:59.818462   41210 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:03:59.818472   41210 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:03:59.818799   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:59.818854   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:59.833765   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42695

	I0429 00:03:59.834188   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:59.834774   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:59.834801   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:59.835142   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:59.835331   41210 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:03:59.836900   41210 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:03:59.836917   41210 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:03:59.837233   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:59.837274   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:59.851504   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36985

	I0429 00:03:59.851887   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:59.852278   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:59.852299   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:59.852580   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:59.852750   41210 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:03:59.855157   41210 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:59.855571   41210 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:03:59.855598   41210 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:59.855739   41210 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:03:59.856010   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:03:59.856042   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:03:59.871133   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41653

	I0429 00:03:59.871683   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:03:59.872232   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:03:59.872254   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:03:59.872573   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:03:59.872717   41210 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:03:59.872933   41210 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:03:59.872958   41210 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:03:59.876019   41210 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:59.876488   41210 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:03:59.876510   41210 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:03:59.876732   41210 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:03:59.876928   41210 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:03:59.877124   41210 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:03:59.877344   41210 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:03:59.971414   41210 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:03:59.989883   41210 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:03:59.989920   41210 api_server.go:166] Checking apiserver status ...

	I0429 00:03:59.989956   41210 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:00.009859   41210 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:04:00.022169   41210 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:00.022226   41210 ssh_runner.go:195] Run: ls

	I0429 00:04:00.027681   41210 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:00.032278   41210 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:00.032305   41210 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:04:00.032314   41210 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:00.032327   41210 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:04:00.032591   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:00.032641   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:00.047361   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39085

	I0429 00:04:00.047740   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:00.048239   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:04:00.048266   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:00.048587   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:00.048767   41210 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:04:00.050268   41210 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:04:00.050282   41210 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:00.050567   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:00.050597   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:00.065880   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43923

	I0429 00:04:00.066264   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:00.066718   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:04:00.066741   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:00.067007   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:00.067219   41210 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:04:00.069883   41210 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:00.070316   41210 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:00.070340   41210 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:00.070497   41210 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:00.070779   41210 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:00.070829   41210 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:00.084868   41210 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34947

	I0429 00:04:00.085237   41210 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:00.085709   41210 main.go:141] libmachine: Using API Version  1

	I0429 00:04:00.085735   41210 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:00.086003   41210 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:00.086204   41210 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:04:00.086383   41210 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:00.086407   41210 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:04:00.088996   41210 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:00.089421   41210 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:00.089447   41210 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:00.089584   41210 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:04:00.089750   41210 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:04:00.089861   41210 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:04:00.089976   41210 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:04:00.171015   41210 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:00.190811   41210 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 3 (5.143658941s)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:04:01.239309   41310 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:04:01.239568   41310 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:01.239579   41310 out.go:304] Setting ErrFile to fd 2...

	I0429 00:04:01.239583   41310 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:01.239843   41310 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:04:01.240022   41310 out.go:298] Setting JSON to false

	I0429 00:04:01.240047   41310 mustload.go:65] Loading cluster: ha-274394

	I0429 00:04:01.240081   41310 notify.go:220] Checking for updates...

	I0429 00:04:01.240419   41310 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:04:01.240433   41310 status.go:255] checking status of ha-274394 ...

	I0429 00:04:01.240800   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:01.240881   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:01.255840   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46501

	I0429 00:04:01.256187   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:01.256904   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:01.256946   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:01.257251   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:01.257462   41310 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:04:01.259042   41310 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:04:01.259065   41310 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:01.259351   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:01.259390   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:01.273317   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39619

	I0429 00:04:01.273689   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:01.274135   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:01.274160   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:01.274447   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:01.274608   41310 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:04:01.277304   41310 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:01.277734   41310 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:01.277764   41310 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:01.277901   41310 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:01.278340   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:01.278387   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:01.293876   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41905

	I0429 00:04:01.294263   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:01.294733   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:01.294754   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:01.295042   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:01.295245   41310 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:04:01.295432   41310 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:01.295457   41310 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:04:01.298442   41310 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:01.298874   41310 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:01.298915   41310 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:01.299046   41310 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:04:01.299223   41310 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:04:01.299397   41310 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:04:01.299576   41310 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:04:01.383861   41310 ssh_runner.go:195] Run: systemctl --version

	I0429 00:04:01.390600   41310 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:01.407977   41310 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:01.408005   41310 api_server.go:166] Checking apiserver status ...

	I0429 00:04:01.408038   41310 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:01.423361   41310 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:04:01.437317   41310 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:01.437365   41310 ssh_runner.go:195] Run: ls

	I0429 00:04:01.446308   41310 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:01.450487   41310 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:01.450508   41310 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:04:01.450520   41310 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:01.450545   41310 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:04:01.450813   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:01.450861   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:01.466438   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34853

	I0429 00:04:01.466880   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:01.467366   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:01.467388   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:01.467746   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:01.467953   41310 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:04:01.469372   41310 status.go:330] ha-274394-m02 host status = "Running" (err=<nil>)

	I0429 00:04:01.469390   41310 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:01.469796   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:01.469838   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:01.484473   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41391

	I0429 00:04:01.484917   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:01.485377   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:01.485395   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:01.485665   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:01.485828   41310 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0429 00:04:01.488071   41310 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:01.488414   41310 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:01.488450   41310 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:01.488535   41310 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:01.489410   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:01.489454   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:01.505167   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36629

	I0429 00:04:01.505534   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:01.505986   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:01.506008   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:01.506324   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:01.506536   41310 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:04:01.506744   41310 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:01.506764   41310 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:04:01.509436   41310 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:01.509887   41310 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:01.509918   41310 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:01.510081   41310 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:04:01.510239   41310 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:04:01.510399   41310 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:04:01.510544   41310 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	W0429 00:04:02.886391   41310 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:02.886481   41310 retry.go:31] will retry after 372.120245ms: dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:05.958264   41310 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:05.958361   41310 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	E0429 00:04:05.958388   41310 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:05.958401   41310 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 00:04:05.958428   41310 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:05.958437   41310 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:04:05.958766   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:05.958824   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:05.973931   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46449

	I0429 00:04:05.974394   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:05.974926   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:05.974953   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:05.975332   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:05.975629   41310 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:04:05.977210   41310 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:04:05.977226   41310 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:05.977490   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:05.977544   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:05.993405   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42013

	I0429 00:04:05.993784   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:05.994200   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:05.994222   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:05.994531   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:05.994721   41310 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:04:05.997173   41310 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:05.997586   41310 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:05.997610   41310 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:05.997734   41310 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:05.998082   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:05.998126   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:06.012598   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39179

	I0429 00:04:06.013066   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:06.013542   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:06.013562   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:06.013915   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:06.014124   41310 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:04:06.014345   41310 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:06.014364   41310 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:04:06.017116   41310 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:06.017525   41310 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:06.017558   41310 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:06.017672   41310 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:04:06.017841   41310 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:04:06.017981   41310 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:04:06.018106   41310 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:04:06.106904   41310 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:06.130111   41310 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:06.130142   41310 api_server.go:166] Checking apiserver status ...

	I0429 00:04:06.130179   41310 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:06.147624   41310 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:04:06.157540   41310 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:06.157584   41310 ssh_runner.go:195] Run: ls

	I0429 00:04:06.163282   41310 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:06.167850   41310 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:06.167870   41310 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:04:06.167878   41310 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:06.167891   41310 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:04:06.168167   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:06.168214   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:06.182843   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44653

	I0429 00:04:06.183242   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:06.183715   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:06.183739   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:06.184042   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:06.184240   41310 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:04:06.185621   41310 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:04:06.185635   41310 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:06.185913   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:06.185952   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:06.200123   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46705

	I0429 00:04:06.200523   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:06.200938   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:06.200960   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:06.201280   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:06.201456   41310 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:04:06.203764   41310 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:06.204177   41310 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:06.204204   41310 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:06.204347   41310 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:06.204643   41310 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:06.204677   41310 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:06.219920   41310 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43503

	I0429 00:04:06.220312   41310 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:06.220736   41310 main.go:141] libmachine: Using API Version  1

	I0429 00:04:06.220761   41310 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:06.221131   41310 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:06.221320   41310 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:04:06.221523   41310 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:06.221541   41310 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:04:06.224038   41310 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:06.224459   41310 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:06.224509   41310 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:06.224640   41310 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:04:06.224808   41310 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:04:06.224958   41310 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:04:06.225091   41310 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:04:06.307230   41310 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:06.325732   41310 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 3 (5.205356031s)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:04:07.336629   41412 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:04:07.336746   41412 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:07.336755   41412 out.go:304] Setting ErrFile to fd 2...

	I0429 00:04:07.336759   41412 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:07.336965   41412 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:04:07.337129   41412 out.go:298] Setting JSON to false

	I0429 00:04:07.337154   41412 mustload.go:65] Loading cluster: ha-274394

	I0429 00:04:07.337275   41412 notify.go:220] Checking for updates...

	I0429 00:04:07.337580   41412 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:04:07.337597   41412 status.go:255] checking status of ha-274394 ...

	I0429 00:04:07.337951   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:07.338001   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:07.353569   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34871

	I0429 00:04:07.353940   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:07.354524   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:07.354545   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:07.354970   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:07.355194   41412 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:04:07.356839   41412 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:04:07.356852   41412 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:07.357177   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:07.357216   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:07.371278   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44423

	I0429 00:04:07.371612   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:07.372014   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:07.372050   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:07.372344   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:07.372521   41412 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:04:07.375230   41412 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:07.375637   41412 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:07.375663   41412 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:07.375823   41412 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:07.376091   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:07.376128   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:07.390489   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39769

	I0429 00:04:07.390854   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:07.391277   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:07.391296   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:07.391623   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:07.391811   41412 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:04:07.391980   41412 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:07.392021   41412 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:04:07.394701   41412 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:07.395122   41412 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:07.395142   41412 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:07.395299   41412 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:04:07.395482   41412 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:04:07.395619   41412 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:04:07.395787   41412 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:04:07.480274   41412 ssh_runner.go:195] Run: systemctl --version

	I0429 00:04:07.489090   41412 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:07.512181   41412 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:07.512213   41412 api_server.go:166] Checking apiserver status ...

	I0429 00:04:07.512251   41412 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:07.531893   41412 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:04:07.544837   41412 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:07.544915   41412 ssh_runner.go:195] Run: ls

	I0429 00:04:07.549867   41412 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:07.556352   41412 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:07.556373   41412 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:04:07.556383   41412 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:07.556403   41412 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:04:07.556682   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:07.556714   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:07.571278   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34445

	I0429 00:04:07.571728   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:07.572270   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:07.572299   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:07.572590   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:07.572793   41412 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:04:07.574287   41412 status.go:330] ha-274394-m02 host status = "Running" (err=<nil>)

	I0429 00:04:07.574307   41412 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:07.574573   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:07.574603   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:07.589268   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35465

	I0429 00:04:07.589631   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:07.590097   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:07.590122   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:07.590410   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:07.590565   41412 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0429 00:04:07.593211   41412 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:07.593597   41412 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:07.593626   41412 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:07.593747   41412 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:07.594012   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:07.594064   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:07.610332   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45513

	I0429 00:04:07.610759   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:07.611220   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:07.611244   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:07.611554   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:07.611771   41412 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:04:07.611964   41412 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:07.611981   41412 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:04:07.614868   41412 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:07.615306   41412 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:07.615336   41412 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:07.615476   41412 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:04:07.615648   41412 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:04:07.615801   41412 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:04:07.615945   41412 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	W0429 00:04:09.030259   41412 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:09.030320   41412 retry.go:31] will retry after 313.93234ms: dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:12.102281   41412 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:12.102389   41412 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	E0429 00:04:12.102406   41412 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:12.102413   41412 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 00:04:12.102437   41412 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:12.102445   41412 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:04:12.102759   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:12.102801   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:12.118861   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41577

	I0429 00:04:12.119349   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:12.119837   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:12.119856   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:12.120183   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:12.120363   41412 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:04:12.122113   41412 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:04:12.122129   41412 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:12.122458   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:12.122515   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:12.137467   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44847

	I0429 00:04:12.137927   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:12.138394   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:12.138419   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:12.138754   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:12.138929   41412 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:04:12.141741   41412 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:12.142224   41412 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:12.142261   41412 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:12.142421   41412 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:12.142763   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:12.142807   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:12.158003   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33623

	I0429 00:04:12.158432   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:12.158913   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:12.158937   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:12.159254   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:12.159448   41412 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:04:12.159644   41412 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:12.159668   41412 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:04:12.162524   41412 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:12.162997   41412 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:12.163030   41412 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:12.163172   41412 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:04:12.163331   41412 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:04:12.163482   41412 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:04:12.163626   41412 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:04:12.253099   41412 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:12.274486   41412 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:12.274515   41412 api_server.go:166] Checking apiserver status ...

	I0429 00:04:12.274554   41412 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:12.299275   41412 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:04:12.315141   41412 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:12.315204   41412 ssh_runner.go:195] Run: ls

	I0429 00:04:12.320513   41412 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:12.325817   41412 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:12.325849   41412 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:04:12.325860   41412 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:12.325879   41412 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:04:12.326217   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:12.326253   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:12.341184   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45115

	I0429 00:04:12.341564   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:12.342157   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:12.342184   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:12.342499   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:12.342690   41412 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:04:12.344208   41412 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:04:12.344224   41412 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:12.344601   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:12.344645   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:12.360586   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37525

	I0429 00:04:12.361129   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:12.361668   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:12.361692   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:12.362071   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:12.362279   41412 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:04:12.365117   41412 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:12.365673   41412 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:12.365704   41412 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:12.365811   41412 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:12.366104   41412 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:12.366143   41412 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:12.381000   41412 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33407

	I0429 00:04:12.381382   41412 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:12.381819   41412 main.go:141] libmachine: Using API Version  1

	I0429 00:04:12.381838   41412 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:12.382224   41412 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:12.382394   41412 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:04:12.382556   41412 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:12.382577   41412 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:04:12.385018   41412 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:12.385463   41412 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:12.385484   41412 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:12.385641   41412 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:04:12.385807   41412 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:04:12.385923   41412 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:04:12.386046   41412 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:04:12.467326   41412 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:12.485595   41412 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 3 (4.781946927s)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:04:13.875663   41512 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:04:13.875836   41512 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:13.875862   41512 out.go:304] Setting ErrFile to fd 2...

	I0429 00:04:13.875878   41512 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:13.876462   41512 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:04:13.876664   41512 out.go:298] Setting JSON to false

	I0429 00:04:13.876691   41512 mustload.go:65] Loading cluster: ha-274394

	I0429 00:04:13.876803   41512 notify.go:220] Checking for updates...

	I0429 00:04:13.877049   41512 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:04:13.877062   41512 status.go:255] checking status of ha-274394 ...

	I0429 00:04:13.877419   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:13.877479   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:13.896156   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37727

	I0429 00:04:13.896564   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:13.897252   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:13.897279   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:13.897768   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:13.898042   41512 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:04:13.899986   41512 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:04:13.900004   41512 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:13.900389   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:13.900434   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:13.915099   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42841

	I0429 00:04:13.915536   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:13.915994   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:13.916015   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:13.916290   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:13.916430   41512 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:04:13.918772   41512 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:13.919157   41512 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:13.919181   41512 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:13.919296   41512 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:13.919558   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:13.919596   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:13.933766   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39459

	I0429 00:04:13.934205   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:13.934615   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:13.934638   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:13.934911   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:13.935100   41512 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:04:13.935280   41512 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:13.935305   41512 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:04:13.937996   41512 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:13.938407   41512 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:13.938433   41512 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:13.938559   41512 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:04:13.938754   41512 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:04:13.938915   41512 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:04:13.939096   41512 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:04:14.024996   41512 ssh_runner.go:195] Run: systemctl --version

	I0429 00:04:14.032838   41512 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:14.049285   41512 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:14.049320   41512 api_server.go:166] Checking apiserver status ...

	I0429 00:04:14.049366   41512 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:14.070611   41512 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:04:14.083890   41512 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:14.083953   41512 ssh_runner.go:195] Run: ls

	I0429 00:04:14.090685   41512 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:14.095159   41512 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:14.095185   41512 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:04:14.095195   41512 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:14.095210   41512 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:04:14.095562   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:14.095629   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:14.111850   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40549

	I0429 00:04:14.112298   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:14.112870   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:14.112896   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:14.113267   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:14.113479   41512 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:04:14.115090   41512 status.go:330] ha-274394-m02 host status = "Running" (err=<nil>)

	I0429 00:04:14.115106   41512 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:14.115440   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:14.115488   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:14.130255   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38513

	I0429 00:04:14.130741   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:14.131262   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:14.131292   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:14.131652   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:14.131877   41512 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0429 00:04:14.134555   41512 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:14.134990   41512 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:14.135023   41512 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:14.135154   41512 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:14.135487   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:14.135521   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:14.149802   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45397

	I0429 00:04:14.150210   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:14.150627   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:14.150647   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:14.150945   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:14.151134   41512 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:04:14.151315   41512 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:14.151338   41512 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:04:14.154093   41512 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:14.154495   41512 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:14.154526   41512 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:14.154696   41512 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:04:14.154880   41512 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:04:14.155087   41512 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:04:14.155249   41512 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	W0429 00:04:15.174383   41512 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:15.174437   41512 retry.go:31] will retry after 319.748073ms: dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:18.246353   41512 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:18.246436   41512 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	E0429 00:04:18.246459   41512 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:18.246469   41512 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 00:04:18.246506   41512 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:18.246521   41512 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:04:18.246843   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:18.246895   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:18.261329   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40441

	I0429 00:04:18.261719   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:18.262227   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:18.262250   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:18.262577   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:18.262763   41512 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:04:18.264224   41512 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:04:18.264237   41512 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:18.264511   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:18.264546   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:18.278229   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42857

	I0429 00:04:18.278664   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:18.279137   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:18.279161   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:18.279467   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:18.279635   41512 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:04:18.282343   41512 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:18.282810   41512 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:18.282856   41512 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:18.283007   41512 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:18.283372   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:18.283418   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:18.297055   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40813

	I0429 00:04:18.297399   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:18.297879   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:18.297901   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:18.298194   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:18.298369   41512 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:04:18.298522   41512 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:18.298541   41512 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:04:18.301017   41512 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:18.301412   41512 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:18.301450   41512 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:18.301591   41512 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:04:18.301760   41512 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:04:18.301909   41512 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:04:18.302064   41512 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:04:18.392671   41512 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:18.409840   41512 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:18.409867   41512 api_server.go:166] Checking apiserver status ...

	I0429 00:04:18.409906   41512 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:18.425297   41512 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:04:18.435983   41512 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:18.436021   41512 ssh_runner.go:195] Run: ls

	I0429 00:04:18.441721   41512 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:18.448112   41512 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:18.448154   41512 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:04:18.448164   41512 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:18.448180   41512 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:04:18.448528   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:18.448570   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:18.463034   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36247

	I0429 00:04:18.463405   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:18.463897   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:18.463917   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:18.464236   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:18.464429   41512 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:04:18.466055   41512 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:04:18.466070   41512 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:18.466402   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:18.466442   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:18.480618   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39971

	I0429 00:04:18.480995   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:18.481458   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:18.481476   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:18.481745   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:18.481918   41512 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:04:18.484533   41512 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:18.484887   41512 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:18.484918   41512 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:18.485042   41512 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:18.485316   41512 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:18.485355   41512 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:18.499464   41512 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43621

	I0429 00:04:18.499828   41512 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:18.500282   41512 main.go:141] libmachine: Using API Version  1

	I0429 00:04:18.500301   41512 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:18.500584   41512 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:18.500786   41512 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:04:18.500959   41512 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:18.500977   41512 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:04:18.503326   41512 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:18.503742   41512 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:18.503771   41512 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:18.503882   41512 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:04:18.504031   41512 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:04:18.504159   41512 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:04:18.504285   41512 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:04:18.586676   41512 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:18.603479   41512 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 3 (3.74755379s)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:04:23.266767   41628 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:04:23.266883   41628 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:23.266892   41628 out.go:304] Setting ErrFile to fd 2...

	I0429 00:04:23.266896   41628 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:23.267051   41628 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:04:23.267195   41628 out.go:298] Setting JSON to false

	I0429 00:04:23.267216   41628 mustload.go:65] Loading cluster: ha-274394

	I0429 00:04:23.267339   41628 notify.go:220] Checking for updates...

	I0429 00:04:23.267540   41628 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:04:23.267554   41628 status.go:255] checking status of ha-274394 ...

	I0429 00:04:23.267924   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:23.267973   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:23.284374   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44997

	I0429 00:04:23.284803   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:23.285393   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:23.285418   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:23.285858   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:23.286137   41628 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:04:23.287915   41628 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:04:23.287935   41628 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:23.288379   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:23.288432   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:23.303259   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34135

	I0429 00:04:23.303674   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:23.304111   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:23.304139   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:23.304440   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:23.304600   41628 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:04:23.307102   41628 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:23.307529   41628 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:23.307561   41628 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:23.307636   41628 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:23.307908   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:23.307942   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:23.321554   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38303

	I0429 00:04:23.321901   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:23.322350   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:23.322369   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:23.322645   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:23.322835   41628 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:04:23.322992   41628 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:23.323024   41628 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:04:23.325500   41628 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:23.325893   41628 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:23.325928   41628 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:23.326084   41628 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:04:23.326254   41628 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:04:23.326415   41628 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:04:23.326568   41628 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:04:23.414647   41628 ssh_runner.go:195] Run: systemctl --version

	I0429 00:04:23.421558   41628 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:23.438974   41628 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:23.439000   41628 api_server.go:166] Checking apiserver status ...

	I0429 00:04:23.439031   41628 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:23.456428   41628 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:04:23.472011   41628 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:23.472048   41628 ssh_runner.go:195] Run: ls

	I0429 00:04:23.477214   41628 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:23.481391   41628 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:23.481410   41628 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:04:23.481418   41628 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:23.481443   41628 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:04:23.481734   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:23.481772   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:23.498647   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42115

	I0429 00:04:23.499018   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:23.499502   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:23.499524   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:23.499829   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:23.499989   41628 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:04:23.501504   41628 status.go:330] ha-274394-m02 host status = "Running" (err=<nil>)

	I0429 00:04:23.501515   41628 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:23.501843   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:23.501882   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:23.515850   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38731

	I0429 00:04:23.516253   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:23.516665   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:23.516699   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:23.516967   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:23.517141   41628 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0429 00:04:23.519710   41628 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:23.520073   41628 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:23.520100   41628 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:23.520238   41628 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:23.520501   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:23.520530   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:23.534348   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37157

	I0429 00:04:23.534727   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:23.535162   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:23.535182   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:23.535439   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:23.535605   41628 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:04:23.535758   41628 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:23.535781   41628 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:04:23.538414   41628 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:23.538852   41628 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:23.538887   41628 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:23.539034   41628 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:04:23.539208   41628 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:04:23.539345   41628 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:04:23.539478   41628 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	W0429 00:04:26.602238   41628 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:26.602321   41628 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	E0429 00:04:26.602335   41628 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:26.602366   41628 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 00:04:26.602388   41628 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:26.602395   41628 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:04:26.602683   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:26.602727   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:26.617597   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37899

	I0429 00:04:26.618035   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:26.618476   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:26.618500   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:26.618782   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:26.618969   41628 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:04:26.620375   41628 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:04:26.620400   41628 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:26.620685   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:26.620718   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:26.634736   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33057

	I0429 00:04:26.635080   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:26.635534   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:26.635551   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:26.635882   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:26.636079   41628 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:04:26.639005   41628 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:26.639473   41628 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:26.639498   41628 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:26.639693   41628 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:26.640012   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:26.640045   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:26.654481   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41627

	I0429 00:04:26.654958   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:26.655470   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:26.655503   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:26.655831   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:26.655995   41628 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:04:26.656212   41628 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:26.656234   41628 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:04:26.659042   41628 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:26.659422   41628 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:26.659451   41628 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:26.659563   41628 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:04:26.659729   41628 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:04:26.659920   41628 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:04:26.660060   41628 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:04:26.749888   41628 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:26.766244   41628 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:26.766270   41628 api_server.go:166] Checking apiserver status ...

	I0429 00:04:26.766308   41628 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:26.783060   41628 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:04:26.793526   41628 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:26.793572   41628 ssh_runner.go:195] Run: ls

	I0429 00:04:26.798478   41628 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:26.802985   41628 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:26.803005   41628 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:04:26.803015   41628 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:26.803033   41628 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:04:26.803302   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:26.803352   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:26.817735   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42073

	I0429 00:04:26.818114   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:26.818582   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:26.818602   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:26.818910   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:26.819075   41628 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:04:26.820500   41628 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:04:26.820526   41628 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:26.820894   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:26.820941   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:26.837324   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40611

	I0429 00:04:26.837714   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:26.838117   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:26.838140   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:26.838513   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:26.838686   41628 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:04:26.841412   41628 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:26.841827   41628 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:26.841861   41628 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:26.841961   41628 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:26.842367   41628 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:26.842406   41628 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:26.856262   41628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46089

	I0429 00:04:26.856629   41628 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:26.857080   41628 main.go:141] libmachine: Using API Version  1

	I0429 00:04:26.857100   41628 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:26.857381   41628 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:26.857558   41628 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:04:26.857763   41628 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:26.857795   41628 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:04:26.860115   41628 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:26.860529   41628 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:26.860556   41628 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:26.860684   41628 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:04:26.860854   41628 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:04:26.861018   41628 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:04:26.861178   41628 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:04:26.942449   41628 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:26.958955   41628 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 3 (3.762395406s)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:04:31.072440   41744 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:04:31.072682   41744 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:31.072691   41744 out.go:304] Setting ErrFile to fd 2...

	I0429 00:04:31.072694   41744 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:31.072855   41744 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:04:31.073026   41744 out.go:298] Setting JSON to false

	I0429 00:04:31.073053   41744 mustload.go:65] Loading cluster: ha-274394

	I0429 00:04:31.073100   41744 notify.go:220] Checking for updates...

	I0429 00:04:31.073522   41744 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:04:31.073544   41744 status.go:255] checking status of ha-274394 ...

	I0429 00:04:31.074099   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:31.074139   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:31.088821   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43057

	I0429 00:04:31.089165   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:31.089713   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:31.089739   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:31.090142   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:31.090385   41744 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:04:31.091828   41744 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:04:31.091840   41744 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:31.092098   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:31.092140   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:31.106659   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36581

	I0429 00:04:31.107034   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:31.107479   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:31.107508   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:31.107827   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:31.108064   41744 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:04:31.110745   41744 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:31.111175   41744 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:31.111200   41744 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:31.111360   41744 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:31.111652   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:31.111688   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:31.126592   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45801

	I0429 00:04:31.127018   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:31.127448   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:31.127469   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:31.127774   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:31.127945   41744 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:04:31.128168   41744 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:31.128205   41744 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:04:31.130868   41744 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:31.131353   41744 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:31.131383   41744 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:31.131531   41744 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:04:31.131701   41744 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:04:31.131869   41744 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:04:31.132015   41744 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:04:31.218828   41744 ssh_runner.go:195] Run: systemctl --version

	I0429 00:04:31.225937   41744 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:31.243013   41744 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:31.243039   41744 api_server.go:166] Checking apiserver status ...

	I0429 00:04:31.243075   41744 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:31.259239   41744 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:04:31.271194   41744 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:31.271246   41744 ssh_runner.go:195] Run: ls

	I0429 00:04:31.276354   41744 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:31.282711   41744 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:31.282735   41744 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:04:31.282746   41744 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:31.282760   41744 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:04:31.283040   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:31.283078   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:31.297597   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41717

	I0429 00:04:31.298090   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:31.298622   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:31.298646   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:31.298995   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:31.299179   41744 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:04:31.301039   41744 status.go:330] ha-274394-m02 host status = "Running" (err=<nil>)

	I0429 00:04:31.301053   41744 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:31.301439   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:31.301484   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:31.318834   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45267

	I0429 00:04:31.319237   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:31.319670   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:31.319693   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:31.320132   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:31.320294   41744 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0429 00:04:31.323005   41744 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:31.323462   41744 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:31.323493   41744 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:31.323616   41744 host.go:66] Checking if "ha-274394-m02" exists ...

	I0429 00:04:31.323905   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:31.323937   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:31.339433   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34311

	I0429 00:04:31.339781   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:31.340218   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:31.340243   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:31.340514   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:31.340714   41744 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0429 00:04:31.340907   41744 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:31.340927   41744 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0429 00:04:31.343493   41744 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:31.343896   41744 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0429 00:04:31.343926   41744 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0429 00:04:31.344072   41744 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0429 00:04:31.344200   41744 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0429 00:04:31.344357   41744 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0429 00:04:31.344481   41744 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	W0429 00:04:34.410332   41744 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.43:22: connect: no route to host

	W0429 00:04:34.410460   41744 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	E0429 00:04:34.410485   41744 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:34.410504   41744 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0429 00:04:34.410531   41744 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.43:22: connect: no route to host

	I0429 00:04:34.410542   41744 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:04:34.411001   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:34.411050   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:34.425961   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40111

	I0429 00:04:34.426434   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:34.426899   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:34.426920   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:34.427299   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:34.427507   41744 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:04:34.429198   41744 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:04:34.429210   41744 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:34.429510   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:34.429553   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:34.445295   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43095

	I0429 00:04:34.445712   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:34.446221   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:34.446243   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:34.446542   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:34.446795   41744 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:04:34.450095   41744 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:34.450482   41744 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:34.450514   41744 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:34.450670   41744 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:34.450988   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:34.451024   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:34.465751   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36611

	I0429 00:04:34.466198   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:34.466682   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:34.466708   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:34.467020   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:34.467182   41744 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:04:34.467350   41744 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:34.467373   41744 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:04:34.469861   41744 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:34.470256   41744 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:34.470295   41744 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:34.470521   41744 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:04:34.470677   41744 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:04:34.470833   41744 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:04:34.470941   41744 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:04:34.563612   41744 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:34.580404   41744 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:34.580441   41744 api_server.go:166] Checking apiserver status ...

	I0429 00:04:34.580484   41744 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:34.596030   41744 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:04:34.607309   41744 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:34.607365   41744 ssh_runner.go:195] Run: ls

	I0429 00:04:34.613038   41744 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:34.619671   41744 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:34.619696   41744 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:04:34.619719   41744 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:34.619733   41744 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:04:34.620012   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:34.620045   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:34.635243   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38489

	I0429 00:04:34.635688   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:34.636272   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:34.636301   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:34.636636   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:34.636847   41744 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:04:34.638377   41744 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:04:34.638395   41744 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:34.638695   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:34.638727   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:34.653127   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44553

	I0429 00:04:34.653627   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:34.654147   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:34.654173   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:34.654509   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:34.654697   41744 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:04:34.657693   41744 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:34.658304   41744 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:34.658333   41744 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:34.658490   41744 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:34.658908   41744 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:34.658951   41744 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:34.674397   41744 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43799

	I0429 00:04:34.674855   41744 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:34.675365   41744 main.go:141] libmachine: Using API Version  1

	I0429 00:04:34.675387   41744 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:34.675684   41744 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:34.675857   41744 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:04:34.676067   41744 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:34.676085   41744 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:04:34.678697   41744 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:34.679046   41744 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:34.679073   41744 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:34.679229   41744 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:04:34.679394   41744 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:04:34.679500   41744 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:04:34.679633   41744 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:04:34.760455   41744 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:34.779755   41744 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr: exit status 7 (671.821887ms)

-- stdout --

	ha-274394

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-274394-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-274394-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0429 00:04:45.832606   41880 out.go:291] Setting OutFile to fd 1 ...

	I0429 00:04:45.832722   41880 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:45.832744   41880 out.go:304] Setting ErrFile to fd 2...

	I0429 00:04:45.832748   41880 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0429 00:04:45.832945   41880 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0429 00:04:45.833107   41880 out.go:298] Setting JSON to false

	I0429 00:04:45.833132   41880 mustload.go:65] Loading cluster: ha-274394

	I0429 00:04:45.833187   41880 notify.go:220] Checking for updates...

	I0429 00:04:45.833513   41880 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0429 00:04:45.833527   41880 status.go:255] checking status of ha-274394 ...

	I0429 00:04:45.833916   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:45.834001   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:45.852798   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34533

	I0429 00:04:45.853206   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:45.853746   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:45.853770   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:45.854170   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:45.854363   41880 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0429 00:04:45.856060   41880 status.go:330] ha-274394 host status = "Running" (err=<nil>)

	I0429 00:04:45.856074   41880 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:45.856350   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:45.856415   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:45.871815   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42953

	I0429 00:04:45.872286   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:45.872777   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:45.872798   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:45.873121   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:45.873298   41880 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0429 00:04:45.876276   41880 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:45.876690   41880 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:45.876725   41880 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:45.876852   41880 host.go:66] Checking if "ha-274394" exists ...

	I0429 00:04:45.877266   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:45.877314   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:45.893369   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45011

	I0429 00:04:45.893832   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:45.894375   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:45.894400   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:45.894767   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:45.894963   41880 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0429 00:04:45.895165   41880 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:45.895204   41880 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0429 00:04:45.898157   41880 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:45.898577   41880 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0429 00:04:45.898598   41880 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0429 00:04:45.898781   41880 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0429 00:04:45.898971   41880 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0429 00:04:45.899109   41880 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0429 00:04:45.899288   41880 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0429 00:04:45.982892   41880 ssh_runner.go:195] Run: systemctl --version

	I0429 00:04:45.991169   41880 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:46.011848   41880 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:46.011876   41880 api_server.go:166] Checking apiserver status ...

	I0429 00:04:46.011908   41880 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:46.030480   41880 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup

	W0429 00:04:46.044685   41880 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1163/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:46.044736   41880 ssh_runner.go:195] Run: ls

	I0429 00:04:46.050414   41880 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:46.058175   41880 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:46.058197   41880 status.go:422] ha-274394 apiserver status = Running (err=<nil>)

	I0429 00:04:46.058207   41880 status.go:257] ha-274394 status: &{Name:ha-274394 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:46.058225   41880 status.go:255] checking status of ha-274394-m02 ...

	I0429 00:04:46.058534   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:46.058573   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:46.073139   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34835

	I0429 00:04:46.073549   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:46.074078   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:46.074100   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:46.074405   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:46.074586   41880 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0429 00:04:46.076046   41880 status.go:330] ha-274394-m02 host status = "Stopped" (err=<nil>)

	I0429 00:04:46.076060   41880 status.go:343] host is not running, skipping remaining checks

	I0429 00:04:46.076068   41880 status.go:257] ha-274394-m02 status: &{Name:ha-274394-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:46.076086   41880 status.go:255] checking status of ha-274394-m03 ...

	I0429 00:04:46.076344   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:46.076386   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:46.092197   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33297

	I0429 00:04:46.092616   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:46.093178   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:46.093203   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:46.093508   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:46.093705   41880 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0429 00:04:46.095308   41880 status.go:330] ha-274394-m03 host status = "Running" (err=<nil>)

	I0429 00:04:46.095326   41880 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:46.095652   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:46.095688   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:46.110267   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43781

	I0429 00:04:46.110621   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:46.111088   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:46.111113   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:46.111402   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:46.111576   41880 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0429 00:04:46.114431   41880 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:46.114883   41880 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:46.114910   41880 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:46.115042   41880 host.go:66] Checking if "ha-274394-m03" exists ...

	I0429 00:04:46.115333   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:46.115377   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:46.130101   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43271

	I0429 00:04:46.130515   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:46.131013   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:46.131037   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:46.131334   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:46.131546   41880 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0429 00:04:46.131722   41880 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:46.131745   41880 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0429 00:04:46.134579   41880 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:46.134974   41880 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0429 00:04:46.134996   41880 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0429 00:04:46.135141   41880 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0429 00:04:46.135330   41880 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0429 00:04:46.135532   41880 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0429 00:04:46.135677   41880 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0429 00:04:46.226640   41880 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:46.245410   41880 kubeconfig.go:125] found "ha-274394" server: "https://192.168.39.254:8443"

	I0429 00:04:46.245440   41880 api_server.go:166] Checking apiserver status ...

	I0429 00:04:46.245474   41880 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:04:46.261345   41880 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup

	W0429 00:04:46.272659   41880 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1506/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0429 00:04:46.272708   41880 ssh_runner.go:195] Run: ls

	I0429 00:04:46.277680   41880 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0429 00:04:46.286167   41880 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0429 00:04:46.286189   41880 status.go:422] ha-274394-m03 apiserver status = Running (err=<nil>)

	I0429 00:04:46.286197   41880 status.go:257] ha-274394-m03 status: &{Name:ha-274394-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0429 00:04:46.286211   41880 status.go:255] checking status of ha-274394-m04 ...

	I0429 00:04:46.286491   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:46.286525   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:46.302991   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40977

	I0429 00:04:46.303399   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:46.303852   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:46.303872   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:46.304154   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:46.304298   41880 main.go:141] libmachine: (ha-274394-m04) Calling .GetState

	I0429 00:04:46.305902   41880 status.go:330] ha-274394-m04 host status = "Running" (err=<nil>)

	I0429 00:04:46.305920   41880 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:46.306215   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:46.306253   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:46.321589   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34655

	I0429 00:04:46.322065   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:46.322511   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:46.322534   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:46.322873   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:46.323070   41880 main.go:141] libmachine: (ha-274394-m04) Calling .GetIP

	I0429 00:04:46.325827   41880 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:46.326291   41880 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:46.326330   41880 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:46.326515   41880 host.go:66] Checking if "ha-274394-m04" exists ...

	I0429 00:04:46.326861   41880 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0429 00:04:46.326918   41880 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0429 00:04:46.342606   41880 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38601

	I0429 00:04:46.343011   41880 main.go:141] libmachine: () Calling .GetVersion

	I0429 00:04:46.343500   41880 main.go:141] libmachine: Using API Version  1

	I0429 00:04:46.343522   41880 main.go:141] libmachine: () Calling .SetConfigRaw

	I0429 00:04:46.343803   41880 main.go:141] libmachine: () Calling .GetMachineName

	I0429 00:04:46.343980   41880 main.go:141] libmachine: (ha-274394-m04) Calling .DriverName

	I0429 00:04:46.344188   41880 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0429 00:04:46.344206   41880 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHHostname

	I0429 00:04:46.347106   41880 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:46.347548   41880 main.go:141] libmachine: (ha-274394-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:65:92:5b", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 01:00:45 +0000 UTC Type:0 Mac:52:54:00:65:92:5b Iaid: IPaddr:192.168.39.106 Prefix:24 Hostname:ha-274394-m04 Clientid:01:52:54:00:65:92:5b}

	I0429 00:04:46.347572   41880 main.go:141] libmachine: (ha-274394-m04) DBG | domain ha-274394-m04 has defined IP address 192.168.39.106 and MAC address 52:54:00:65:92:5b in network mk-ha-274394

	I0429 00:04:46.347721   41880 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHPort

	I0429 00:04:46.347898   41880 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHKeyPath

	I0429 00:04:46.348053   41880 main.go:141] libmachine: (ha-274394-m04) Calling .GetSSHUsername

	I0429 00:04:46.348202   41880 sshutil.go:53] new ssh client: &{IP:192.168.39.106 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m04/id_rsa Username:docker}

	I0429 00:04:46.426591   41880 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:04:46.441771   41880 status.go:257] ha-274394-m04 status: &{Name:ha-274394-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-274394 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-274394 -n ha-274394

helpers_test.go:244: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-274394 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-274394 logs -n 25: (1.607671484s)

helpers_test.go:252: TestMultiControlPlane/serial/RestartSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m03:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394:/home/docker/cp-test_ha-274394-m03_ha-274394.txt                       |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394 sudo cat                                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m03_ha-274394.txt                                 |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m03:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m02:/home/docker/cp-test_ha-274394-m03_ha-274394-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m02 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m03_ha-274394-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m03:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04:/home/docker/cp-test_ha-274394-m03_ha-274394-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m04 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m03_ha-274394-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-274394 cp testdata/cp-test.txt                                                | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile3174175435/001/cp-test_ha-274394-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394:/home/docker/cp-test_ha-274394-m04_ha-274394.txt                       |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394 sudo cat                                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m04_ha-274394.txt                                 |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m02:/home/docker/cp-test_ha-274394-m04_ha-274394-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m02 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m04_ha-274394-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-274394 cp ha-274394-m04:/home/docker/cp-test.txt                              | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m03:/home/docker/cp-test_ha-274394-m04_ha-274394-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n                                                                 | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | ha-274394-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-274394 ssh -n ha-274394-m03 sudo cat                                          | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC | 29 Apr 24 00:01 UTC |

	|         | /home/docker/cp-test_ha-274394-m04_ha-274394-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-274394 node stop m02 -v=7                                                     | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:01 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-274394 node start m02 -v=7                                                    | ha-274394 | jenkins | v1.33.0 | 29 Apr 24 00:03 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/04/28 23:56:44

	Running on machine: ubuntu-20-agent-10

	Binary: Built with gc go1.22.1 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0428 23:56:44.603247   36356 out.go:291] Setting OutFile to fd 1 ...

	I0428 23:56:44.603339   36356 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0428 23:56:44.603350   36356 out.go:304] Setting ErrFile to fd 2...

	I0428 23:56:44.603354   36356 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0428 23:56:44.603524   36356 root.go:338] Updating PATH: /home/jenkins/minikube-integration/17977-13393/.minikube/bin

	I0428 23:56:44.604037   36356 out.go:298] Setting JSON to false

	I0428 23:56:44.604835   36356 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-10","uptime":5949,"bootTime":1714342656,"procs":177,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1058-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0428 23:56:44.604886   36356 start.go:139] virtualization: kvm guest

	I0428 23:56:44.607006   36356 out.go:177] * [ha-274394] minikube v1.33.0 on Ubuntu 20.04 (kvm/amd64)

	I0428 23:56:44.608416   36356 notify.go:220] Checking for updates...

	I0428 23:56:44.609889   36356 out.go:177]   - MINIKUBE_LOCATION=17977

	I0428 23:56:44.611307   36356 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0428 23:56:44.612625   36356 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:56:44.613862   36356 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:56:44.615062   36356 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0428 23:56:44.616343   36356 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0428 23:56:44.617967   36356 driver.go:392] Setting default libvirt URI to qemu:///system

	I0428 23:56:44.652686   36356 out.go:177] * Using the kvm2 driver based on user configuration

	I0428 23:56:44.653931   36356 start.go:297] selected driver: kvm2

	I0428 23:56:44.653943   36356 start.go:901] validating driver "kvm2" against <nil>

	I0428 23:56:44.653953   36356 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0428 23:56:44.654662   36356 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0428 23:56:44.654727   36356 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/17977-13393/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0428 23:56:44.669647   36356 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0

	I0428 23:56:44.669711   36356 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0428 23:56:44.669935   36356 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0428 23:56:44.669992   36356 cni.go:84] Creating CNI manager for ""

	I0428 23:56:44.670004   36356 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0428 23:56:44.670008   36356 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0428 23:56:44.670095   36356 start.go:340] cluster config:

	{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0428 23:56:44.670188   36356 iso.go:125] acquiring lock: {Name:mkdac29be984af97898eb097bf04b319c0b5a23b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0428 23:56:44.672641   36356 out.go:177] * Starting "ha-274394" primary control-plane node in "ha-274394" cluster

	I0428 23:56:44.673990   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:56:44.674079   36356 preload.go:147] Found local preload: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4

	I0428 23:56:44.674091   36356 cache.go:56] Caching tarball of preloaded images

	I0428 23:56:44.674167   36356 preload.go:173] Found /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0428 23:56:44.674177   36356 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0428 23:56:44.674499   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:56:44.674522   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json: {Name:mka29a6cba1291c4c68f145dccef6ba110940a93 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:56:44.674652   36356 start.go:360] acquireMachinesLock for ha-274394: {Name:mkf607109012ed2f4aeb283e90eb20782d746716 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0428 23:56:44.674679   36356 start.go:364] duration metric: took 14.805µs to acquireMachinesLock for "ha-274394"

	I0428 23:56:44.674692   36356 start.go:93] Provisioning new machine with config: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:56:44.674751   36356 start.go:125] createHost starting for "" (driver="kvm2")

	I0428 23:56:44.676337   36356 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0428 23:56:44.676466   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:56:44.676503   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:56:44.690945   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37491

	I0428 23:56:44.691290   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:56:44.691875   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:56:44.691902   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:56:44.692184   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:56:44.692373   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:56:44.692481   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:56:44.692639   36356 start.go:159] libmachine.API.Create for "ha-274394" (driver="kvm2")

	I0428 23:56:44.692672   36356 client.go:168] LocalClient.Create starting

	I0428 23:56:44.692707   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem

	I0428 23:56:44.692765   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:56:44.692791   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:56:44.692853   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem

	I0428 23:56:44.692882   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:56:44.692901   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:56:44.692925   36356 main.go:141] libmachine: Running pre-create checks...

	I0428 23:56:44.692937   36356 main.go:141] libmachine: (ha-274394) Calling .PreCreateCheck

	I0428 23:56:44.693213   36356 main.go:141] libmachine: (ha-274394) Calling .GetConfigRaw

	I0428 23:56:44.693560   36356 main.go:141] libmachine: Creating machine...

	I0428 23:56:44.693574   36356 main.go:141] libmachine: (ha-274394) Calling .Create

	I0428 23:56:44.693695   36356 main.go:141] libmachine: (ha-274394) Creating KVM machine...

	I0428 23:56:44.694900   36356 main.go:141] libmachine: (ha-274394) DBG | found existing default KVM network

	I0428 23:56:44.695582   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:44.695473   36379 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ac0}

	I0428 23:56:44.695617   36356 main.go:141] libmachine: (ha-274394) DBG | created network xml: 

	I0428 23:56:44.695637   36356 main.go:141] libmachine: (ha-274394) DBG | <network>

	I0428 23:56:44.695651   36356 main.go:141] libmachine: (ha-274394) DBG |   <name>mk-ha-274394</name>

	I0428 23:56:44.695670   36356 main.go:141] libmachine: (ha-274394) DBG |   <dns enable='no'/>

	I0428 23:56:44.695685   36356 main.go:141] libmachine: (ha-274394) DBG |   

	I0428 23:56:44.695695   36356 main.go:141] libmachine: (ha-274394) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0428 23:56:44.695714   36356 main.go:141] libmachine: (ha-274394) DBG |     <dhcp>

	I0428 23:56:44.695730   36356 main.go:141] libmachine: (ha-274394) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0428 23:56:44.695740   36356 main.go:141] libmachine: (ha-274394) DBG |     </dhcp>

	I0428 23:56:44.695758   36356 main.go:141] libmachine: (ha-274394) DBG |   </ip>

	I0428 23:56:44.695763   36356 main.go:141] libmachine: (ha-274394) DBG |   

	I0428 23:56:44.695767   36356 main.go:141] libmachine: (ha-274394) DBG | </network>

	I0428 23:56:44.695774   36356 main.go:141] libmachine: (ha-274394) DBG | 

	I0428 23:56:44.700784   36356 main.go:141] libmachine: (ha-274394) DBG | trying to create private KVM network mk-ha-274394 192.168.39.0/24...

	I0428 23:56:44.765647   36356 main.go:141] libmachine: (ha-274394) DBG | private KVM network mk-ha-274394 192.168.39.0/24 created

	I0428 23:56:44.765680   36356 main.go:141] libmachine: (ha-274394) Setting up store path in /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394 ...

	I0428 23:56:44.765707   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:44.765600   36379 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:56:44.765726   36356 main.go:141] libmachine: (ha-274394) Building disk image from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0428 23:56:44.765810   36356 main.go:141] libmachine: (ha-274394) Downloading /home/jenkins/minikube-integration/17977-13393/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0428 23:56:44.991025   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:44.990901   36379 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa...

	I0428 23:56:45.061669   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:45.061561   36379 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/ha-274394.rawdisk...

	I0428 23:56:45.061712   36356 main.go:141] libmachine: (ha-274394) DBG | Writing magic tar header

	I0428 23:56:45.061726   36356 main.go:141] libmachine: (ha-274394) DBG | Writing SSH key tar header

	I0428 23:56:45.061742   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:45.061686   36379 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394 ...

	I0428 23:56:45.061871   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394

	I0428 23:56:45.061933   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394 (perms=drwx------)

	I0428 23:56:45.061961   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines

	I0428 23:56:45.061982   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:56:45.061998   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393

	I0428 23:56:45.062011   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines (perms=drwxr-xr-x)

	I0428 23:56:45.062043   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube (perms=drwxr-xr-x)

	I0428 23:56:45.062056   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393 (perms=drwxrwxr-x)

	I0428 23:56:45.062068   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0428 23:56:45.062082   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0428 23:56:45.062094   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home/jenkins

	I0428 23:56:45.062107   36356 main.go:141] libmachine: (ha-274394) DBG | Checking permissions on dir: /home

	I0428 23:56:45.062116   36356 main.go:141] libmachine: (ha-274394) DBG | Skipping /home - not owner

	I0428 23:56:45.062127   36356 main.go:141] libmachine: (ha-274394) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0428 23:56:45.062136   36356 main.go:141] libmachine: (ha-274394) Creating domain...

	I0428 23:56:45.062965   36356 main.go:141] libmachine: (ha-274394) define libvirt domain using xml: 

	I0428 23:56:45.062990   36356 main.go:141] libmachine: (ha-274394) <domain type='kvm'>

	I0428 23:56:45.063000   36356 main.go:141] libmachine: (ha-274394)   <name>ha-274394</name>

	I0428 23:56:45.063009   36356 main.go:141] libmachine: (ha-274394)   <memory unit='MiB'>2200</memory>

	I0428 23:56:45.063020   36356 main.go:141] libmachine: (ha-274394)   <vcpu>2</vcpu>

	I0428 23:56:45.063029   36356 main.go:141] libmachine: (ha-274394)   <features>

	I0428 23:56:45.063041   36356 main.go:141] libmachine: (ha-274394)     <acpi/>

	I0428 23:56:45.063045   36356 main.go:141] libmachine: (ha-274394)     <apic/>

	I0428 23:56:45.063053   36356 main.go:141] libmachine: (ha-274394)     <pae/>

	I0428 23:56:45.063058   36356 main.go:141] libmachine: (ha-274394)     

	I0428 23:56:45.063066   36356 main.go:141] libmachine: (ha-274394)   </features>

	I0428 23:56:45.063071   36356 main.go:141] libmachine: (ha-274394)   <cpu mode='host-passthrough'>

	I0428 23:56:45.063078   36356 main.go:141] libmachine: (ha-274394)   

	I0428 23:56:45.063085   36356 main.go:141] libmachine: (ha-274394)   </cpu>

	I0428 23:56:45.063111   36356 main.go:141] libmachine: (ha-274394)   <os>

	I0428 23:56:45.063132   36356 main.go:141] libmachine: (ha-274394)     <type>hvm</type>

	I0428 23:56:45.063145   36356 main.go:141] libmachine: (ha-274394)     <boot dev='cdrom'/>

	I0428 23:56:45.063156   36356 main.go:141] libmachine: (ha-274394)     <boot dev='hd'/>

	I0428 23:56:45.063168   36356 main.go:141] libmachine: (ha-274394)     <bootmenu enable='no'/>

	I0428 23:56:45.063177   36356 main.go:141] libmachine: (ha-274394)   </os>

	I0428 23:56:45.063188   36356 main.go:141] libmachine: (ha-274394)   <devices>

	I0428 23:56:45.063199   36356 main.go:141] libmachine: (ha-274394)     <disk type='file' device='cdrom'>

	I0428 23:56:45.063232   36356 main.go:141] libmachine: (ha-274394)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/boot2docker.iso'/>

	I0428 23:56:45.063257   36356 main.go:141] libmachine: (ha-274394)       <target dev='hdc' bus='scsi'/>

	I0428 23:56:45.063269   36356 main.go:141] libmachine: (ha-274394)       <readonly/>

	I0428 23:56:45.063287   36356 main.go:141] libmachine: (ha-274394)     </disk>

	I0428 23:56:45.063297   36356 main.go:141] libmachine: (ha-274394)     <disk type='file' device='disk'>

	I0428 23:56:45.063303   36356 main.go:141] libmachine: (ha-274394)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0428 23:56:45.063311   36356 main.go:141] libmachine: (ha-274394)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/ha-274394.rawdisk'/>

	I0428 23:56:45.063319   36356 main.go:141] libmachine: (ha-274394)       <target dev='hda' bus='virtio'/>

	I0428 23:56:45.063323   36356 main.go:141] libmachine: (ha-274394)     </disk>

	I0428 23:56:45.063332   36356 main.go:141] libmachine: (ha-274394)     <interface type='network'>

	I0428 23:56:45.063338   36356 main.go:141] libmachine: (ha-274394)       <source network='mk-ha-274394'/>

	I0428 23:56:45.063344   36356 main.go:141] libmachine: (ha-274394)       <model type='virtio'/>

	I0428 23:56:45.063349   36356 main.go:141] libmachine: (ha-274394)     </interface>

	I0428 23:56:45.063359   36356 main.go:141] libmachine: (ha-274394)     <interface type='network'>

	I0428 23:56:45.063379   36356 main.go:141] libmachine: (ha-274394)       <source network='default'/>

	I0428 23:56:45.063391   36356 main.go:141] libmachine: (ha-274394)       <model type='virtio'/>

	I0428 23:56:45.063403   36356 main.go:141] libmachine: (ha-274394)     </interface>

	I0428 23:56:45.063417   36356 main.go:141] libmachine: (ha-274394)     <serial type='pty'>

	I0428 23:56:45.063428   36356 main.go:141] libmachine: (ha-274394)       <target port='0'/>

	I0428 23:56:45.063437   36356 main.go:141] libmachine: (ha-274394)     </serial>

	I0428 23:56:45.063445   36356 main.go:141] libmachine: (ha-274394)     <console type='pty'>

	I0428 23:56:45.063455   36356 main.go:141] libmachine: (ha-274394)       <target type='serial' port='0'/>

	I0428 23:56:45.063474   36356 main.go:141] libmachine: (ha-274394)     </console>

	I0428 23:56:45.063484   36356 main.go:141] libmachine: (ha-274394)     <rng model='virtio'>

	I0428 23:56:45.063512   36356 main.go:141] libmachine: (ha-274394)       <backend model='random'>/dev/random</backend>

	I0428 23:56:45.063538   36356 main.go:141] libmachine: (ha-274394)     </rng>

	I0428 23:56:45.063550   36356 main.go:141] libmachine: (ha-274394)     

	I0428 23:56:45.063572   36356 main.go:141] libmachine: (ha-274394)     

	I0428 23:56:45.063584   36356 main.go:141] libmachine: (ha-274394)   </devices>

	I0428 23:56:45.063593   36356 main.go:141] libmachine: (ha-274394) </domain>

	I0428 23:56:45.063601   36356 main.go:141] libmachine: (ha-274394) 

	I0428 23:56:45.067836   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a6:1d:f8 in network default

	I0428 23:56:45.068304   36356 main.go:141] libmachine: (ha-274394) Ensuring networks are active...

	I0428 23:56:45.068323   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:45.068905   36356 main.go:141] libmachine: (ha-274394) Ensuring network default is active

	I0428 23:56:45.069173   36356 main.go:141] libmachine: (ha-274394) Ensuring network mk-ha-274394 is active

	I0428 23:56:45.069648   36356 main.go:141] libmachine: (ha-274394) Getting domain xml...

	I0428 23:56:45.070358   36356 main.go:141] libmachine: (ha-274394) Creating domain...

	I0428 23:56:46.229124   36356 main.go:141] libmachine: (ha-274394) Waiting to get IP...

	I0428 23:56:46.229873   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:46.230293   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:46.230321   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:46.230266   36379 retry.go:31] will retry after 256.079887ms: waiting for machine to come up

	I0428 23:56:46.487746   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:46.488167   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:46.488190   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:46.488135   36379 retry.go:31] will retry after 259.573037ms: waiting for machine to come up

	I0428 23:56:46.749564   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:46.749940   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:46.749971   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:46.749894   36379 retry.go:31] will retry after 421.248911ms: waiting for machine to come up

	I0428 23:56:47.172578   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:47.173101   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:47.173132   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:47.173077   36379 retry.go:31] will retry after 446.554138ms: waiting for machine to come up

	I0428 23:56:47.621636   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:47.622039   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:47.622068   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:47.621985   36379 retry.go:31] will retry after 623.05137ms: waiting for machine to come up

	I0428 23:56:48.246898   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:48.247325   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:48.247347   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:48.247304   36379 retry.go:31] will retry after 674.412309ms: waiting for machine to come up

	I0428 23:56:48.922759   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:48.923073   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:48.923103   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:48.923031   36379 retry.go:31] will retry after 750.488538ms: waiting for machine to come up

	I0428 23:56:49.675196   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:49.675579   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:49.675614   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:49.675525   36379 retry.go:31] will retry after 1.274430052s: waiting for machine to come up

	I0428 23:56:50.951373   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:50.951753   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:50.951780   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:50.951712   36379 retry.go:31] will retry after 1.440496033s: waiting for machine to come up

	I0428 23:56:52.393417   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:52.393792   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:52.393814   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:52.393746   36379 retry.go:31] will retry after 2.10240003s: waiting for machine to come up

	I0428 23:56:54.497430   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:54.497829   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:54.497858   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:54.497777   36379 retry.go:31] will retry after 1.935763747s: waiting for machine to come up

	I0428 23:56:56.434877   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:56.435313   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:56.435343   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:56.435254   36379 retry.go:31] will retry after 2.246149526s: waiting for machine to come up

	I0428 23:56:58.684702   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:56:58.685119   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:56:58.685143   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:56:58.685091   36379 retry.go:31] will retry after 2.753267841s: waiting for machine to come up

	I0428 23:57:01.439496   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:01.439726   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find current IP address of domain ha-274394 in network mk-ha-274394

	I0428 23:57:01.439748   36356 main.go:141] libmachine: (ha-274394) DBG | I0428 23:57:01.439695   36379 retry.go:31] will retry after 4.35224695s: waiting for machine to come up

	I0428 23:57:05.794060   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.794442   36356 main.go:141] libmachine: (ha-274394) Found IP for machine: 192.168.39.237

	I0428 23:57:05.794467   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has current primary IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.794476   36356 main.go:141] libmachine: (ha-274394) Reserving static IP address...

	I0428 23:57:05.794825   36356 main.go:141] libmachine: (ha-274394) DBG | unable to find host DHCP lease matching {name: "ha-274394", mac: "52:54:00:a1:02:06", ip: "192.168.39.237"} in network mk-ha-274394

	I0428 23:57:05.865762   36356 main.go:141] libmachine: (ha-274394) DBG | Getting to WaitForSSH function...

	I0428 23:57:05.865787   36356 main.go:141] libmachine: (ha-274394) Reserved static IP address: 192.168.39.237

	I0428 23:57:05.865796   36356 main.go:141] libmachine: (ha-274394) Waiting for SSH to be available...

	I0428 23:57:05.868238   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.868679   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:minikube Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:05.868710   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:05.868753   36356 main.go:141] libmachine: (ha-274394) DBG | Using SSH client type: external

	I0428 23:57:05.868785   36356 main.go:141] libmachine: (ha-274394) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa (-rw-------)

	I0428 23:57:05.868821   36356 main.go:141] libmachine: (ha-274394) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.237 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:57:05.868837   36356 main.go:141] libmachine: (ha-274394) DBG | About to run SSH command:

	I0428 23:57:05.868862   36356 main.go:141] libmachine: (ha-274394) DBG | exit 0

	I0428 23:57:05.995181   36356 main.go:141] libmachine: (ha-274394) DBG | SSH cmd err, output: <nil>: 

	I0428 23:57:05.995442   36356 main.go:141] libmachine: (ha-274394) KVM machine creation complete!

	I0428 23:57:05.995758   36356 main.go:141] libmachine: (ha-274394) Calling .GetConfigRaw

	I0428 23:57:05.996317   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:05.996503   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:05.996642   36356 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0428 23:57:05.996686   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:05.998130   36356 main.go:141] libmachine: Detecting operating system of created instance...

	I0428 23:57:05.998147   36356 main.go:141] libmachine: Waiting for SSH to be available...

	I0428 23:57:05.998155   36356 main.go:141] libmachine: Getting to WaitForSSH function...

	I0428 23:57:05.998161   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.000506   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.000786   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.000807   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.001000   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.001156   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.001304   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.001400   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.001519   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.001696   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.001705   36356 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0428 23:57:06.105745   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:57:06.105775   36356 main.go:141] libmachine: Detecting the provisioner...

	I0428 23:57:06.105785   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.108180   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.108463   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.108483   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.108623   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.108837   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.108991   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.109095   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.109257   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.109433   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.109445   36356 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0428 23:57:06.219616   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0428 23:57:06.219678   36356 main.go:141] libmachine: found compatible host: buildroot

	I0428 23:57:06.219688   36356 main.go:141] libmachine: Provisioning with buildroot...

	I0428 23:57:06.219711   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:57:06.219970   36356 buildroot.go:166] provisioning hostname "ha-274394"

	I0428 23:57:06.219993   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:57:06.220152   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.222516   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.222928   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.222956   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.223088   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.223273   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.223400   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.223530   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.223732   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.223884   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.223895   36356 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-274394 && echo "ha-274394" | sudo tee /etc/hostname

	I0428 23:57:06.346120   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-274394

	I0428 23:57:06.346147   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.348916   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.349259   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.349290   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.349437   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.349605   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.349770   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.349918   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.350107   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.350259   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.350280   36356 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-274394' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-274394/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-274394' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0428 23:57:06.464092   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:57:06.464118   36356 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17977-13393/.minikube CaCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17977-13393/.minikube}

	I0428 23:57:06.464151   36356 buildroot.go:174] setting up certificates

	I0428 23:57:06.464163   36356 provision.go:84] configureAuth start

	I0428 23:57:06.464185   36356 main.go:141] libmachine: (ha-274394) Calling .GetMachineName

	I0428 23:57:06.464469   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:06.467030   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.467355   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.467387   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.467540   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.470563   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.470888   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.470907   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.471082   36356 provision.go:143] copyHostCerts

	I0428 23:57:06.471126   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:57:06.471183   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem, removing ...

	I0428 23:57:06.471207   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:57:06.471291   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem (1675 bytes)

	I0428 23:57:06.471386   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:57:06.471410   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem, removing ...

	I0428 23:57:06.471420   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:57:06.471456   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem (1082 bytes)

	I0428 23:57:06.471517   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:57:06.471540   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem, removing ...

	I0428 23:57:06.471549   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:57:06.471584   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem (1123 bytes)

	I0428 23:57:06.471645   36356 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem org=jenkins.ha-274394 san=[127.0.0.1 192.168.39.237 ha-274394 localhost minikube]

	I0428 23:57:06.573643   36356 provision.go:177] copyRemoteCerts

	I0428 23:57:06.573696   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0428 23:57:06.573720   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.576152   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.576514   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.576544   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.576665   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.576843   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.577001   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.577123   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:06.663863   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0428 23:57:06.663955   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0428 23:57:06.694572   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0428 23:57:06.694632   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0428 23:57:06.722982   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0428 23:57:06.723037   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0428 23:57:06.751340   36356 provision.go:87] duration metric: took 287.163137ms to configureAuth

	I0428 23:57:06.751365   36356 buildroot.go:189] setting minikube options for container-runtime

	I0428 23:57:06.751508   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:57:06.751564   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:06.753881   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.754233   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:06.754262   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:06.754433   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:06.754591   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.754749   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:06.754852   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:06.754990   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:06.755149   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:06.755166   36356 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0428 23:57:07.035413   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0428 23:57:07.035450   36356 main.go:141] libmachine: Checking connection to Docker...

	I0428 23:57:07.035475   36356 main.go:141] libmachine: (ha-274394) Calling .GetURL

	I0428 23:57:07.036800   36356 main.go:141] libmachine: (ha-274394) DBG | Using libvirt version 6000000

	I0428 23:57:07.038840   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.039121   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.039148   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.039301   36356 main.go:141] libmachine: Docker is up and running!

	I0428 23:57:07.039313   36356 main.go:141] libmachine: Reticulating splines...

	I0428 23:57:07.039321   36356 client.go:171] duration metric: took 22.346638475s to LocalClient.Create

	I0428 23:57:07.039346   36356 start.go:167] duration metric: took 22.346709049s to libmachine.API.Create "ha-274394"

	I0428 23:57:07.039358   36356 start.go:293] postStartSetup for "ha-274394" (driver="kvm2")

	I0428 23:57:07.039372   36356 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0428 23:57:07.039392   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.039621   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0428 23:57:07.039654   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.041418   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.041695   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.041721   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.041838   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.042035   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.042193   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.042358   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:07.126553   36356 ssh_runner.go:195] Run: cat /etc/os-release

	I0428 23:57:07.131394   36356 info.go:137] Remote host: Buildroot 2023.02.9

	I0428 23:57:07.131418   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/addons for local assets ...

	I0428 23:57:07.131489   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/files for local assets ...

	I0428 23:57:07.131582   36356 filesync.go:149] local asset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> 207272.pem in /etc/ssl/certs

	I0428 23:57:07.131595   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /etc/ssl/certs/207272.pem

	I0428 23:57:07.131731   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0428 23:57:07.143264   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:57:07.169021   36356 start.go:296] duration metric: took 129.64708ms for postStartSetup

	I0428 23:57:07.169063   36356 main.go:141] libmachine: (ha-274394) Calling .GetConfigRaw

	I0428 23:57:07.169591   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:07.172044   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.172385   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.172414   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.172640   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:57:07.172823   36356 start.go:128] duration metric: took 22.49806301s to createHost

	I0428 23:57:07.172850   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.174730   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.175018   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.175039   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.175144   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.175354   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.175490   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.175622   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.175762   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:57:07.175912   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.237 22 <nil> <nil>}

	I0428 23:57:07.175931   36356 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0428 23:57:07.283490   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714348627.250495573

	I0428 23:57:07.283513   36356 fix.go:216] guest clock: 1714348627.250495573

	I0428 23:57:07.283522   36356 fix.go:229] Guest: 2024-04-28 23:57:07.250495573 +0000 UTC Remote: 2024-04-28 23:57:07.172835932 +0000 UTC m=+22.618724383 (delta=77.659641ms)

	I0428 23:57:07.283564   36356 fix.go:200] guest clock delta is within tolerance: 77.659641ms

	I0428 23:57:07.283580   36356 start.go:83] releasing machines lock for "ha-274394", held for 22.608884768s

	I0428 23:57:07.283601   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.283905   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:07.286602   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.286951   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.286996   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.287152   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.287670   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.287826   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:07.287894   36356 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0428 23:57:07.287938   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.288038   36356 ssh_runner.go:195] Run: cat /version.json

	I0428 23:57:07.288059   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:07.290428   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.290560   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.290791   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.290816   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.290941   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.290945   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:07.291032   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:07.291107   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:07.291130   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.291298   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:07.291309   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.291469   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:07.291526   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:07.291680   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:07.367832   36356 ssh_runner.go:195] Run: systemctl --version

	I0428 23:57:07.389909   36356 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0428 23:57:07.553715   36356 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0428 23:57:07.560656   36356 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0428 23:57:07.560728   36356 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0428 23:57:07.580243   36356 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0428 23:57:07.580269   36356 start.go:494] detecting cgroup driver to use...

	I0428 23:57:07.580352   36356 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0428 23:57:07.597855   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0428 23:57:07.614447   36356 docker.go:217] disabling cri-docker service (if available) ...

	I0428 23:57:07.614507   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0428 23:57:07.630137   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0428 23:57:07.646659   36356 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0428 23:57:07.770067   36356 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0428 23:57:07.939717   36356 docker.go:233] disabling docker service ...

	I0428 23:57:07.939790   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0428 23:57:07.956532   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0428 23:57:07.970431   36356 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0428 23:57:08.090398   36356 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0428 23:57:08.208133   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0428 23:57:08.222537   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0428 23:57:08.243672   36356 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0428 23:57:08.243746   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.254760   36356 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0428 23:57:08.254827   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.265802   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.276580   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.287357   36356 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0428 23:57:08.298925   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.310180   36356 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.329330   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:57:08.340865   36356 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0428 23:57:08.350992   36356 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0428 23:57:08.351099   36356 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0428 23:57:08.365295   36356 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0428 23:57:08.375416   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:57:08.489130   36356 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0428 23:57:08.627175   36356 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0428 23:57:08.627252   36356 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0428 23:57:08.632940   36356 start.go:562] Will wait 60s for crictl version

	I0428 23:57:08.633035   36356 ssh_runner.go:195] Run: which crictl

	I0428 23:57:08.637726   36356 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0428 23:57:08.688300   36356 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0428 23:57:08.688414   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:57:08.718921   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:57:08.752722   36356 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0428 23:57:08.754156   36356 main.go:141] libmachine: (ha-274394) Calling .GetIP

	I0428 23:57:08.756290   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:08.756627   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:08.756654   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:08.756870   36356 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0428 23:57:08.761473   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:57:08.776539   36356 kubeadm.go:877] updating cluster {Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cl

usterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0428 23:57:08.776707   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:57:08.776777   36356 ssh_runner.go:195] Run: sudo crictl images --output json

	I0428 23:57:08.813688   36356 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0". assuming images are not preloaded.

	I0428 23:57:08.813765   36356 ssh_runner.go:195] Run: which lz4

	I0428 23:57:08.818304   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0428 23:57:08.818436   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0428 23:57:08.823568   36356 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0428 23:57:08.823596   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394544937 bytes)

	I0428 23:57:10.542324   36356 crio.go:462] duration metric: took 1.723924834s to copy over tarball

	I0428 23:57:10.542410   36356 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0428 23:57:13.112112   36356 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.569667818s)

	I0428 23:57:13.112142   36356 crio.go:469] duration metric: took 2.569786929s to extract the tarball

	I0428 23:57:13.112149   36356 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0428 23:57:13.152213   36356 ssh_runner.go:195] Run: sudo crictl images --output json

	I0428 23:57:13.202989   36356 crio.go:514] all images are preloaded for cri-o runtime.

	I0428 23:57:13.203014   36356 cache_images.go:84] Images are preloaded, skipping loading

	I0428 23:57:13.203023   36356 kubeadm.go:928] updating node { 192.168.39.237 8443 v1.30.0 crio true true} ...

	I0428 23:57:13.203155   36356 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-274394 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.237

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0428 23:57:13.203239   36356 ssh_runner.go:195] Run: crio config

	I0428 23:57:13.256369   36356 cni.go:84] Creating CNI manager for ""

	I0428 23:57:13.256390   36356 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0428 23:57:13.256398   36356 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0428 23:57:13.256417   36356 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.237 APIServerPort:8443 KubernetesVersion:v1.30.0 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-274394 NodeName:ha-274394 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.237"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.237 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0428 23:57:13.256553   36356 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.237

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-274394"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.237

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.237"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0428 23:57:13.256576   36356 kube-vip.go:111] generating kube-vip config ...

	I0428 23:57:13.256610   36356 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0428 23:57:13.276673   36356 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0428 23:57:13.276754   36356 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0428 23:57:13.276809   36356 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0428 23:57:13.289710   36356 binaries.go:44] Found k8s binaries, skipping transfer

	I0428 23:57:13.289767   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0428 23:57:13.302563   36356 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0428 23:57:13.323639   36356 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0428 23:57:13.343843   36356 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0428 23:57:13.363730   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1352 bytes)

	I0428 23:57:13.384050   36356 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0428 23:57:13.388734   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:57:13.404951   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:57:13.547364   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:57:13.573283   36356 certs.go:68] Setting up /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394 for IP: 192.168.39.237

	I0428 23:57:13.573311   36356 certs.go:194] generating shared ca certs ...

	I0428 23:57:13.573326   36356 certs.go:226] acquiring lock for ca certs: {Name:mka5d31eea282c20e045cfb5e09273edc965e467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.573483   36356 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key

	I0428 23:57:13.573525   36356 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key

	I0428 23:57:13.573535   36356 certs.go:256] generating profile certs ...

	I0428 23:57:13.573586   36356 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key

	I0428 23:57:13.573615   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt with IP's: []

	I0428 23:57:13.648288   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt ...

	I0428 23:57:13.648320   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt: {Name:mk32ae7dfd9f9a702d9db8b5322b2bf08a48e9fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.648491   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key ...

	I0428 23:57:13.648503   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key: {Name:mk3088da440752b13c33384f2e40d936a105f5d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.648587   36356 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582

	I0428 23:57:13.648604   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.237 192.168.39.254]

	I0428 23:57:13.811379   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582 ...

	I0428 23:57:13.811407   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582: {Name:mkec37f4828f6d0d617a8817ad0cb65319dfc837 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.811571   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582 ...

	I0428 23:57:13.811589   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582: {Name:mk3bb5ee50351cf2b6f1de8651fd8346e52caf40 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:13.811694   36356 certs.go:381] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.c2322582 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt

	I0428 23:57:13.811784   36356 certs.go:385] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.c2322582 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key

	I0428 23:57:13.811836   36356 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key

	I0428 23:57:13.811856   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt with IP's: []

	I0428 23:57:14.027352   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt ...

	I0428 23:57:14.027379   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt: {Name:mkf2b62fd6e6eae93da857bc5cdce5be75eb4616 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:14.027538   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key ...

	I0428 23:57:14.027550   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key: {Name:mkca8eb4eb8045104b93c56b349092a4368aa735 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:14.027645   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0428 23:57:14.027664   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0428 23:57:14.027680   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0428 23:57:14.027695   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0428 23:57:14.027706   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0428 23:57:14.027720   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0428 23:57:14.027732   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0428 23:57:14.027743   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0428 23:57:14.027789   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem (1338 bytes)

	W0428 23:57:14.027820   36356 certs.go:480] ignoring /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727_empty.pem, impossibly tiny 0 bytes

	I0428 23:57:14.027829   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem (1675 bytes)

	I0428 23:57:14.027856   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem (1082 bytes)

	I0428 23:57:14.027877   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem (1123 bytes)

	I0428 23:57:14.027897   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem (1675 bytes)

	I0428 23:57:14.027934   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:57:14.027960   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.027974   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem -> /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.027986   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.028516   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0428 23:57:14.056477   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0428 23:57:14.083299   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0428 23:57:14.110784   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0428 23:57:14.138763   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0428 23:57:14.165666   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0428 23:57:14.193648   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0428 23:57:14.223287   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0428 23:57:14.253425   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0428 23:57:14.284140   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem --> /usr/share/ca-certificates/20727.pem (1338 bytes)

	I0428 23:57:14.314319   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /usr/share/ca-certificates/207272.pem (1708 bytes)

	I0428 23:57:14.343119   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0428 23:57:14.364726   36356 ssh_runner.go:195] Run: openssl version

	I0428 23:57:14.375141   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0428 23:57:14.395577   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.401302   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 28 23:08 /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.401384   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:57:14.410279   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0428 23:57:14.425476   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20727.pem && ln -fs /usr/share/ca-certificates/20727.pem /etc/ssl/certs/20727.pem"

	I0428 23:57:14.438080   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.442930   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 28 23:49 /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.442975   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20727.pem

	I0428 23:57:14.449030   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20727.pem /etc/ssl/certs/51391683.0"

	I0428 23:57:14.461177   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/207272.pem && ln -fs /usr/share/ca-certificates/207272.pem /etc/ssl/certs/207272.pem"

	I0428 23:57:14.473485   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.478398   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 28 23:49 /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.478444   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/207272.pem

	I0428 23:57:14.484622   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/207272.pem /etc/ssl/certs/3ec20f2e.0"

	I0428 23:57:14.497144   36356 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0428 23:57:14.501613   36356 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0428 23:57:14.501664   36356 kubeadm.go:391] StartCluster: {Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Clust

erName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:57:14.501755   36356 cri.go:56] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0428 23:57:14.501787   36356 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0428 23:57:14.548339   36356 cri.go:91] found id: ""

	I0428 23:57:14.548426   36356 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0428 23:57:14.560473   36356 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0428 23:57:14.572795   36356 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0428 23:57:14.584608   36356 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0428 23:57:14.584629   36356 kubeadm.go:156] found existing configuration files:

	I0428 23:57:14.584677   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0428 23:57:14.595801   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0428 23:57:14.595872   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0428 23:57:14.608553   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0428 23:57:14.805450   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0428 23:57:14.805508   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0428 23:57:14.816940   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0428 23:57:14.827476   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0428 23:57:14.827533   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0428 23:57:14.838818   36356 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0428 23:57:14.849316   36356 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0428 23:57:14.849374   36356 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0428 23:57:14.860533   36356 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0428 23:57:14.970911   36356 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0

	I0428 23:57:14.971092   36356 kubeadm.go:309] [preflight] Running pre-flight checks

	I0428 23:57:15.140642   36356 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0428 23:57:15.140791   36356 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0428 23:57:15.140938   36356 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0428 23:57:15.402735   36356 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0428 23:57:15.581497   36356 out.go:204]   - Generating certificates and keys ...

	I0428 23:57:15.581620   36356 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0428 23:57:15.581696   36356 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0428 23:57:15.581791   36356 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0428 23:57:15.742471   36356 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0428 23:57:15.880482   36356 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0428 23:57:16.079408   36356 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0428 23:57:16.265709   36356 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0428 23:57:16.265929   36356 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-274394 localhost] and IPs [192.168.39.237 127.0.0.1 ::1]

	I0428 23:57:16.377253   36356 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0428 23:57:16.377392   36356 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-274394 localhost] and IPs [192.168.39.237 127.0.0.1 ::1]

	I0428 23:57:16.568167   36356 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0428 23:57:16.755727   36356 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0428 23:57:17.068472   36356 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0428 23:57:17.068836   36356 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0428 23:57:17.224359   36356 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0428 23:57:17.587671   36356 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0428 23:57:17.762573   36356 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0428 23:57:17.944221   36356 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0428 23:57:18.245238   36356 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0428 23:57:18.245785   36356 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0428 23:57:18.249440   36356 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0428 23:57:18.251518   36356 out.go:204]   - Booting up control plane ...

	I0428 23:57:18.251619   36356 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0428 23:57:18.251797   36356 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0428 23:57:18.252676   36356 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0428 23:57:18.269919   36356 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0428 23:57:18.270872   36356 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0428 23:57:18.270967   36356 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0428 23:57:18.409785   36356 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0428 23:57:18.409916   36356 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0428 23:57:19.408097   36356 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 1.001619721s

	I0428 23:57:19.408195   36356 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0428 23:57:25.389394   36356 kubeadm.go:309] [api-check] The API server is healthy after 5.984864862s

	I0428 23:57:25.404982   36356 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0428 23:57:25.422266   36356 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0428 23:57:25.456777   36356 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0428 23:57:25.456979   36356 kubeadm.go:309] [mark-control-plane] Marking the node ha-274394 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0428 23:57:25.476230   36356 kubeadm.go:309] [bootstrap-token] Using token: p7cwcq.w3fzbiomge83y6x5

	I0428 23:57:25.477875   36356 out.go:204]   - Configuring RBAC rules ...

	I0428 23:57:25.478055   36356 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0428 23:57:25.485371   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0428 23:57:25.497525   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0428 23:57:25.502880   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0428 23:57:25.507998   36356 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0428 23:57:25.515623   36356 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0428 23:57:25.797907   36356 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0428 23:57:26.231776   36356 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0428 23:57:26.796535   36356 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0428 23:57:26.797290   36356 kubeadm.go:309] 

	I0428 23:57:26.797374   36356 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0428 23:57:26.797385   36356 kubeadm.go:309] 

	I0428 23:57:26.797496   36356 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0428 23:57:26.797518   36356 kubeadm.go:309] 

	I0428 23:57:26.797583   36356 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0428 23:57:26.797662   36356 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0428 23:57:26.797737   36356 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0428 23:57:26.797770   36356 kubeadm.go:309] 

	I0428 23:57:26.797838   36356 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0428 23:57:26.797857   36356 kubeadm.go:309] 

	I0428 23:57:26.797939   36356 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0428 23:57:26.797950   36356 kubeadm.go:309] 

	I0428 23:57:26.798054   36356 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0428 23:57:26.798154   36356 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0428 23:57:26.798260   36356 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0428 23:57:26.798268   36356 kubeadm.go:309] 

	I0428 23:57:26.798355   36356 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0428 23:57:26.798421   36356 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0428 23:57:26.798427   36356 kubeadm.go:309] 

	I0428 23:57:26.798493   36356 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token p7cwcq.w3fzbiomge83y6x5 \

	I0428 23:57:26.798582   36356 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 \

	I0428 23:57:26.798602   36356 kubeadm.go:309] 	--control-plane 

	I0428 23:57:26.798608   36356 kubeadm.go:309] 

	I0428 23:57:26.798682   36356 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0428 23:57:26.798693   36356 kubeadm.go:309] 

	I0428 23:57:26.798806   36356 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token p7cwcq.w3fzbiomge83y6x5 \

	I0428 23:57:26.798954   36356 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 

	I0428 23:57:26.799378   36356 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0428 23:57:26.799459   36356 cni.go:84] Creating CNI manager for ""

	I0428 23:57:26.799472   36356 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0428 23:57:26.801505   36356 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0428 23:57:26.802707   36356 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0428 23:57:26.808925   36356 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.0/kubectl ...

	I0428 23:57:26.808943   36356 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0428 23:57:26.834378   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0428 23:57:27.201663   36356 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0428 23:57:27.201739   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:27.201741   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-274394 minikube.k8s.io/updated_at=2024_04_28T23_57_27_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328 minikube.k8s.io/name=ha-274394 minikube.k8s.io/primary=true

	I0428 23:57:27.218086   36356 ops.go:34] apiserver oom_adj: -16

	I0428 23:57:27.424076   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:27.925075   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:28.424356   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:28.924339   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:29.424513   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:29.924288   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:30.425076   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:30.924258   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:31.424755   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:31.924830   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:32.424739   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:32.924320   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:33.425053   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:33.924560   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:34.424815   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:34.924173   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:35.424207   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:35.924496   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:36.425172   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:36.924859   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:37.424869   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:37.924250   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:38.424267   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:38.924424   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0428 23:57:39.082874   36356 kubeadm.go:1107] duration metric: took 11.881195164s to wait for elevateKubeSystemPrivileges

	W0428 23:57:39.082918   36356 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0428 23:57:39.082928   36356 kubeadm.go:393] duration metric: took 24.581266215s to StartCluster

	I0428 23:57:39.082947   36356 settings.go:142] acquiring lock: {Name:mk4e6965347be51f4cd501030baea6b9cd2dbc9e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:39.083032   36356 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:57:39.083795   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/kubeconfig: {Name:mk5412a370a0ddec304ff7697d6d137221e96742 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:57:39.083984   36356 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:57:39.084009   36356 start.go:240] waiting for startup goroutines ...

	I0428 23:57:39.083994   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0428 23:57:39.084007   36356 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]

	I0428 23:57:39.084098   36356 addons.go:69] Setting storage-provisioner=true in profile "ha-274394"

	I0428 23:57:39.084105   36356 addons.go:69] Setting default-storageclass=true in profile "ha-274394"

	I0428 23:57:39.084136   36356 addons.go:234] Setting addon storage-provisioner=true in "ha-274394"

	I0428 23:57:39.084173   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:57:39.084193   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:57:39.084174   36356 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-274394"

	I0428 23:57:39.084599   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.084626   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.084651   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.084660   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.099465   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40107

	I0428 23:57:39.099483   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38259

	I0428 23:57:39.099923   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.099924   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.100433   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.100461   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.100515   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.100531   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.100847   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.100870   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.101048   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:39.101480   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.101623   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.103124   36356 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:57:39.103379   36356 kapi.go:59] client config for ha-274394: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt", KeyFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key", CAFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0428 23:57:39.103792   36356 cert_rotation.go:137] Starting client certificate rotation controller

	I0428 23:57:39.103956   36356 addons.go:234] Setting addon default-storageclass=true in "ha-274394"

	I0428 23:57:39.103995   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:57:39.104250   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.104294   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.117517   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42057

	I0428 23:57:39.117990   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.118551   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.118583   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.118929   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.119159   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:39.119482   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44955

	I0428 23:57:39.119880   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.120375   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.120400   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.120739   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.120952   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:39.122980   36356 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0428 23:57:39.121312   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:39.124387   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:39.124487   36356 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0428 23:57:39.124512   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0428 23:57:39.124529   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:39.127583   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.128028   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:39.128055   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.128209   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:39.128392   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:39.128545   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:39.128689   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:39.140041   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43663

	I0428 23:57:39.140489   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:39.140944   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:39.140962   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:39.141257   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:39.141435   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:57:39.143020   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:57:39.143276   36356 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0428 23:57:39.143289   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0428 23:57:39.143301   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:57:39.146287   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.146694   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:57:39.146732   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:57:39.146972   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:57:39.147160   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:57:39.147331   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:57:39.147464   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:57:39.275667   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0428 23:57:39.307241   36356 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0428 23:57:39.452854   36356 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0428 23:57:39.886409   36356 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0428 23:57:40.144028   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144057   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144093   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144128   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144337   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144352   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144360   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144366   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144465   36356 main.go:141] libmachine: (ha-274394) DBG | Closing plugin on server side

	I0428 23:57:40.144477   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144503   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144521   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.144529   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.144593   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144632   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144616   36356 main.go:141] libmachine: (ha-274394) DBG | Closing plugin on server side

	I0428 23:57:40.144722   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.144737   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.144861   36356 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0428 23:57:40.144875   36356 round_trippers.go:469] Request Headers:

	I0428 23:57:40.144885   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:57:40.144889   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:57:40.159830   36356 round_trippers.go:574] Response Status: 200 OK in 14 milliseconds

	I0428 23:57:40.160397   36356 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0428 23:57:40.160413   36356 round_trippers.go:469] Request Headers:

	I0428 23:57:40.160420   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:57:40.160426   36356 round_trippers.go:473]     Content-Type: application/json

	I0428 23:57:40.160431   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:57:40.164030   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:57:40.164307   36356 main.go:141] libmachine: Making call to close driver server

	I0428 23:57:40.164329   36356 main.go:141] libmachine: (ha-274394) Calling .Close

	I0428 23:57:40.164622   36356 main.go:141] libmachine: Successfully made call to close driver server

	I0428 23:57:40.164645   36356 main.go:141] libmachine: Making call to close connection to plugin binary

	I0428 23:57:40.166553   36356 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0428 23:57:40.168054   36356 addons.go:505] duration metric: took 1.084044252s for enable addons: enabled=[storage-provisioner default-storageclass]

	I0428 23:57:40.168092   36356 start.go:245] waiting for cluster config update ...

	I0428 23:57:40.168102   36356 start.go:254] writing updated cluster config ...

	I0428 23:57:40.170126   36356 out.go:177] 

	I0428 23:57:40.171839   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:57:40.171906   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:57:40.173902   36356 out.go:177] * Starting "ha-274394-m02" control-plane node in "ha-274394" cluster

	I0428 23:57:40.175173   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:57:40.175207   36356 cache.go:56] Caching tarball of preloaded images

	I0428 23:57:40.175324   36356 preload.go:173] Found /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0428 23:57:40.175343   36356 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0428 23:57:40.175453   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:57:40.175692   36356 start.go:360] acquireMachinesLock for ha-274394-m02: {Name:mkf607109012ed2f4aeb283e90eb20782d746716 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0428 23:57:40.175759   36356 start.go:364] duration metric: took 36.777µs to acquireMachinesLock for "ha-274394-m02"

	I0428 23:57:40.175784   36356 start.go:93] Provisioning new machine with config: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:57:40.175893   36356 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0428 23:57:40.177596   36356 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0428 23:57:40.177686   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:57:40.177716   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:57:40.192465   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33915

	I0428 23:57:40.192869   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:57:40.193339   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:57:40.193360   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:57:40.193660   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:57:40.193851   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:57:40.194005   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:57:40.194206   36356 start.go:159] libmachine.API.Create for "ha-274394" (driver="kvm2")

	I0428 23:57:40.194237   36356 client.go:168] LocalClient.Create starting

	I0428 23:57:40.194281   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem

	I0428 23:57:40.194325   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:57:40.194343   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:57:40.194395   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem

	I0428 23:57:40.194413   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:57:40.194423   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:57:40.194437   36356 main.go:141] libmachine: Running pre-create checks...

	I0428 23:57:40.194445   36356 main.go:141] libmachine: (ha-274394-m02) Calling .PreCreateCheck

	I0428 23:57:40.194610   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetConfigRaw

	I0428 23:57:40.194952   36356 main.go:141] libmachine: Creating machine...

	I0428 23:57:40.194964   36356 main.go:141] libmachine: (ha-274394-m02) Calling .Create

	I0428 23:57:40.195082   36356 main.go:141] libmachine: (ha-274394-m02) Creating KVM machine...

	I0428 23:57:40.196448   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found existing default KVM network

	I0428 23:57:40.196567   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found existing private KVM network mk-ha-274394

	I0428 23:57:40.196728   36356 main.go:141] libmachine: (ha-274394-m02) Setting up store path in /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02 ...

	I0428 23:57:40.196753   36356 main.go:141] libmachine: (ha-274394-m02) Building disk image from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0428 23:57:40.196818   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.196708   36756 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:57:40.196940   36356 main.go:141] libmachine: (ha-274394-m02) Downloading /home/jenkins/minikube-integration/17977-13393/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0428 23:57:40.430082   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.429932   36756 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa...

	I0428 23:57:40.583373   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.583223   36756 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/ha-274394-m02.rawdisk...

	I0428 23:57:40.583418   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Writing magic tar header

	I0428 23:57:40.583434   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Writing SSH key tar header

	I0428 23:57:40.583447   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:40.583383   36756 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02 ...

	I0428 23:57:40.583532   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02

	I0428 23:57:40.583555   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02 (perms=drwx------)

	I0428 23:57:40.583568   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines

	I0428 23:57:40.583584   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines (perms=drwxr-xr-x)

	I0428 23:57:40.583603   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:57:40.583619   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393

	I0428 23:57:40.583646   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube (perms=drwxr-xr-x)

	I0428 23:57:40.583660   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393 (perms=drwxrwxr-x)

	I0428 23:57:40.583673   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0428 23:57:40.583685   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home/jenkins

	I0428 23:57:40.583696   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0428 23:57:40.583708   36356 main.go:141] libmachine: (ha-274394-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0428 23:57:40.583716   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Checking permissions on dir: /home

	I0428 23:57:40.583733   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Skipping /home - not owner

	I0428 23:57:40.583747   36356 main.go:141] libmachine: (ha-274394-m02) Creating domain...

	I0428 23:57:40.584643   36356 main.go:141] libmachine: (ha-274394-m02) define libvirt domain using xml: 

	I0428 23:57:40.584666   36356 main.go:141] libmachine: (ha-274394-m02) <domain type='kvm'>

	I0428 23:57:40.584679   36356 main.go:141] libmachine: (ha-274394-m02)   <name>ha-274394-m02</name>

	I0428 23:57:40.584692   36356 main.go:141] libmachine: (ha-274394-m02)   <memory unit='MiB'>2200</memory>

	I0428 23:57:40.584703   36356 main.go:141] libmachine: (ha-274394-m02)   <vcpu>2</vcpu>

	I0428 23:57:40.584718   36356 main.go:141] libmachine: (ha-274394-m02)   <features>

	I0428 23:57:40.584731   36356 main.go:141] libmachine: (ha-274394-m02)     <acpi/>

	I0428 23:57:40.584741   36356 main.go:141] libmachine: (ha-274394-m02)     <apic/>

	I0428 23:57:40.584750   36356 main.go:141] libmachine: (ha-274394-m02)     <pae/>

	I0428 23:57:40.584760   36356 main.go:141] libmachine: (ha-274394-m02)     

	I0428 23:57:40.584777   36356 main.go:141] libmachine: (ha-274394-m02)   </features>

	I0428 23:57:40.584788   36356 main.go:141] libmachine: (ha-274394-m02)   <cpu mode='host-passthrough'>

	I0428 23:57:40.584800   36356 main.go:141] libmachine: (ha-274394-m02)   

	I0428 23:57:40.584812   36356 main.go:141] libmachine: (ha-274394-m02)   </cpu>

	I0428 23:57:40.584825   36356 main.go:141] libmachine: (ha-274394-m02)   <os>

	I0428 23:57:40.584837   36356 main.go:141] libmachine: (ha-274394-m02)     <type>hvm</type>

	I0428 23:57:40.584848   36356 main.go:141] libmachine: (ha-274394-m02)     <boot dev='cdrom'/>

	I0428 23:57:40.584858   36356 main.go:141] libmachine: (ha-274394-m02)     <boot dev='hd'/>

	I0428 23:57:40.584869   36356 main.go:141] libmachine: (ha-274394-m02)     <bootmenu enable='no'/>

	I0428 23:57:40.584881   36356 main.go:141] libmachine: (ha-274394-m02)   </os>

	I0428 23:57:40.584889   36356 main.go:141] libmachine: (ha-274394-m02)   <devices>

	I0428 23:57:40.584903   36356 main.go:141] libmachine: (ha-274394-m02)     <disk type='file' device='cdrom'>

	I0428 23:57:40.584923   36356 main.go:141] libmachine: (ha-274394-m02)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/boot2docker.iso'/>

	I0428 23:57:40.584937   36356 main.go:141] libmachine: (ha-274394-m02)       <target dev='hdc' bus='scsi'/>

	I0428 23:57:40.584947   36356 main.go:141] libmachine: (ha-274394-m02)       <readonly/>

	I0428 23:57:40.584955   36356 main.go:141] libmachine: (ha-274394-m02)     </disk>

	I0428 23:57:40.584965   36356 main.go:141] libmachine: (ha-274394-m02)     <disk type='file' device='disk'>

	I0428 23:57:40.584977   36356 main.go:141] libmachine: (ha-274394-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0428 23:57:40.584989   36356 main.go:141] libmachine: (ha-274394-m02)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/ha-274394-m02.rawdisk'/>

	I0428 23:57:40.585019   36356 main.go:141] libmachine: (ha-274394-m02)       <target dev='hda' bus='virtio'/>

	I0428 23:57:40.585048   36356 main.go:141] libmachine: (ha-274394-m02)     </disk>

	I0428 23:57:40.585062   36356 main.go:141] libmachine: (ha-274394-m02)     <interface type='network'>

	I0428 23:57:40.585078   36356 main.go:141] libmachine: (ha-274394-m02)       <source network='mk-ha-274394'/>

	I0428 23:57:40.585090   36356 main.go:141] libmachine: (ha-274394-m02)       <model type='virtio'/>

	I0428 23:57:40.585100   36356 main.go:141] libmachine: (ha-274394-m02)     </interface>

	I0428 23:57:40.585112   36356 main.go:141] libmachine: (ha-274394-m02)     <interface type='network'>

	I0428 23:57:40.585122   36356 main.go:141] libmachine: (ha-274394-m02)       <source network='default'/>

	I0428 23:57:40.585133   36356 main.go:141] libmachine: (ha-274394-m02)       <model type='virtio'/>

	I0428 23:57:40.585143   36356 main.go:141] libmachine: (ha-274394-m02)     </interface>

	I0428 23:57:40.585193   36356 main.go:141] libmachine: (ha-274394-m02)     <serial type='pty'>

	I0428 23:57:40.585213   36356 main.go:141] libmachine: (ha-274394-m02)       <target port='0'/>

	I0428 23:57:40.585230   36356 main.go:141] libmachine: (ha-274394-m02)     </serial>

	I0428 23:57:40.585246   36356 main.go:141] libmachine: (ha-274394-m02)     <console type='pty'>

	I0428 23:57:40.585275   36356 main.go:141] libmachine: (ha-274394-m02)       <target type='serial' port='0'/>

	I0428 23:57:40.585293   36356 main.go:141] libmachine: (ha-274394-m02)     </console>

	I0428 23:57:40.585302   36356 main.go:141] libmachine: (ha-274394-m02)     <rng model='virtio'>

	I0428 23:57:40.585308   36356 main.go:141] libmachine: (ha-274394-m02)       <backend model='random'>/dev/random</backend>

	I0428 23:57:40.585314   36356 main.go:141] libmachine: (ha-274394-m02)     </rng>

	I0428 23:57:40.585321   36356 main.go:141] libmachine: (ha-274394-m02)     

	I0428 23:57:40.585326   36356 main.go:141] libmachine: (ha-274394-m02)     

	I0428 23:57:40.585333   36356 main.go:141] libmachine: (ha-274394-m02)   </devices>

	I0428 23:57:40.585338   36356 main.go:141] libmachine: (ha-274394-m02) </domain>

	I0428 23:57:40.585349   36356 main.go:141] libmachine: (ha-274394-m02) 

	I0428 23:57:40.591951   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:29:fa:a1 in network default

	I0428 23:57:40.592539   36356 main.go:141] libmachine: (ha-274394-m02) Ensuring networks are active...

	I0428 23:57:40.592572   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:40.593208   36356 main.go:141] libmachine: (ha-274394-m02) Ensuring network default is active

	I0428 23:57:40.593513   36356 main.go:141] libmachine: (ha-274394-m02) Ensuring network mk-ha-274394 is active

	I0428 23:57:40.593859   36356 main.go:141] libmachine: (ha-274394-m02) Getting domain xml...

	I0428 23:57:40.594509   36356 main.go:141] libmachine: (ha-274394-m02) Creating domain...

	I0428 23:57:41.836657   36356 main.go:141] libmachine: (ha-274394-m02) Waiting to get IP...

	I0428 23:57:41.837571   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:41.838045   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:41.838120   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:41.838015   36756 retry.go:31] will retry after 263.733241ms: waiting for machine to come up

	I0428 23:57:42.105185   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:42.105687   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:42.105724   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:42.105649   36756 retry.go:31] will retry after 331.1126ms: waiting for machine to come up

	I0428 23:57:42.438029   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:42.438463   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:42.438490   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:42.438436   36756 retry.go:31] will retry after 446.032628ms: waiting for machine to come up

	I0428 23:57:42.886123   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:42.886522   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:42.886551   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:42.886483   36756 retry.go:31] will retry after 461.928323ms: waiting for machine to come up

	I0428 23:57:43.350246   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:43.350746   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:43.350773   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:43.350696   36756 retry.go:31] will retry after 703.683282ms: waiting for machine to come up

	I0428 23:57:44.055920   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:44.056329   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:44.056361   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:44.056286   36756 retry.go:31] will retry after 903.640049ms: waiting for machine to come up

	I0428 23:57:44.961160   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:44.961635   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:44.961664   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:44.961581   36756 retry.go:31] will retry after 931.278913ms: waiting for machine to come up

	I0428 23:57:45.894066   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:45.894506   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:45.894535   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:45.894451   36756 retry.go:31] will retry after 1.279366183s: waiting for machine to come up

	I0428 23:57:47.174982   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:47.175538   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:47.175570   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:47.175475   36756 retry.go:31] will retry after 1.506197273s: waiting for machine to come up

	I0428 23:57:48.683913   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:48.684413   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:48.684452   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:48.684371   36756 retry.go:31] will retry after 2.323617854s: waiting for machine to come up

	I0428 23:57:51.009605   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:51.010052   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:51.010079   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:51.010011   36756 retry.go:31] will retry after 2.511993371s: waiting for machine to come up

	I0428 23:57:53.524618   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:53.524963   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:53.524989   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:53.524930   36756 retry.go:31] will retry after 2.984005541s: waiting for machine to come up

	I0428 23:57:56.510802   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:57:56.511159   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:57:56.511208   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:57:56.511109   36756 retry.go:31] will retry after 3.975363933s: waiting for machine to come up

	I0428 23:58:00.488249   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:00.488659   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find current IP address of domain ha-274394-m02 in network mk-ha-274394

	I0428 23:58:00.488699   36356 main.go:141] libmachine: (ha-274394-m02) DBG | I0428 23:58:00.488635   36756 retry.go:31] will retry after 4.708905436s: waiting for machine to come up

	I0428 23:58:05.199518   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:05.200038   36356 main.go:141] libmachine: (ha-274394-m02) Found IP for machine: 192.168.39.43

	I0428 23:58:05.200069   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has current primary IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:05.200075   36356 main.go:141] libmachine: (ha-274394-m02) Reserving static IP address...

	I0428 23:58:05.200401   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find host DHCP lease matching {name: "ha-274394-m02", mac: "52:54:00:94:ad:64", ip: "192.168.39.43"} in network mk-ha-274394

	I0428 23:58:05.271102   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Getting to WaitForSSH function...

	I0428 23:58:05.271136   36356 main.go:141] libmachine: (ha-274394-m02) Reserved static IP address: 192.168.39.43

	I0428 23:58:05.271154   36356 main.go:141] libmachine: (ha-274394-m02) Waiting for SSH to be available...

	I0428 23:58:05.273658   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:05.274071   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394

	I0428 23:58:05.274110   36356 main.go:141] libmachine: (ha-274394-m02) DBG | unable to find defined IP address of network mk-ha-274394 interface with MAC address 52:54:00:94:ad:64

	I0428 23:58:05.274190   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH client type: external

	I0428 23:58:05.274217   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa (-rw-------)

	I0428 23:58:05.274244   36356 main.go:141] libmachine: (ha-274394-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:58:05.274262   36356 main.go:141] libmachine: (ha-274394-m02) DBG | About to run SSH command:

	I0428 23:58:05.274279   36356 main.go:141] libmachine: (ha-274394-m02) DBG | exit 0

	I0428 23:58:05.277779   36356 main.go:141] libmachine: (ha-274394-m02) DBG | SSH cmd err, output: exit status 255: 

	I0428 23:58:05.277800   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0428 23:58:05.277808   36356 main.go:141] libmachine: (ha-274394-m02) DBG | command : exit 0

	I0428 23:58:05.277813   36356 main.go:141] libmachine: (ha-274394-m02) DBG | err     : exit status 255

	I0428 23:58:05.277834   36356 main.go:141] libmachine: (ha-274394-m02) DBG | output  : 

	I0428 23:58:08.279936   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Getting to WaitForSSH function...

	I0428 23:58:08.282287   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.282606   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.282638   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.282767   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH client type: external

	I0428 23:58:08.282790   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa (-rw-------)

	I0428 23:58:08.282817   36356 main.go:141] libmachine: (ha-274394-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.43 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:58:08.282831   36356 main.go:141] libmachine: (ha-274394-m02) DBG | About to run SSH command:

	I0428 23:58:08.282847   36356 main.go:141] libmachine: (ha-274394-m02) DBG | exit 0

	I0428 23:58:08.406493   36356 main.go:141] libmachine: (ha-274394-m02) DBG | SSH cmd err, output: <nil>: 

	I0428 23:58:08.406751   36356 main.go:141] libmachine: (ha-274394-m02) KVM machine creation complete!

	I0428 23:58:08.407023   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetConfigRaw

	I0428 23:58:08.407546   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:08.407752   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:08.407917   36356 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0428 23:58:08.407949   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetState

	I0428 23:58:08.409148   36356 main.go:141] libmachine: Detecting operating system of created instance...

	I0428 23:58:08.409163   36356 main.go:141] libmachine: Waiting for SSH to be available...

	I0428 23:58:08.409170   36356 main.go:141] libmachine: Getting to WaitForSSH function...

	I0428 23:58:08.409176   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.411283   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.411639   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.411666   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.411790   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.411958   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.412074   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.412205   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.412341   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.412556   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.412567   36356 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0428 23:58:08.517856   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:58:08.517876   36356 main.go:141] libmachine: Detecting the provisioner...

	I0428 23:58:08.517884   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.520659   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.521074   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.521104   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.521249   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.521452   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.521595   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.521718   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.521891   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.522108   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.522122   36356 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0428 23:58:08.623755   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0428 23:58:08.623844   36356 main.go:141] libmachine: found compatible host: buildroot

	I0428 23:58:08.623859   36356 main.go:141] libmachine: Provisioning with buildroot...

	I0428 23:58:08.623869   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:58:08.624132   36356 buildroot.go:166] provisioning hostname "ha-274394-m02"

	I0428 23:58:08.624159   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:58:08.624360   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.626758   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.627168   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.627207   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.627320   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.627519   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.627679   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.627799   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.627986   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.628168   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.628185   36356 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-274394-m02 && echo "ha-274394-m02" | sudo tee /etc/hostname

	I0428 23:58:08.748721   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-274394-m02

	I0428 23:58:08.748751   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.751328   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.751725   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.751754   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.751921   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:08.752118   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.752289   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:08.752435   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:08.752591   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:08.752746   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:08.752761   36356 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-274394-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-274394-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-274394-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0428 23:58:08.865693   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:58:08.865735   36356 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17977-13393/.minikube CaCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17977-13393/.minikube}

	I0428 23:58:08.865752   36356 buildroot.go:174] setting up certificates

	I0428 23:58:08.865761   36356 provision.go:84] configureAuth start

	I0428 23:58:08.865770   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetMachineName

	I0428 23:58:08.866040   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:08.868779   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.869186   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.869215   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.869353   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:08.871473   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.871800   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:08.871832   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:08.871946   36356 provision.go:143] copyHostCerts

	I0428 23:58:08.871975   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:58:08.872008   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem, removing ...

	I0428 23:58:08.872018   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:58:08.872094   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem (1082 bytes)

	I0428 23:58:08.872213   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:58:08.872239   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem, removing ...

	I0428 23:58:08.872244   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:58:08.872278   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem (1123 bytes)

	I0428 23:58:08.872365   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:58:08.872389   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem, removing ...

	I0428 23:58:08.872398   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:58:08.872430   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem (1675 bytes)

	I0428 23:58:08.872508   36356 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem org=jenkins.ha-274394-m02 san=[127.0.0.1 192.168.39.43 ha-274394-m02 localhost minikube]

	I0428 23:58:09.052110   36356 provision.go:177] copyRemoteCerts

	I0428 23:58:09.052164   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0428 23:58:09.052184   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.054860   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.055216   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.055240   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.055399   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.055567   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.055717   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.055858   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:09.137022   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0428 23:58:09.137100   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0428 23:58:09.167033   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0428 23:58:09.167092   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0428 23:58:09.196003   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0428 23:58:09.196052   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0428 23:58:09.225865   36356 provision.go:87] duration metric: took 360.094398ms to configureAuth

	I0428 23:58:09.225900   36356 buildroot.go:189] setting minikube options for container-runtime

	I0428 23:58:09.226133   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:09.226208   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.228933   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.229315   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.229339   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.229568   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.229766   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.229900   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.230040   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.230170   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:09.230388   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:09.230411   36356 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0428 23:58:09.507505   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0428 23:58:09.507533   36356 main.go:141] libmachine: Checking connection to Docker...

	I0428 23:58:09.507544   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetURL

	I0428 23:58:09.508981   36356 main.go:141] libmachine: (ha-274394-m02) DBG | Using libvirt version 6000000

	I0428 23:58:09.511365   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.511820   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.511847   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.511983   36356 main.go:141] libmachine: Docker is up and running!

	I0428 23:58:09.511995   36356 main.go:141] libmachine: Reticulating splines...

	I0428 23:58:09.512002   36356 client.go:171] duration metric: took 29.317754136s to LocalClient.Create

	I0428 23:58:09.512028   36356 start.go:167] duration metric: took 29.317822967s to libmachine.API.Create "ha-274394"

	I0428 23:58:09.512041   36356 start.go:293] postStartSetup for "ha-274394-m02" (driver="kvm2")

	I0428 23:58:09.512058   36356 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0428 23:58:09.512081   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.512308   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0428 23:58:09.512333   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.514486   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.514786   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.514819   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.514890   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.515065   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.515222   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.515394   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:09.598106   36356 ssh_runner.go:195] Run: cat /etc/os-release

	I0428 23:58:09.603534   36356 info.go:137] Remote host: Buildroot 2023.02.9

	I0428 23:58:09.605400   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/addons for local assets ...

	I0428 23:58:09.605465   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/files for local assets ...

	I0428 23:58:09.605532   36356 filesync.go:149] local asset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> 207272.pem in /etc/ssl/certs

	I0428 23:58:09.605541   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /etc/ssl/certs/207272.pem

	I0428 23:58:09.605627   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0428 23:58:09.616520   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:58:09.648817   36356 start.go:296] duration metric: took 136.751105ms for postStartSetup

	I0428 23:58:09.648864   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetConfigRaw

	I0428 23:58:09.649443   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:09.651782   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.652097   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.652145   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.652400   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:58:09.652581   36356 start.go:128] duration metric: took 29.476676023s to createHost

	I0428 23:58:09.652603   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.654816   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.655121   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.655141   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.655311   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.655499   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.655654   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.655785   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.655923   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:58:09.656090   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.43 22 <nil> <nil>}

	I0428 23:58:09.656101   36356 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0428 23:58:09.763749   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714348689.739838626

	I0428 23:58:09.763772   36356 fix.go:216] guest clock: 1714348689.739838626

	I0428 23:58:09.763782   36356 fix.go:229] Guest: 2024-04-28 23:58:09.739838626 +0000 UTC Remote: 2024-04-28 23:58:09.652593063 +0000 UTC m=+85.098481504 (delta=87.245563ms)

	I0428 23:58:09.763801   36356 fix.go:200] guest clock delta is within tolerance: 87.245563ms

	I0428 23:58:09.763808   36356 start.go:83] releasing machines lock for "ha-274394-m02", held for 29.58803473s

	I0428 23:58:09.763831   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.764088   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:09.766409   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.766722   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.766751   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.769042   36356 out.go:177] * Found network options:

	I0428 23:58:09.770388   36356 out.go:177]   - NO_PROXY=192.168.39.237

	W0428 23:58:09.771614   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:58:09.771670   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.772270   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.772475   36356 main.go:141] libmachine: (ha-274394-m02) Calling .DriverName

	I0428 23:58:09.772539   36356 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0428 23:58:09.772591   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	W0428 23:58:09.772706   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:58:09.772781   36356 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0428 23:58:09.772803   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHHostname

	I0428 23:58:09.775069   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775442   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.775474   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775498   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775608   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.775788   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.775865   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:09.775888   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:09.775969   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.776049   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHPort

	I0428 23:58:09.776112   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:09.776192   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHKeyPath

	I0428 23:58:09.776354   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetSSHUsername

	I0428 23:58:09.776515   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.43 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m02/id_rsa Username:docker}

	I0428 23:58:10.017919   36356 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0428 23:58:10.025250   36356 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0428 23:58:10.025319   36356 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0428 23:58:10.042207   36356 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0428 23:58:10.042227   36356 start.go:494] detecting cgroup driver to use...

	I0428 23:58:10.042298   36356 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0428 23:58:10.060095   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0428 23:58:10.074396   36356 docker.go:217] disabling cri-docker service (if available) ...

	I0428 23:58:10.074438   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0428 23:58:10.089348   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0428 23:58:10.105801   36356 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0428 23:58:10.231914   36356 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0428 23:58:10.370359   36356 docker.go:233] disabling docker service ...

	I0428 23:58:10.370433   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0428 23:58:10.387029   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0428 23:58:10.401713   36356 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0428 23:58:10.545671   36356 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0428 23:58:10.673835   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0428 23:58:10.690495   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0428 23:58:10.713136   36356 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0428 23:58:10.713195   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.724228   36356 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0428 23:58:10.724289   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.734841   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.745343   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.755951   36356 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0428 23:58:10.769464   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.780518   36356 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.800846   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:58:10.813387   36356 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0428 23:58:10.824342   36356 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0428 23:58:10.824386   36356 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0428 23:58:10.840504   36356 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0428 23:58:10.850816   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:58:11.002082   36356 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0428 23:58:11.150506   36356 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0428 23:58:11.150580   36356 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0428 23:58:11.155694   36356 start.go:562] Will wait 60s for crictl version

	I0428 23:58:11.155737   36356 ssh_runner.go:195] Run: which crictl

	I0428 23:58:11.159794   36356 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0428 23:58:11.198604   36356 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0428 23:58:11.198662   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:58:11.227554   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:58:11.259462   36356 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0428 23:58:11.261048   36356 out.go:177]   - env NO_PROXY=192.168.39.237

	I0428 23:58:11.262197   36356 main.go:141] libmachine: (ha-274394-m02) Calling .GetIP

	I0428 23:58:11.264686   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:11.265028   36356 main.go:141] libmachine: (ha-274394-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:94:ad:64", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:56 +0000 UTC Type:0 Mac:52:54:00:94:ad:64 Iaid: IPaddr:192.168.39.43 Prefix:24 Hostname:ha-274394-m02 Clientid:01:52:54:00:94:ad:64}

	I0428 23:58:11.265066   36356 main.go:141] libmachine: (ha-274394-m02) DBG | domain ha-274394-m02 has defined IP address 192.168.39.43 and MAC address 52:54:00:94:ad:64 in network mk-ha-274394

	I0428 23:58:11.265314   36356 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0428 23:58:11.269635   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:58:11.284122   36356 mustload.go:65] Loading cluster: ha-274394

	I0428 23:58:11.284320   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:11.284574   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:11.284606   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:11.299185   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43987

	I0428 23:58:11.299552   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:11.300015   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:11.300035   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:11.300322   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:11.300512   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:58:11.302241   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:58:11.302540   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:11.302569   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:11.316673   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34755

	I0428 23:58:11.317081   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:11.317581   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:11.317603   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:11.317957   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:11.318147   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:58:11.318306   36356 certs.go:68] Setting up /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394 for IP: 192.168.39.43

	I0428 23:58:11.318321   36356 certs.go:194] generating shared ca certs ...

	I0428 23:58:11.318343   36356 certs.go:226] acquiring lock for ca certs: {Name:mka5d31eea282c20e045cfb5e09273edc965e467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:58:11.318474   36356 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key

	I0428 23:58:11.318509   36356 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key

	I0428 23:58:11.318518   36356 certs.go:256] generating profile certs ...

	I0428 23:58:11.318589   36356 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key

	I0428 23:58:11.318612   36356 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c

	I0428 23:58:11.318627   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.237 192.168.39.43 192.168.39.254]

	I0428 23:58:11.545721   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c ...

	I0428 23:58:11.545748   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c: {Name:mkeed2aa96bd12faaef131331a07f70de364149a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:58:11.545910   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c ...

	I0428 23:58:11.545924   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c: {Name:mk7099ae4bf57427dc8efa8eca1c99f9dfbcfc1c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:58:11.545987   36356 certs.go:381] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.7e238c0c -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt

	I0428 23:58:11.546128   36356 certs.go:385] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.7e238c0c -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key

	I0428 23:58:11.546251   36356 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key

	I0428 23:58:11.546266   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0428 23:58:11.546283   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0428 23:58:11.546302   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0428 23:58:11.546314   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0428 23:58:11.546327   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0428 23:58:11.546339   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0428 23:58:11.546356   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0428 23:58:11.546367   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0428 23:58:11.546440   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem (1338 bytes)

	W0428 23:58:11.546474   36356 certs.go:480] ignoring /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727_empty.pem, impossibly tiny 0 bytes

	I0428 23:58:11.546484   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem (1675 bytes)

	I0428 23:58:11.546515   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem (1082 bytes)

	I0428 23:58:11.546544   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem (1123 bytes)

	I0428 23:58:11.546575   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem (1675 bytes)

	I0428 23:58:11.546612   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:58:11.546640   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /usr/share/ca-certificates/207272.pem

	I0428 23:58:11.546660   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:11.546673   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem -> /usr/share/ca-certificates/20727.pem

	I0428 23:58:11.546701   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:58:11.549269   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:11.549627   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:58:11.549651   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:11.549864   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:58:11.550078   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:58:11.550246   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:58:11.550386   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:58:11.626257   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0428 23:58:11.633493   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0428 23:58:11.648763   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0428 23:58:11.653913   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0428 23:58:11.666682   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0428 23:58:11.671203   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0428 23:58:11.683465   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0428 23:58:11.688416   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0428 23:58:11.700908   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0428 23:58:11.705691   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0428 23:58:11.718671   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0428 23:58:11.723458   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0428 23:58:11.736255   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0428 23:58:11.765294   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0428 23:58:11.790622   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0428 23:58:11.815237   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0428 23:58:11.840522   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0428 23:58:11.866184   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0428 23:58:11.892486   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0428 23:58:11.919387   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0428 23:58:11.945021   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /usr/share/ca-certificates/207272.pem (1708 bytes)

	I0428 23:58:11.971444   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0428 23:58:11.998626   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem --> /usr/share/ca-certificates/20727.pem (1338 bytes)

	I0428 23:58:12.027890   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0428 23:58:12.047360   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0428 23:58:12.066886   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0428 23:58:12.085348   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0428 23:58:12.103655   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0428 23:58:12.122468   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0428 23:58:12.140788   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0428 23:58:12.159242   36356 ssh_runner.go:195] Run: openssl version

	I0428 23:58:12.165224   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/207272.pem && ln -fs /usr/share/ca-certificates/207272.pem /etc/ssl/certs/207272.pem"

	I0428 23:58:12.177844   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/207272.pem

	I0428 23:58:12.183316   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 28 23:49 /usr/share/ca-certificates/207272.pem

	I0428 23:58:12.183365   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/207272.pem

	I0428 23:58:12.190660   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/207272.pem /etc/ssl/certs/3ec20f2e.0"

	I0428 23:58:12.204445   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0428 23:58:12.218304   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:12.223358   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 28 23:08 /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:12.223409   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:58:12.229577   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0428 23:58:12.243231   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20727.pem && ln -fs /usr/share/ca-certificates/20727.pem /etc/ssl/certs/20727.pem"

	I0428 23:58:12.256708   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20727.pem

	I0428 23:58:12.261981   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 28 23:49 /usr/share/ca-certificates/20727.pem

	I0428 23:58:12.262039   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20727.pem

	I0428 23:58:12.268393   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20727.pem /etc/ssl/certs/51391683.0"

	I0428 23:58:12.280239   36356 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0428 23:58:12.284658   36356 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0428 23:58:12.284714   36356 kubeadm.go:928] updating node {m02 192.168.39.43 8443 v1.30.0 crio true true} ...

	I0428 23:58:12.284819   36356 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-274394-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.43

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0428 23:58:12.284857   36356 kube-vip.go:111] generating kube-vip config ...

	I0428 23:58:12.284892   36356 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0428 23:58:12.305290   36356 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0428 23:58:12.305341   36356 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0428 23:58:12.305383   36356 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0428 23:58:12.316898   36356 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0428 23:58:12.316947   36356 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0428 23:58:12.329307   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0428 23:58:12.329324   36356 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet

	I0428 23:58:12.329342   36356 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm

	I0428 23:58:12.329329   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:58:12.329504   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:58:12.335405   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0428 23:58:12.335438   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0428 23:58:14.045229   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:58:14.045312   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:58:14.051404   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0428 23:58:14.051439   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0428 23:58:15.812706   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0428 23:58:15.829608   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:58:15.829706   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:58:15.834283   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0428 23:58:15.834318   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0428 23:58:16.307677   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0428 23:58:16.319127   36356 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (312 bytes)

	I0428 23:58:16.341843   36356 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0428 23:58:16.362469   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0428 23:58:16.382263   36356 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0428 23:58:16.386704   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:58:16.399847   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:58:16.542357   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:58:16.562649   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:58:16.563136   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:16.563183   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:16.578899   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45237

	I0428 23:58:16.579324   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:16.579790   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:16.579815   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:16.580113   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:16.580286   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:58:16.580432   36356 start.go:316] joinCluster: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration

:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:58:16.580525   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0428 23:58:16.580547   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:58:16.583320   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:16.583742   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:58:16.583771   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:58:16.583929   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:58:16.584086   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:58:16.584266   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:58:16.584415   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:58:16.761399   36356 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:58:16.761453   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token kta4yl.dkqb9qr4g4gf2lc7 --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m02 --control-plane --apiserver-advertise-address=192.168.39.43 --apiserver-bind-port=8443"

	I0428 23:58:38.387908   36356 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token kta4yl.dkqb9qr4g4gf2lc7 --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m02 --control-plane --apiserver-advertise-address=192.168.39.43 --apiserver-bind-port=8443": (21.626432622s)

	I0428 23:58:38.387953   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0428 23:58:39.010776   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-274394-m02 minikube.k8s.io/updated_at=2024_04_28T23_58_39_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328 minikube.k8s.io/name=ha-274394 minikube.k8s.io/primary=false

	I0428 23:58:39.142412   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-274394-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0428 23:58:39.293444   36356 start.go:318] duration metric: took 22.713007972s to joinCluster

	I0428 23:58:39.293513   36356 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:58:39.295333   36356 out.go:177] * Verifying Kubernetes components...

	I0428 23:58:39.293856   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:39.296894   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:58:39.590067   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:58:39.653930   36356 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:58:39.654223   36356 kapi.go:59] client config for ha-274394: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt", KeyFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key", CAFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0428 23:58:39.654290   36356 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.237:8443

	I0428 23:58:39.654479   36356 node_ready.go:35] waiting up to 6m0s for node "ha-274394-m02" to be "Ready" ...

	I0428 23:58:39.654555   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:39.654563   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:39.654570   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:39.654574   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:39.664649   36356 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0428 23:58:40.155296   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:40.155331   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:40.155342   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:40.155348   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:40.172701   36356 round_trippers.go:574] Response Status: 200 OK in 17 milliseconds

	I0428 23:58:40.655311   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:40.655338   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:40.655350   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:40.655361   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:40.661218   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:41.155679   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:41.155700   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:41.155710   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:41.155713   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:41.159217   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:41.654979   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:41.655002   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:41.655011   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:41.655017   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:41.658216   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:41.659155   36356 node_ready.go:53] node "ha-274394-m02" has status "Ready":"False"

	I0428 23:58:42.155563   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:42.155591   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:42.155602   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:42.155608   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:42.159309   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:42.655232   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:42.655250   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:42.655258   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:42.655262   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:42.658587   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:43.155324   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:43.155378   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:43.155392   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:43.155397   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:43.160299   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:43.655539   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:43.655559   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:43.655567   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:43.655570   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:43.659388   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:43.660385   36356 node_ready.go:53] node "ha-274394-m02" has status "Ready":"False"

	I0428 23:58:44.154684   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:44.154707   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:44.154715   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:44.154720   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:44.158344   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:44.655229   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:44.684950   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:44.684969   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:44.684976   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:44.689026   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:45.155245   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:45.155266   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:45.155273   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:45.155278   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:45.158906   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:45.655245   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:45.655265   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:45.655272   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:45.655277   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:45.659245   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:46.155290   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:46.155311   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:46.155322   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:46.155328   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:46.160353   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:46.161167   36356 node_ready.go:53] node "ha-274394-m02" has status "Ready":"False"

	I0428 23:58:46.654806   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:46.654828   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:46.654835   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:46.654839   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:46.658180   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:47.155464   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:47.155486   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:47.155494   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:47.155498   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:47.160773   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:47.654818   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:47.654843   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:47.654850   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:47.654855   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:47.658410   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.154672   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:48.154697   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.154706   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.154710   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.159615   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:48.160955   36356 node_ready.go:49] node "ha-274394-m02" has status "Ready":"True"

	I0428 23:58:48.160973   36356 node_ready.go:38] duration metric: took 8.506473788s for node "ha-274394-m02" to be "Ready" ...

	I0428 23:58:48.160982   36356 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0428 23:58:48.161046   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:48.161055   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.161062   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.161068   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.169896   36356 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0428 23:58:48.176675   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.176747   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rslhx

	I0428 23:58:48.176759   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.176765   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.176768   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.179899   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.180719   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:48.180735   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.180742   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.180747   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.184065   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.184638   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:48.184657   36356 pod_ready.go:81] duration metric: took 7.958913ms for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.184666   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.184714   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-xkdcv

	I0428 23:58:48.184722   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.184730   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.184736   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.195110   36356 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0428 23:58:48.195972   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:48.195992   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.195999   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.196003   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.199213   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.199713   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:48.199733   36356 pod_ready.go:81] duration metric: took 15.060231ms for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.199747   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.199805   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394

	I0428 23:58:48.199815   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.199821   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.199825   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.203469   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.204875   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:48.204891   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.204898   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.204902   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.208879   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.209993   36356 pod_ready.go:92] pod "etcd-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:48.210011   36356 pod_ready.go:81] duration metric: took 10.253451ms for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.210037   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:48.210104   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:48.210112   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.210118   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.210123   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.212475   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:48.213184   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:48.213196   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.213203   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.213206   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.216781   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:48.710847   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:48.710869   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.710877   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.710881   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.717464   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0428 23:58:48.718367   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:48.718385   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:48.718395   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:48.718402   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:48.721385   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:49.210458   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:49.210481   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.210488   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.210492   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.214589   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:49.215523   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:49.215538   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.215545   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.215549   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.218124   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:49.710303   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:49.710327   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.710334   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.710340   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.714259   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:49.715063   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:49.715080   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:49.715088   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:49.715092   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:49.718099   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:50.211244   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:50.211267   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.211277   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.211285   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.215809   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:50.216675   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:50.216695   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.216705   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.216711   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.220299   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:50.220861   36356 pod_ready.go:102] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"False"

	I0428 23:58:50.710227   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:50.710254   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.710266   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.710273   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.714777   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:50.715631   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:50.715647   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:50.715656   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:50.715661   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:50.718977   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:51.210455   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:51.210484   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.210492   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.210495   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.214863   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:51.215676   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:51.215695   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.215705   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.215711   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.219164   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:51.710844   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:51.710866   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.710874   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.710878   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.714505   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:51.715380   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:51.715395   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:51.715402   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:51.715405   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:51.718737   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.210936   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:52.210960   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.210969   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.210973   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.214315   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.215246   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:52.215264   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.215271   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.215276   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.217789   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:52.710926   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:52.710951   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.710960   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.710972   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.714784   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.715778   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:52.715797   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:52.715805   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:52.715810   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:52.718927   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:52.719705   36356 pod_ready.go:102] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"False"

	I0428 23:58:53.211232   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:53.211273   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.211284   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.211289   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.215284   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:53.215955   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:53.215970   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.215976   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.215980   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.218518   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:53.710221   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:53.710244   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.710254   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.710259   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.713769   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:53.714799   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:53.714816   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:53.714826   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:53.714831   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:53.717753   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:54.210997   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:54.211027   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.211035   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.211039   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.214689   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:54.215567   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:54.215581   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.215587   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.215592   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.219396   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:54.710980   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:54.710999   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.711006   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.711010   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.714596   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:54.715401   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:54.715416   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:54.715421   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:54.715425   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:54.718723   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:55.211159   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:55.211186   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.211199   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.211207   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.215703   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:55.216484   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:55.216501   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.216507   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.216511   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.219394   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:55.220002   36356 pod_ready.go:102] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"False"

	I0428 23:58:55.710286   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:55.710320   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.710330   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.710335   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.714152   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:55.715422   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:55.715435   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:55.715442   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:55.715446   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:55.718421   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:56.210425   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:56.210447   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.210455   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.210459   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.214208   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:56.215146   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:56.215160   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.215167   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.215171   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.217756   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:56.710994   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:56.711013   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.711021   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.711024   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.713949   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:56.714853   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:56.714867   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:56.714872   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:56.714876   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:56.717415   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.210188   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0428 23:58:57.210211   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.210219   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.210223   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.213897   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:57.215006   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.215024   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.215033   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.215039   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.217552   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.218220   36356 pod_ready.go:92] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.218236   36356 pod_ready.go:81] duration metric: took 9.008187231s for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.218250   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.218295   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394

	I0428 23:58:57.218302   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.218308   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.218315   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.220629   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.221425   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:57.221443   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.221453   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.221462   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.223509   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.224113   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.224133   36356 pod_ready.go:81] duration metric: took 5.873511ms for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.224144   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.224215   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394-m02

	I0428 23:58:57.224227   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.224236   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.224244   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.226285   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.227060   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.227075   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.227082   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.227087   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.229206   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.229767   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.229788   36356 pod_ready.go:81] duration metric: took 5.632505ms for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.229799   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.229849   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394

	I0428 23:58:57.229858   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.229864   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.229868   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.232892   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:57.233655   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:57.233670   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.233676   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.233682   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.235860   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.236478   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.236500   36356 pod_ready.go:81] duration metric: took 6.69293ms for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.236513   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.236567   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m02

	I0428 23:58:57.236582   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.236591   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.236603   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.239009   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.239661   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.239676   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.239684   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.239691   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.242103   36356 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0428 23:58:57.242658   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.242674   36356 pod_ready.go:81] duration metric: took 6.151599ms for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.242681   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.411103   36356 request.go:629] Waited for 168.362894ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0428 23:58:57.411156   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0428 23:58:57.411161   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.411169   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.411174   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.414521   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:57.610626   36356 request.go:629] Waited for 195.367099ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.610752   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:57.610822   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.610833   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.610846   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.615056   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:57.615713   36356 pod_ready.go:92] pod "kube-proxy-g95c9" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:57.615731   36356 pod_ready.go:81] duration metric: took 373.044367ms for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.615740   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:57.811010   36356 request.go:629] Waited for 195.183352ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0428 23:58:57.811064   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0428 23:58:57.811068   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:57.811076   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:57.811081   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:57.815095   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:58.010219   36356 request.go:629] Waited for 194.281833ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.010339   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.010358   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.010365   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.010370   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.014383   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:58.015289   36356 pod_ready.go:92] pod "kube-proxy-pwbfs" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:58.015307   36356 pod_ready.go:81] duration metric: took 399.560892ms for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.015315   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.210510   36356 request.go:629] Waited for 195.105309ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0428 23:58:58.210572   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0428 23:58:58.210577   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.210583   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.210588   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.215302   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:58.410679   36356 request.go:629] Waited for 194.371002ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.410749   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0428 23:58:58.410755   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.410764   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.410770   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.414880   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:58.415576   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:58.415594   36356 pod_ready.go:81] duration metric: took 400.27299ms for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.415604   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.610680   36356 request.go:629] Waited for 195.022143ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0428 23:58:58.610745   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0428 23:58:58.610751   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.610756   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.610760   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.615040   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:58:58.811088   36356 request.go:629] Waited for 195.345352ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:58.811150   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0428 23:58:58.811156   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.811167   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.811171   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.814458   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:58.815300   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0428 23:58:58.815317   36356 pod_ready.go:81] duration metric: took 399.706734ms for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0428 23:58:58.815328   36356 pod_ready.go:38] duration metric: took 10.654327215s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0428 23:58:58.815340   36356 api_server.go:52] waiting for apiserver process to appear ...

	I0428 23:58:58.815386   36356 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0428 23:58:58.831473   36356 api_server.go:72] duration metric: took 19.537927218s to wait for apiserver process to appear ...

	I0428 23:58:58.831505   36356 api_server.go:88] waiting for apiserver healthz status ...

	I0428 23:58:58.831530   36356 api_server.go:253] Checking apiserver healthz at https://192.168.39.237:8443/healthz ...

	I0428 23:58:58.836498   36356 api_server.go:279] https://192.168.39.237:8443/healthz returned 200:

	ok

	I0428 23:58:58.836579   36356 round_trippers.go:463] GET https://192.168.39.237:8443/version

	I0428 23:58:58.836595   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:58.836613   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:58.836621   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:58.837583   36356 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0428 23:58:58.837822   36356 api_server.go:141] control plane version: v1.30.0

	I0428 23:58:58.837849   36356 api_server.go:131] duration metric: took 6.335764ms to wait for apiserver health ...

	I0428 23:58:58.837859   36356 system_pods.go:43] waiting for kube-system pods to appear ...

	I0428 23:58:59.010251   36356 request.go:629] Waited for 172.319916ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.010324   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.010354   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.010369   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.010377   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.016252   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:59.023090   36356 system_pods.go:59] 17 kube-system pods found

	I0428 23:58:59.023126   36356 system_pods.go:61] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0428 23:58:59.023132   36356 system_pods.go:61] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0428 23:58:59.023136   36356 system_pods.go:61] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0428 23:58:59.023140   36356 system_pods.go:61] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0428 23:58:59.023143   36356 system_pods.go:61] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0428 23:58:59.023146   36356 system_pods.go:61] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0428 23:58:59.023150   36356 system_pods.go:61] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0428 23:58:59.023155   36356 system_pods.go:61] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0428 23:58:59.023158   36356 system_pods.go:61] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0428 23:58:59.023161   36356 system_pods.go:61] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0428 23:58:59.023167   36356 system_pods.go:61] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0428 23:58:59.023172   36356 system_pods.go:61] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0428 23:58:59.023175   36356 system_pods.go:61] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0428 23:58:59.023180   36356 system_pods.go:61] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0428 23:58:59.023183   36356 system_pods.go:61] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0428 23:58:59.023186   36356 system_pods.go:61] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0428 23:58:59.023189   36356 system_pods.go:61] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0428 23:58:59.023194   36356 system_pods.go:74] duration metric: took 185.326461ms to wait for pod list to return data ...

	I0428 23:58:59.023207   36356 default_sa.go:34] waiting for default service account to be created ...

	I0428 23:58:59.210913   36356 request.go:629] Waited for 187.648663ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0428 23:58:59.210979   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0428 23:58:59.210993   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.211002   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.211013   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.214865   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:59.215086   36356 default_sa.go:45] found service account: "default"

	I0428 23:58:59.215102   36356 default_sa.go:55] duration metric: took 191.890036ms for default service account to be created ...

	I0428 23:58:59.215110   36356 system_pods.go:116] waiting for k8s-apps to be running ...

	I0428 23:58:59.410522   36356 request.go:629] Waited for 195.32449ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.410587   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0428 23:58:59.410592   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.410599   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.410603   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.416485   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0428 23:58:59.422169   36356 system_pods.go:86] 17 kube-system pods found

	I0428 23:58:59.422199   36356 system_pods.go:89] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0428 23:58:59.422207   36356 system_pods.go:89] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0428 23:58:59.422214   36356 system_pods.go:89] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0428 23:58:59.422220   36356 system_pods.go:89] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0428 23:58:59.422226   36356 system_pods.go:89] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0428 23:58:59.422232   36356 system_pods.go:89] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0428 23:58:59.422237   36356 system_pods.go:89] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0428 23:58:59.422243   36356 system_pods.go:89] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0428 23:58:59.422251   36356 system_pods.go:89] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0428 23:58:59.422265   36356 system_pods.go:89] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0428 23:58:59.422275   36356 system_pods.go:89] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0428 23:58:59.422283   36356 system_pods.go:89] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0428 23:58:59.422293   36356 system_pods.go:89] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0428 23:58:59.422300   36356 system_pods.go:89] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0428 23:58:59.422310   36356 system_pods.go:89] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0428 23:58:59.422316   36356 system_pods.go:89] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0428 23:58:59.422325   36356 system_pods.go:89] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0428 23:58:59.422337   36356 system_pods.go:126] duration metric: took 207.21932ms to wait for k8s-apps to be running ...

	I0428 23:58:59.422349   36356 system_svc.go:44] waiting for kubelet service to be running ....

	I0428 23:58:59.422404   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0428 23:58:59.441950   36356 system_svc.go:56] duration metric: took 19.591591ms WaitForService to wait for kubelet

	I0428 23:58:59.441982   36356 kubeadm.go:576] duration metric: took 20.148438728s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0428 23:58:59.442004   36356 node_conditions.go:102] verifying NodePressure condition ...

	I0428 23:58:59.610455   36356 request.go:629] Waited for 168.364577ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes

	I0428 23:58:59.610505   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes

	I0428 23:58:59.610515   36356 round_trippers.go:469] Request Headers:

	I0428 23:58:59.610522   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:58:59.610526   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:58:59.614523   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0428 23:58:59.615695   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0428 23:58:59.615718   36356 node_conditions.go:123] node cpu capacity is 2

	I0428 23:58:59.615731   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0428 23:58:59.615735   36356 node_conditions.go:123] node cpu capacity is 2

	I0428 23:58:59.615741   36356 node_conditions.go:105] duration metric: took 173.731434ms to run NodePressure ...

	I0428 23:58:59.615756   36356 start.go:240] waiting for startup goroutines ...

	I0428 23:58:59.615797   36356 start.go:254] writing updated cluster config ...

	I0428 23:58:59.617862   36356 out.go:177] 

	I0428 23:58:59.619360   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:58:59.619475   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:58:59.621275   36356 out.go:177] * Starting "ha-274394-m03" control-plane node in "ha-274394" cluster

	I0428 23:58:59.622428   36356 preload.go:132] Checking if preload exists for k8s version v1.30.0 and runtime crio

	I0428 23:58:59.622455   36356 cache.go:56] Caching tarball of preloaded images

	I0428 23:58:59.622553   36356 preload.go:173] Found /home/jenkins/minikube-integration/17977-13393/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0428 23:58:59.622565   36356 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0 on crio

	I0428 23:58:59.622681   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:58:59.622874   36356 start.go:360] acquireMachinesLock for ha-274394-m03: {Name:mkf607109012ed2f4aeb283e90eb20782d746716 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0428 23:58:59.622929   36356 start.go:364] duration metric: took 33.665µs to acquireMachinesLock for "ha-274394-m03"

	I0428 23:58:59.622950   36356 start.go:93] Provisioning new machine with config: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-d

ns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimi

zations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:58:59.623064   36356 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0428 23:58:59.624667   36356 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0428 23:58:59.624758   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:58:59.624802   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:58:59.641214   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42821

	I0428 23:58:59.641727   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:58:59.642309   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:58:59.642334   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:58:59.642611   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:58:59.642804   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:58:59.642927   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:58:59.643066   36356 start.go:159] libmachine.API.Create for "ha-274394" (driver="kvm2")

	I0428 23:58:59.643091   36356 client.go:168] LocalClient.Create starting

	I0428 23:58:59.643121   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem

	I0428 23:58:59.643154   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:58:59.643179   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:58:59.643227   36356 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem

	I0428 23:58:59.643249   36356 main.go:141] libmachine: Decoding PEM data...

	I0428 23:58:59.643260   36356 main.go:141] libmachine: Parsing certificate...

	I0428 23:58:59.643281   36356 main.go:141] libmachine: Running pre-create checks...

	I0428 23:58:59.643296   36356 main.go:141] libmachine: (ha-274394-m03) Calling .PreCreateCheck

	I0428 23:58:59.643479   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetConfigRaw

	I0428 23:58:59.643879   36356 main.go:141] libmachine: Creating machine...

	I0428 23:58:59.643892   36356 main.go:141] libmachine: (ha-274394-m03) Calling .Create

	I0428 23:58:59.644001   36356 main.go:141] libmachine: (ha-274394-m03) Creating KVM machine...

	I0428 23:58:59.645183   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found existing default KVM network

	I0428 23:58:59.645266   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found existing private KVM network mk-ha-274394

	I0428 23:58:59.645383   36356 main.go:141] libmachine: (ha-274394-m03) Setting up store path in /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03 ...

	I0428 23:58:59.645406   36356 main.go:141] libmachine: (ha-274394-m03) Building disk image from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso

	I0428 23:58:59.645459   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.645378   37169 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:58:59.645569   36356 main.go:141] libmachine: (ha-274394-m03) Downloading /home/jenkins/minikube-integration/17977-13393/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/17977-13393/.minikube/cache/iso/amd64/minikube-v1.33.0-1713736271-18706-amd64.iso...

	I0428 23:58:59.868035   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.867896   37169 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa...

	I0428 23:58:59.956656   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.956555   37169 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/ha-274394-m03.rawdisk...

	I0428 23:58:59.956683   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Writing magic tar header

	I0428 23:58:59.956697   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Writing SSH key tar header

	I0428 23:58:59.956708   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:58:59.956666   37169 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03 ...

	I0428 23:58:59.956777   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03

	I0428 23:58:59.956822   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube/machines

	I0428 23:58:59.956840   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03 (perms=drwx------)

	I0428 23:58:59.956859   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube/machines (perms=drwxr-xr-x)

	I0428 23:58:59.956873   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393/.minikube (perms=drwxr-xr-x)

	I0428 23:58:59.956887   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration/17977-13393 (perms=drwxrwxr-x)

	I0428 23:58:59.956902   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393/.minikube

	I0428 23:58:59.956914   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0428 23:58:59.956933   36356 main.go:141] libmachine: (ha-274394-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0428 23:58:59.956960   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/17977-13393

	I0428 23:58:59.956971   36356 main.go:141] libmachine: (ha-274394-m03) Creating domain...

	I0428 23:58:59.956990   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0428 23:58:59.957007   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home/jenkins

	I0428 23:58:59.957021   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Checking permissions on dir: /home

	I0428 23:58:59.957038   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Skipping /home - not owner

	I0428 23:58:59.957806   36356 main.go:141] libmachine: (ha-274394-m03) define libvirt domain using xml: 

	I0428 23:58:59.957828   36356 main.go:141] libmachine: (ha-274394-m03) <domain type='kvm'>

	I0428 23:58:59.957838   36356 main.go:141] libmachine: (ha-274394-m03)   <name>ha-274394-m03</name>

	I0428 23:58:59.957853   36356 main.go:141] libmachine: (ha-274394-m03)   <memory unit='MiB'>2200</memory>

	I0428 23:58:59.957866   36356 main.go:141] libmachine: (ha-274394-m03)   <vcpu>2</vcpu>

	I0428 23:58:59.957877   36356 main.go:141] libmachine: (ha-274394-m03)   <features>

	I0428 23:58:59.957887   36356 main.go:141] libmachine: (ha-274394-m03)     <acpi/>

	I0428 23:58:59.957898   36356 main.go:141] libmachine: (ha-274394-m03)     <apic/>

	I0428 23:58:59.957909   36356 main.go:141] libmachine: (ha-274394-m03)     <pae/>

	I0428 23:58:59.957920   36356 main.go:141] libmachine: (ha-274394-m03)     

	I0428 23:58:59.957929   36356 main.go:141] libmachine: (ha-274394-m03)   </features>

	I0428 23:58:59.957941   36356 main.go:141] libmachine: (ha-274394-m03)   <cpu mode='host-passthrough'>

	I0428 23:58:59.957968   36356 main.go:141] libmachine: (ha-274394-m03)   

	I0428 23:58:59.957989   36356 main.go:141] libmachine: (ha-274394-m03)   </cpu>

	I0428 23:58:59.958001   36356 main.go:141] libmachine: (ha-274394-m03)   <os>

	I0428 23:58:59.958017   36356 main.go:141] libmachine: (ha-274394-m03)     <type>hvm</type>

	I0428 23:58:59.958046   36356 main.go:141] libmachine: (ha-274394-m03)     <boot dev='cdrom'/>

	I0428 23:58:59.958059   36356 main.go:141] libmachine: (ha-274394-m03)     <boot dev='hd'/>

	I0428 23:58:59.958069   36356 main.go:141] libmachine: (ha-274394-m03)     <bootmenu enable='no'/>

	I0428 23:58:59.958080   36356 main.go:141] libmachine: (ha-274394-m03)   </os>

	I0428 23:58:59.958092   36356 main.go:141] libmachine: (ha-274394-m03)   <devices>

	I0428 23:58:59.958105   36356 main.go:141] libmachine: (ha-274394-m03)     <disk type='file' device='cdrom'>

	I0428 23:58:59.958119   36356 main.go:141] libmachine: (ha-274394-m03)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/boot2docker.iso'/>

	I0428 23:58:59.958132   36356 main.go:141] libmachine: (ha-274394-m03)       <target dev='hdc' bus='scsi'/>

	I0428 23:58:59.958144   36356 main.go:141] libmachine: (ha-274394-m03)       <readonly/>

	I0428 23:58:59.958155   36356 main.go:141] libmachine: (ha-274394-m03)     </disk>

	I0428 23:58:59.958169   36356 main.go:141] libmachine: (ha-274394-m03)     <disk type='file' device='disk'>

	I0428 23:58:59.958187   36356 main.go:141] libmachine: (ha-274394-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0428 23:58:59.958206   36356 main.go:141] libmachine: (ha-274394-m03)       <source file='/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/ha-274394-m03.rawdisk'/>

	I0428 23:58:59.958218   36356 main.go:141] libmachine: (ha-274394-m03)       <target dev='hda' bus='virtio'/>

	I0428 23:58:59.958230   36356 main.go:141] libmachine: (ha-274394-m03)     </disk>

	I0428 23:58:59.958242   36356 main.go:141] libmachine: (ha-274394-m03)     <interface type='network'>

	I0428 23:58:59.958274   36356 main.go:141] libmachine: (ha-274394-m03)       <source network='mk-ha-274394'/>

	I0428 23:58:59.958300   36356 main.go:141] libmachine: (ha-274394-m03)       <model type='virtio'/>

	I0428 23:58:59.958313   36356 main.go:141] libmachine: (ha-274394-m03)     </interface>

	I0428 23:58:59.958329   36356 main.go:141] libmachine: (ha-274394-m03)     <interface type='network'>

	I0428 23:58:59.958342   36356 main.go:141] libmachine: (ha-274394-m03)       <source network='default'/>

	I0428 23:58:59.958350   36356 main.go:141] libmachine: (ha-274394-m03)       <model type='virtio'/>

	I0428 23:58:59.958363   36356 main.go:141] libmachine: (ha-274394-m03)     </interface>

	I0428 23:58:59.958371   36356 main.go:141] libmachine: (ha-274394-m03)     <serial type='pty'>

	I0428 23:58:59.958382   36356 main.go:141] libmachine: (ha-274394-m03)       <target port='0'/>

	I0428 23:58:59.958390   36356 main.go:141] libmachine: (ha-274394-m03)     </serial>

	I0428 23:58:59.958401   36356 main.go:141] libmachine: (ha-274394-m03)     <console type='pty'>

	I0428 23:58:59.958417   36356 main.go:141] libmachine: (ha-274394-m03)       <target type='serial' port='0'/>

	I0428 23:58:59.958433   36356 main.go:141] libmachine: (ha-274394-m03)     </console>

	I0428 23:58:59.958450   36356 main.go:141] libmachine: (ha-274394-m03)     <rng model='virtio'>

	I0428 23:58:59.958464   36356 main.go:141] libmachine: (ha-274394-m03)       <backend model='random'>/dev/random</backend>

	I0428 23:58:59.958474   36356 main.go:141] libmachine: (ha-274394-m03)     </rng>

	I0428 23:58:59.958483   36356 main.go:141] libmachine: (ha-274394-m03)     

	I0428 23:58:59.958497   36356 main.go:141] libmachine: (ha-274394-m03)     

	I0428 23:58:59.958508   36356 main.go:141] libmachine: (ha-274394-m03)   </devices>

	I0428 23:58:59.958517   36356 main.go:141] libmachine: (ha-274394-m03) </domain>

	I0428 23:58:59.958532   36356 main.go:141] libmachine: (ha-274394-m03) 

	I0428 23:58:59.965013   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:ba:70:2d in network default

	I0428 23:58:59.965465   36356 main.go:141] libmachine: (ha-274394-m03) Ensuring networks are active...

	I0428 23:58:59.965490   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:58:59.966174   36356 main.go:141] libmachine: (ha-274394-m03) Ensuring network default is active

	I0428 23:58:59.966465   36356 main.go:141] libmachine: (ha-274394-m03) Ensuring network mk-ha-274394 is active

	I0428 23:58:59.966765   36356 main.go:141] libmachine: (ha-274394-m03) Getting domain xml...

	I0428 23:58:59.967422   36356 main.go:141] libmachine: (ha-274394-m03) Creating domain...

	I0428 23:59:01.202748   36356 main.go:141] libmachine: (ha-274394-m03) Waiting to get IP...

	I0428 23:59:01.203443   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:01.203897   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:01.203938   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:01.203872   37169 retry.go:31] will retry after 282.787142ms: waiting for machine to come up

	I0428 23:59:01.488289   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:01.488845   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:01.488880   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:01.488821   37169 retry.go:31] will retry after 311.074996ms: waiting for machine to come up

	I0428 23:59:01.801101   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:01.801590   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:01.801615   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:01.801538   37169 retry.go:31] will retry after 333.347197ms: waiting for machine to come up

	I0428 23:59:02.136222   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:02.136685   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:02.136722   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:02.136662   37169 retry.go:31] will retry after 515.127499ms: waiting for machine to come up

	I0428 23:59:02.652873   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:02.653262   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:02.653290   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:02.653217   37169 retry.go:31] will retry after 472.600429ms: waiting for machine to come up

	I0428 23:59:03.127829   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:03.128260   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:03.128285   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:03.128216   37169 retry.go:31] will retry after 918.328461ms: waiting for machine to come up

	I0428 23:59:04.047989   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:04.048469   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:04.048501   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:04.048401   37169 retry.go:31] will retry after 1.054046887s: waiting for machine to come up

	I0428 23:59:05.104188   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:05.104616   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:05.104654   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:05.104563   37169 retry.go:31] will retry after 1.317728284s: waiting for machine to come up

	I0428 23:59:06.424099   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:06.424567   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:06.424603   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:06.424502   37169 retry.go:31] will retry after 1.54429179s: waiting for machine to come up

	I0428 23:59:07.971097   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:07.971619   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:07.971640   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:07.971572   37169 retry.go:31] will retry after 1.943348331s: waiting for machine to come up

	I0428 23:59:09.916650   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:09.917110   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:09.917138   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:09.917059   37169 retry.go:31] will retry after 2.643143471s: waiting for machine to come up

	I0428 23:59:12.563295   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:12.563756   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:12.563783   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:12.563719   37169 retry.go:31] will retry after 3.420586328s: waiting for machine to come up

	I0428 23:59:15.986099   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:15.986542   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:15.986573   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:15.986487   37169 retry.go:31] will retry after 3.581143816s: waiting for machine to come up

	I0428 23:59:19.571466   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:19.571889   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find current IP address of domain ha-274394-m03 in network mk-ha-274394

	I0428 23:59:19.571918   36356 main.go:141] libmachine: (ha-274394-m03) DBG | I0428 23:59:19.571850   37169 retry.go:31] will retry after 5.55088001s: waiting for machine to come up

	I0428 23:59:25.124118   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:25.124562   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has current primary IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:25.124584   36356 main.go:141] libmachine: (ha-274394-m03) Found IP for machine: 192.168.39.250

	I0428 23:59:25.124598   36356 main.go:141] libmachine: (ha-274394-m03) Reserving static IP address...

	I0428 23:59:25.124921   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find host DHCP lease matching {name: "ha-274394-m03", mac: "52:54:00:0d:4c:dd", ip: "192.168.39.250"} in network mk-ha-274394

	I0428 23:59:25.197142   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Getting to WaitForSSH function...

	I0428 23:59:25.197166   36356 main.go:141] libmachine: (ha-274394-m03) Reserved static IP address: 192.168.39.250

	I0428 23:59:25.197212   36356 main.go:141] libmachine: (ha-274394-m03) Waiting for SSH to be available...

	I0428 23:59:25.199898   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:25.200254   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394

	I0428 23:59:25.200280   36356 main.go:141] libmachine: (ha-274394-m03) DBG | unable to find defined IP address of network mk-ha-274394 interface with MAC address 52:54:00:0d:4c:dd

	I0428 23:59:25.200392   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH client type: external

	I0428 23:59:25.200415   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa (-rw-------)

	I0428 23:59:25.200454   36356 main.go:141] libmachine: (ha-274394-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:59:25.200480   36356 main.go:141] libmachine: (ha-274394-m03) DBG | About to run SSH command:

	I0428 23:59:25.200505   36356 main.go:141] libmachine: (ha-274394-m03) DBG | exit 0

	I0428 23:59:25.204174   36356 main.go:141] libmachine: (ha-274394-m03) DBG | SSH cmd err, output: exit status 255: 

	I0428 23:59:25.204192   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0428 23:59:25.204202   36356 main.go:141] libmachine: (ha-274394-m03) DBG | command : exit 0

	I0428 23:59:25.204210   36356 main.go:141] libmachine: (ha-274394-m03) DBG | err     : exit status 255

	I0428 23:59:25.204221   36356 main.go:141] libmachine: (ha-274394-m03) DBG | output  : 

	I0428 23:59:28.206195   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Getting to WaitForSSH function...

	I0428 23:59:28.209965   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.210449   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.210480   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.210638   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH client type: external

	I0428 23:59:28.210667   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa (-rw-------)

	I0428 23:59:28.210707   36356 main.go:141] libmachine: (ha-274394-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.250 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0428 23:59:28.210727   36356 main.go:141] libmachine: (ha-274394-m03) DBG | About to run SSH command:

	I0428 23:59:28.210742   36356 main.go:141] libmachine: (ha-274394-m03) DBG | exit 0

	I0428 23:59:28.338185   36356 main.go:141] libmachine: (ha-274394-m03) DBG | SSH cmd err, output: <nil>: 

	I0428 23:59:28.338430   36356 main.go:141] libmachine: (ha-274394-m03) KVM machine creation complete!

	I0428 23:59:28.338791   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetConfigRaw

	I0428 23:59:28.339377   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:28.339584   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:28.339791   36356 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0428 23:59:28.339811   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetState

	I0428 23:59:28.341407   36356 main.go:141] libmachine: Detecting operating system of created instance...

	I0428 23:59:28.341426   36356 main.go:141] libmachine: Waiting for SSH to be available...

	I0428 23:59:28.341433   36356 main.go:141] libmachine: Getting to WaitForSSH function...

	I0428 23:59:28.341441   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.343848   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.344223   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.344248   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.344376   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.344530   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.344668   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.344809   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.344963   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.345166   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.345177   36356 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0428 23:59:28.457369   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:59:28.457393   36356 main.go:141] libmachine: Detecting the provisioner...

	I0428 23:59:28.457401   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.459831   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.460234   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.460254   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.460462   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.460635   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.460795   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.460929   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.461110   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.461319   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.461334   36356 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0428 23:59:28.575513   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0428 23:59:28.575577   36356 main.go:141] libmachine: found compatible host: buildroot

	I0428 23:59:28.575591   36356 main.go:141] libmachine: Provisioning with buildroot...

	I0428 23:59:28.575599   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:59:28.575836   36356 buildroot.go:166] provisioning hostname "ha-274394-m03"

	I0428 23:59:28.575863   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:59:28.576068   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.578532   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.578931   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.578960   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.579060   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.579211   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.579335   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.579444   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.579637   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.579820   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.579837   36356 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-274394-m03 && echo "ha-274394-m03" | sudo tee /etc/hostname

	I0428 23:59:28.712688   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-274394-m03

	I0428 23:59:28.712717   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.715733   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.716152   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.716191   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.716417   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:28.716624   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.716814   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:28.716966   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:28.717155   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:28.717357   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:28.717380   36356 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-274394-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-274394-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-274394-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0428 23:59:28.841508   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0428 23:59:28.841559   36356 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/17977-13393/.minikube CaCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/17977-13393/.minikube}

	I0428 23:59:28.841576   36356 buildroot.go:174] setting up certificates

	I0428 23:59:28.841586   36356 provision.go:84] configureAuth start

	I0428 23:59:28.841595   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetMachineName

	I0428 23:59:28.841879   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:28.845193   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.845548   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.845578   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.845693   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:28.847976   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.848368   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:28.848393   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:28.848514   36356 provision.go:143] copyHostCerts

	I0428 23:59:28.848537   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:59:28.848565   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem, removing ...

	I0428 23:59:28.848573   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem

	I0428 23:59:28.848635   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/cert.pem (1123 bytes)

	I0428 23:59:28.848714   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:59:28.848732   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem, removing ...

	I0428 23:59:28.848739   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem

	I0428 23:59:28.848762   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/key.pem (1675 bytes)

	I0428 23:59:28.848811   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:59:28.848827   36356 exec_runner.go:144] found /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem, removing ...

	I0428 23:59:28.848833   36356 exec_runner.go:203] rm: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem

	I0428 23:59:28.848853   36356 exec_runner.go:151] cp: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/17977-13393/.minikube/ca.pem (1082 bytes)

	I0428 23:59:28.848903   36356 provision.go:117] generating server cert: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem org=jenkins.ha-274394-m03 san=[127.0.0.1 192.168.39.250 ha-274394-m03 localhost minikube]

	I0428 23:59:29.012952   36356 provision.go:177] copyRemoteCerts

	I0428 23:59:29.013023   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0428 23:59:29.013055   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.015566   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.015904   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.015935   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.016127   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.016358   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.016550   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.016710   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:29.109376   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0428 23:59:29.109447   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0428 23:59:29.140078   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0428 23:59:29.140132   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0428 23:59:29.170421   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0428 23:59:29.170498   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0428 23:59:29.196503   36356 provision.go:87] duration metric: took 354.905712ms to configureAuth

	I0428 23:59:29.196530   36356 buildroot.go:189] setting minikube options for container-runtime

	I0428 23:59:29.196783   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:59:29.196853   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.199543   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.199885   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.199907   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.200083   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.200254   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.200404   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.200525   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.200690   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:29.200838   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:29.200853   36356 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0428 23:59:29.503246   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0428 23:59:29.503276   36356 main.go:141] libmachine: Checking connection to Docker...

	I0428 23:59:29.503287   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetURL

	I0428 23:59:29.504495   36356 main.go:141] libmachine: (ha-274394-m03) DBG | Using libvirt version 6000000

	I0428 23:59:29.506850   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.507214   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.507241   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.507419   36356 main.go:141] libmachine: Docker is up and running!

	I0428 23:59:29.507439   36356 main.go:141] libmachine: Reticulating splines...

	I0428 23:59:29.507446   36356 client.go:171] duration metric: took 29.864346558s to LocalClient.Create

	I0428 23:59:29.507469   36356 start.go:167] duration metric: took 29.864403952s to libmachine.API.Create "ha-274394"

	I0428 23:59:29.507478   36356 start.go:293] postStartSetup for "ha-274394-m03" (driver="kvm2")

	I0428 23:59:29.507488   36356 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0428 23:59:29.507509   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.507729   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0428 23:59:29.507746   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.510131   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.510522   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.510563   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.510678   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.510845   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.511001   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.511156   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:29.596901   36356 ssh_runner.go:195] Run: cat /etc/os-release

	I0428 23:59:29.601706   36356 info.go:137] Remote host: Buildroot 2023.02.9

	I0428 23:59:29.601727   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/addons for local assets ...

	I0428 23:59:29.601789   36356 filesync.go:126] Scanning /home/jenkins/minikube-integration/17977-13393/.minikube/files for local assets ...

	I0428 23:59:29.601886   36356 filesync.go:149] local asset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> 207272.pem in /etc/ssl/certs

	I0428 23:59:29.601896   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /etc/ssl/certs/207272.pem

	I0428 23:59:29.602001   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0428 23:59:29.612235   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:59:29.639858   36356 start.go:296] duration metric: took 132.371288ms for postStartSetup

	I0428 23:59:29.639898   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetConfigRaw

	I0428 23:59:29.640442   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:29.643445   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.643832   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.643857   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.644181   36356 profile.go:143] Saving config to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/config.json ...

	I0428 23:59:29.644406   36356 start.go:128] duration metric: took 30.021329967s to createHost

	I0428 23:59:29.644432   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.646565   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.646909   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.646939   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.647052   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.647200   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.647366   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.647477   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.647640   36356 main.go:141] libmachine: Using SSH client type: native

	I0428 23:59:29.647806   36356 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0428 23:59:29.647818   36356 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0428 23:59:29.767512   36356 main.go:141] libmachine: SSH cmd err, output: <nil>: 1714348769.755757207

	I0428 23:59:29.767540   36356 fix.go:216] guest clock: 1714348769.755757207

	I0428 23:59:29.767552   36356 fix.go:229] Guest: 2024-04-28 23:59:29.755757207 +0000 UTC Remote: 2024-04-28 23:59:29.644418148 +0000 UTC m=+165.090306589 (delta=111.339059ms)

	I0428 23:59:29.767569   36356 fix.go:200] guest clock delta is within tolerance: 111.339059ms

	I0428 23:59:29.767575   36356 start.go:83] releasing machines lock for "ha-274394-m03", held for 30.144638005s

	I0428 23:59:29.767599   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.767844   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:29.770233   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.770627   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.770658   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.772993   36356 out.go:177] * Found network options:

	I0428 23:59:29.774437   36356 out.go:177]   - NO_PROXY=192.168.39.237,192.168.39.43

	W0428 23:59:29.775869   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	W0428 23:59:29.775892   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:59:29.775908   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.776440   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.776628   36356 main.go:141] libmachine: (ha-274394-m03) Calling .DriverName

	I0428 23:59:29.776720   36356 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0428 23:59:29.776749   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	W0428 23:59:29.776986   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	W0428 23:59:29.777012   36356 proxy.go:119] fail to check proxy env: Error ip not in block

	I0428 23:59:29.777072   36356 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0428 23:59:29.777091   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHHostname

	I0428 23:59:29.779588   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.779789   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.780023   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.780062   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.780288   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:29.780325   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.780341   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:29.780487   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHPort

	I0428 23:59:29.780497   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.780688   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHKeyPath

	I0428 23:59:29.780693   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.780882   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetSSHUsername

	I0428 23:59:29.780886   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:29.781047   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394-m03/id_rsa Username:docker}

	I0428 23:59:30.022766   36356 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0428 23:59:30.029806   36356 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0428 23:59:30.029872   36356 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0428 23:59:30.049513   36356 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0428 23:59:30.049537   36356 start.go:494] detecting cgroup driver to use...

	I0428 23:59:30.049602   36356 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0428 23:59:30.067833   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0428 23:59:30.084419   36356 docker.go:217] disabling cri-docker service (if available) ...

	I0428 23:59:30.084490   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0428 23:59:30.101260   36356 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0428 23:59:30.118454   36356 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0428 23:59:30.245117   36356 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0428 23:59:30.402173   36356 docker.go:233] disabling docker service ...

	I0428 23:59:30.402240   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0428 23:59:30.419742   36356 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0428 23:59:30.434799   36356 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0428 23:59:30.586310   36356 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0428 23:59:30.701297   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0428 23:59:30.717873   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0428 23:59:30.740576   36356 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0428 23:59:30.740637   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.755747   36356 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0428 23:59:30.755821   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.769519   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.783158   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.800160   36356 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0428 23:59:30.812526   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.824663   36356 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.845871   36356 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0428 23:59:30.858527   36356 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0428 23:59:30.871070   36356 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0428 23:59:30.871116   36356 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0428 23:59:30.892560   36356 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0428 23:59:30.906892   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:59:31.047857   36356 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0428 23:59:31.608180   36356 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0428 23:59:31.608258   36356 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0428 23:59:31.613650   36356 start.go:562] Will wait 60s for crictl version

	I0428 23:59:31.613712   36356 ssh_runner.go:195] Run: which crictl

	I0428 23:59:31.618572   36356 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0428 23:59:31.667744   36356 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0428 23:59:31.667841   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:59:31.698887   36356 ssh_runner.go:195] Run: crio --version

	I0428 23:59:31.732978   36356 out.go:177] * Preparing Kubernetes v1.30.0 on CRI-O 1.29.1 ...

	I0428 23:59:31.734467   36356 out.go:177]   - env NO_PROXY=192.168.39.237

	I0428 23:59:31.735737   36356 out.go:177]   - env NO_PROXY=192.168.39.237,192.168.39.43

	I0428 23:59:31.736997   36356 main.go:141] libmachine: (ha-274394-m03) Calling .GetIP

	I0428 23:59:31.739814   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:31.740186   36356 main.go:141] libmachine: (ha-274394-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0d:4c:dd", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:59:15 +0000 UTC Type:0 Mac:52:54:00:0d:4c:dd Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-274394-m03 Clientid:01:52:54:00:0d:4c:dd}

	I0428 23:59:31.740216   36356 main.go:141] libmachine: (ha-274394-m03) DBG | domain ha-274394-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:0d:4c:dd in network mk-ha-274394

	I0428 23:59:31.740374   36356 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0428 23:59:31.745539   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:59:31.759169   36356 mustload.go:65] Loading cluster: ha-274394

	I0428 23:59:31.759367   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:59:31.759592   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:59:31.759625   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:59:31.774099   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36133

	I0428 23:59:31.774493   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:59:31.774982   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:59:31.775008   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:59:31.775303   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:59:31.775488   36356 main.go:141] libmachine: (ha-274394) Calling .GetState

	I0428 23:59:31.777010   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:59:31.777277   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:59:31.777308   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:59:31.791488   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37067

	I0428 23:59:31.791874   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:59:31.792798   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:59:31.792816   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:59:31.793108   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:59:31.793289   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:59:31.793448   36356 certs.go:68] Setting up /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394 for IP: 192.168.39.250

	I0428 23:59:31.793462   36356 certs.go:194] generating shared ca certs ...

	I0428 23:59:31.793482   36356 certs.go:226] acquiring lock for ca certs: {Name:mka5d31eea282c20e045cfb5e09273edc965e467 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:59:31.793619   36356 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key

	I0428 23:59:31.793657   36356 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key

	I0428 23:59:31.793665   36356 certs.go:256] generating profile certs ...

	I0428 23:59:31.793730   36356 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key

	I0428 23:59:31.793754   36356 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005

	I0428 23:59:31.793767   36356 crypto.go:68] Generating cert /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.237 192.168.39.43 192.168.39.250 192.168.39.254]

	I0428 23:59:31.935877   36356 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005 ...

	I0428 23:59:31.935910   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005: {Name:mkb1d55f40172ee8436492fe8f68a99e68fc03c3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:59:31.936096   36356 crypto.go:164] Writing key to /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005 ...

	I0428 23:59:31.936114   36356 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005: {Name:mka939da220f505a93b36da1922b3c1aa6b40303 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0428 23:59:31.936219   36356 certs.go:381] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt.293e4005 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt

	I0428 23:59:31.936357   36356 certs.go:385] copying /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key.293e4005 -> /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key

	I0428 23:59:31.936484   36356 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key

	I0428 23:59:31.936501   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0428 23:59:31.936513   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0428 23:59:31.936526   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0428 23:59:31.936537   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0428 23:59:31.936547   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0428 23:59:31.936557   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0428 23:59:31.936567   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0428 23:59:31.936577   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0428 23:59:31.936618   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem (1338 bytes)

	W0428 23:59:31.936644   36356 certs.go:480] ignoring /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727_empty.pem, impossibly tiny 0 bytes

	I0428 23:59:31.936653   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca-key.pem (1675 bytes)

	I0428 23:59:31.936674   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/ca.pem (1082 bytes)

	I0428 23:59:31.936698   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/cert.pem (1123 bytes)

	I0428 23:59:31.936718   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/key.pem (1675 bytes)

	I0428 23:59:31.936753   36356 certs.go:484] found cert: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem (1708 bytes)

	I0428 23:59:31.936778   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem -> /usr/share/ca-certificates/207272.pem

	I0428 23:59:31.936791   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:31.936803   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem -> /usr/share/ca-certificates/20727.pem

	I0428 23:59:31.936841   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:59:31.939693   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:31.940099   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:59:31.940126   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:31.940327   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:59:31.940489   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:59:31.940610   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:59:31.940730   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:59:32.014500   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0428 23:59:32.019823   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0428 23:59:32.035881   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0428 23:59:32.040779   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0428 23:59:32.057077   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0428 23:59:32.062345   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0428 23:59:32.076399   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0428 23:59:32.083489   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0428 23:59:32.100707   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0428 23:59:32.105612   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0428 23:59:32.119597   36356 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0428 23:59:32.124604   36356 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0428 23:59:32.138154   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0428 23:59:32.170086   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0428 23:59:32.198963   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0428 23:59:32.226907   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0428 23:59:32.253636   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0428 23:59:32.278554   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0428 23:59:32.304986   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0428 23:59:32.331547   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0428 23:59:32.359245   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/files/etc/ssl/certs/207272.pem --> /usr/share/ca-certificates/207272.pem (1708 bytes)

	I0428 23:59:32.388215   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0428 23:59:32.415247   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/certs/20727.pem --> /usr/share/ca-certificates/20727.pem (1338 bytes)

	I0428 23:59:32.442937   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0428 23:59:32.462088   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0428 23:59:32.485219   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0428 23:59:32.505466   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0428 23:59:32.524971   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0428 23:59:32.543452   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0428 23:59:32.561866   36356 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0428 23:59:32.580866   36356 ssh_runner.go:195] Run: openssl version

	I0428 23:59:32.587281   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/207272.pem && ln -fs /usr/share/ca-certificates/207272.pem /etc/ssl/certs/207272.pem"

	I0428 23:59:32.599497   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/207272.pem

	I0428 23:59:32.604579   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 28 23:49 /usr/share/ca-certificates/207272.pem

	I0428 23:59:32.604620   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/207272.pem

	I0428 23:59:32.610534   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/207272.pem /etc/ssl/certs/3ec20f2e.0"

	I0428 23:59:32.622113   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0428 23:59:32.633898   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:32.639105   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 28 23:08 /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:32.639152   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0428 23:59:32.645086   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0428 23:59:32.656327   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/20727.pem && ln -fs /usr/share/ca-certificates/20727.pem /etc/ssl/certs/20727.pem"

	I0428 23:59:32.667538   36356 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/20727.pem

	I0428 23:59:32.672551   36356 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 28 23:49 /usr/share/ca-certificates/20727.pem

	I0428 23:59:32.672585   36356 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/20727.pem

	I0428 23:59:32.679007   36356 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/20727.pem /etc/ssl/certs/51391683.0"

	I0428 23:59:32.691035   36356 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0428 23:59:32.695662   36356 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0428 23:59:32.695716   36356 kubeadm.go:928] updating node {m03 192.168.39.250 8443 v1.30.0 crio true true} ...

	I0428 23:59:32.695808   36356 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-274394-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.250

	[Install]

	 config:

	{KubernetesVersion:v1.30.0 ClusterName:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0428 23:59:32.695835   36356 kube-vip.go:111] generating kube-vip config ...

	I0428 23:59:32.695872   36356 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0428 23:59:32.712399   36356 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0428 23:59:32.712452   36356 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0428 23:59:32.712493   36356 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0

	I0428 23:59:32.722354   36356 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0': No such file or directory

	Initiating transfer...

	I0428 23:59:32.722390   36356 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0

	I0428 23:59:32.733638   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubectl.sha256

	I0428 23:59:32.733661   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl -> /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:59:32.733670   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubeadm.sha256

	I0428 23:59:32.733674   36356 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0/bin/linux/amd64/kubelet.sha256

	I0428 23:59:32.733720   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0428 23:59:32.733727   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl

	I0428 23:59:32.733688   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm -> /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:59:32.733893   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm

	I0428 23:59:32.743978   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubectl': No such file or directory

	I0428 23:59:32.744010   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubectl --> /var/lib/minikube/binaries/v1.30.0/kubectl (51454104 bytes)

	I0428 23:59:32.754412   36356 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet -> /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:59:32.754479   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubeadm': No such file or directory

	I0428 23:59:32.754511   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubeadm --> /var/lib/minikube/binaries/v1.30.0/kubeadm (50249880 bytes)

	I0428 23:59:32.754529   36356 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet

	I0428 23:59:32.811837   36356 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0/kubelet': No such file or directory

	I0428 23:59:32.811888   36356 ssh_runner.go:362] scp /home/jenkins/minikube-integration/17977-13393/.minikube/cache/linux/amd64/v1.30.0/kubelet --> /var/lib/minikube/binaries/v1.30.0/kubelet (100100024 bytes)

	I0428 23:59:33.742700   36356 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0428 23:59:33.754911   36356 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0428 23:59:33.775851   36356 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0428 23:59:33.794540   36356 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0428 23:59:33.812285   36356 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0428 23:59:33.816564   36356 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0428 23:59:33.831086   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:59:33.959822   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:59:33.979990   36356 host.go:66] Checking if "ha-274394" exists ...

	I0428 23:59:33.980339   36356 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0428 23:59:33.980381   36356 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0428 23:59:33.995673   36356 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39919

	I0428 23:59:33.996168   36356 main.go:141] libmachine: () Calling .GetVersion

	I0428 23:59:33.996792   36356 main.go:141] libmachine: Using API Version  1

	I0428 23:59:33.996826   36356 main.go:141] libmachine: () Calling .SetConfigRaw

	I0428 23:59:33.997145   36356 main.go:141] libmachine: () Calling .GetMachineName

	I0428 23:59:33.997356   36356 main.go:141] libmachine: (ha-274394) Calling .DriverName

	I0428 23:59:33.997488   36356 start.go:316] joinCluster: &{Name:ha-274394 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18706/minikube-v1.33.0-1713736271-18706-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713736339-18706@sha256:bccd96633fa59b612ea2e24c6961d2499fe576afbab2e6056a6801ffbd3b1a7e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0 Cluster

Name:ha-274394 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.237 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.43 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false i

nspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:fa

lse DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0428 23:59:33.997595   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0428 23:59:33.997609   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHHostname

	I0428 23:59:34.000823   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:34.001251   36356 main.go:141] libmachine: (ha-274394) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a1:02:06", ip: ""} in network mk-ha-274394: {Iface:virbr1 ExpiryTime:2024-04-29 00:57:00 +0000 UTC Type:0 Mac:52:54:00:a1:02:06 Iaid: IPaddr:192.168.39.237 Prefix:24 Hostname:ha-274394 Clientid:01:52:54:00:a1:02:06}

	I0428 23:59:34.001282   36356 main.go:141] libmachine: (ha-274394) DBG | domain ha-274394 has defined IP address 192.168.39.237 and MAC address 52:54:00:a1:02:06 in network mk-ha-274394

	I0428 23:59:34.001440   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHPort

	I0428 23:59:34.001603   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHKeyPath

	I0428 23:59:34.001747   36356 main.go:141] libmachine: (ha-274394) Calling .GetSSHUsername

	I0428 23:59:34.001869   36356 sshutil.go:53] new ssh client: &{IP:192.168.39.237 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/17977-13393/.minikube/machines/ha-274394/id_rsa Username:docker}

	I0428 23:59:34.163965   36356 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:59:34.164013   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token xjl1hv.qr8jswflfz5d4crm --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443"

	I0428 23:59:57.753188   36356 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0:$PATH" kubeadm join control-plane.minikube.internal:8443 --token xjl1hv.qr8jswflfz5d4crm --discovery-token-ca-cert-hash sha256:c90111446aabe3a401a65d4b7a9a9a2168cf750db867b339079fc02c5d132a33 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-274394-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443": (23.589146569s)

	I0428 23:59:57.753234   36356 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0428 23:59:58.433673   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-274394-m03 minikube.k8s.io/updated_at=2024_04_28T23_59_58_0700 minikube.k8s.io/version=v1.33.0 minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328 minikube.k8s.io/name=ha-274394 minikube.k8s.io/primary=false

	I0428 23:59:58.575531   36356 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-274394-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0428 23:59:58.699252   36356 start.go:318] duration metric: took 24.701760658s to joinCluster

	I0428 23:59:58.699325   36356 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0428 23:59:58.700772   36356 out.go:177] * Verifying Kubernetes components...

	I0428 23:59:58.699710   36356 config.go:182] Loaded profile config "ha-274394": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0

	I0428 23:59:58.702011   36356 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0428 23:59:58.992947   36356 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0428 23:59:59.039022   36356 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/17977-13393/kubeconfig

	I0428 23:59:59.039347   36356 kapi.go:59] client config for ha-274394: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.crt", KeyFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/profiles/ha-274394/client.key", CAFile:"/home/jenkins/minikube-integration/17977-13393/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1d02700), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0428 23:59:59.039423   36356 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.237:8443

	I0428 23:59:59.039662   36356 node_ready.go:35] waiting up to 6m0s for node "ha-274394-m03" to be "Ready" ...

	I0428 23:59:59.039739   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0428 23:59:59.039749   36356 round_trippers.go:469] Request Headers:

	I0428 23:59:59.039761   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:59:59.039769   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:59:59.044215   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0428 23:59:59.540563   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0428 23:59:59.540595   36356 round_trippers.go:469] Request Headers:

	I0428 23:59:59.540605   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0428 23:59:59.540611   36356 round_trippers.go:473]     Accept: application/json, */*

	I0428 23:59:59.545042   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:00.040363   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:00.040387   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:00.040395   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:00.040399   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:00.052445   36356 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I0429 00:00:00.540532   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:00.540560   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:00.540570   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:00.540575   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:00.544839   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:01.040082   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:01.040105   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:01.040113   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:01.040116   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:01.043721   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:01.044695   36356 node_ready.go:53] node "ha-274394-m03" has status "Ready":"False"

	I0429 00:00:01.540152   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:01.540175   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:01.540182   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:01.540185   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:01.544113   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:02.040892   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:02.040915   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:02.040926   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:02.040933   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:02.045818   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:02.539953   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:02.539976   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:02.539983   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:02.539988   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:02.544199   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:03.040237   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:03.040265   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:03.040276   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:03.040282   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:03.045325   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:03.046199   36356 node_ready.go:53] node "ha-274394-m03" has status "Ready":"False"

	I0429 00:00:03.540612   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:03.540637   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:03.540650   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:03.540654   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:03.545488   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:04.040836   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:04.040868   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:04.040887   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:04.040895   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:04.046280   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:04.540501   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:04.540527   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:04.540544   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:04.540551   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:04.544986   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:05.040393   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:05.040420   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:05.040429   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:05.040437   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:05.045045   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:05.046512   36356 node_ready.go:53] node "ha-274394-m03" has status "Ready":"False"

	I0429 00:00:05.540289   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:05.540310   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:05.540316   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:05.540320   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:05.545290   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:06.040177   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:06.040197   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:06.040203   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:06.040207   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:06.051024   36356 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0429 00:00:06.540102   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:06.540136   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:06.540144   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:06.540148   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:06.544263   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.039962   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.039982   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.039990   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.039995   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.044076   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.540106   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.540132   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.540145   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.540151   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.543779   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.544580   36356 node_ready.go:49] node "ha-274394-m03" has status "Ready":"True"

	I0429 00:00:07.544602   36356 node_ready.go:38] duration metric: took 8.504923556s for node "ha-274394-m03" to be "Ready" ...

	I0429 00:00:07.544611   36356 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 00:00:07.544667   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:07.544677   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.544684   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.544687   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.553653   36356 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0429 00:00:07.561698   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.561817   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-rslhx

	I0429 00:00:07.561827   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.561838   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.561847   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.565506   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.566518   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:07.566534   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.566540   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.566545   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.569905   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.570543   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.570562   36356 pod_ready.go:81] duration metric: took 8.831944ms for pod "coredns-7db6d8ff4d-rslhx" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.570571   36356 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.570622   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-xkdcv

	I0429 00:00:07.570630   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.570636   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.570640   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.574999   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.576125   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:07.576146   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.576157   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.576161   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.580599   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.581239   36356 pod_ready.go:92] pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.581256   36356 pod_ready.go:81] duration metric: took 10.67917ms for pod "coredns-7db6d8ff4d-xkdcv" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.581274   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.581333   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394

	I0429 00:00:07.581342   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.581394   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.581408   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.589396   36356 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 00:00:07.590368   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:07.590389   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.590396   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.590401   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.593754   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.594461   36356 pod_ready.go:92] pod "etcd-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.594479   36356 pod_ready.go:81] duration metric: took 13.196822ms for pod "etcd-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.594491   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.594550   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m02

	I0429 00:00:07.594561   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.594571   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.594579   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.598205   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.598968   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:07.598989   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.598997   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.599003   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.602493   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:07.603262   36356 pod_ready.go:92] pod "etcd-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:07.603287   36356 pod_ready.go:81] duration metric: took 8.787518ms for pod "etcd-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.603300   36356 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:07.740735   36356 request.go:629] Waited for 137.335456ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:07.740793   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:07.740799   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.740806   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.740810   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.744904   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:07.940222   36356 request.go:629] Waited for 194.103628ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.940293   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:07.940300   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:07.940311   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:07.940320   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:07.944388   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:08.140733   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:08.140759   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.140768   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.140772   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.146200   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:08.340435   36356 request.go:629] Waited for 193.229978ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.340527   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.340535   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.340548   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.340554   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.348074   36356 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 00:00:08.603651   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:08.603675   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.603684   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.603690   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.607841   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:08.740178   36356 request.go:629] Waited for 131.240032ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.740243   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:08.740251   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:08.740262   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:08.740269   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:08.744106   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:09.104560   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:09.104580   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.104587   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.104593   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.109646   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:09.141091   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:09.141121   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.141133   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.141140   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.145148   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:09.604524   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:09.606661   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.606683   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.606690   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.612435   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:09.614907   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:09.614925   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:09.614932   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:09.614936   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:09.618703   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:09.619548   36356 pod_ready.go:102] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 00:00:10.103536   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:10.103614   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.103630   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.103638   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.109798   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 00:00:10.111485   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:10.111504   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.111515   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.111522   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.115064   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:10.604281   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:10.604310   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.604320   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.604325   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.609142   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:10.610464   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:10.610484   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:10.610495   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:10.610500   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:10.616566   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 00:00:11.103607   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:11.103632   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.103642   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.103646   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.107835   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:11.108744   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:11.108761   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.108768   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.108772   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.111862   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:11.603444   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:11.603463   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.603470   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.603475   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.607641   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:11.608655   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:11.608670   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:11.608682   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:11.608686   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:11.612140   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:12.104123   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:12.104145   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.104152   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.104156   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.108430   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:12.109205   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:12.109221   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.109228   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.109234   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.113119   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:12.113849   36356 pod_ready.go:102] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 00:00:12.604327   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:12.604352   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.604363   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.604367   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.609419   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:12.610396   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:12.610415   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:12.610424   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:12.610429   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:12.613931   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:13.103988   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:13.104013   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.104020   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.104024   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.108252   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:13.109306   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:13.109326   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.109336   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.109342   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.113607   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:13.603763   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:13.603785   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.603795   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.603800   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.608023   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:13.608911   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:13.608963   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:13.608978   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:13.608983   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:13.612695   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.104203   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:14.104224   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.104233   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.104238   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.110775   36356 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0429 00:00:14.111901   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.111922   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.111932   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.111937   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.124604   36356 round_trippers.go:574] Response Status: 200 OK in 12 milliseconds

	I0429 00:00:14.125329   36356 pod_ready.go:102] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"False"

	I0429 00:00:14.603835   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/etcd-ha-274394-m03

	I0429 00:00:14.605874   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.605892   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.605898   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.610827   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:14.611910   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.611925   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.611932   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.611936   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.616291   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:14.616947   36356 pod_ready.go:92] pod "etcd-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.616966   36356 pod_ready.go:81] duration metric: took 7.0136586s for pod "etcd-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.616984   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.617056   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394

	I0429 00:00:14.617065   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.617072   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.617077   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.620266   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.620999   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:14.621015   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.621022   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.621028   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.624239   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.624743   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.624766   36356 pod_ready.go:81] duration metric: took 7.774137ms for pod "kube-apiserver-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.624778   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.624845   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394-m02

	I0429 00:00:14.624856   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.624864   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.624868   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.628427   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.629157   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:14.629170   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.629177   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.629180   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.632260   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.632852   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.632874   36356 pod_ready.go:81] duration metric: took 8.087549ms for pod "kube-apiserver-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.632887   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.632958   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-274394-m03

	I0429 00:00:14.632969   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.632979   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.632988   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.636284   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:14.740734   36356 request.go:629] Waited for 103.678901ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.740817   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:14.740831   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.740841   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.740846   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.773084   36356 round_trippers.go:574] Response Status: 200 OK in 32 milliseconds

	I0429 00:00:14.773907   36356 pod_ready.go:92] pod "kube-apiserver-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:14.773924   36356 pod_ready.go:81] duration metric: took 141.027444ms for pod "kube-apiserver-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.773933   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:14.940281   36356 request.go:629] Waited for 166.264237ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394

	I0429 00:00:14.940343   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394

	I0429 00:00:14.940349   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:14.940360   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:14.940365   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:14.944365   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:15.140345   36356 request.go:629] Waited for 195.163934ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:15.140423   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:15.140431   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.140439   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.140444   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.144062   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:15.144848   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:15.144866   36356 pod_ready.go:81] duration metric: took 370.926651ms for pod "kube-controller-manager-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.144875   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.340256   36356 request.go:629] Waited for 195.311171ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m02

	I0429 00:00:15.340322   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m02

	I0429 00:00:15.340327   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.340355   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.340361   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.347923   36356 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0429 00:00:15.540947   36356 request.go:629] Waited for 191.397388ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:15.541007   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:15.541019   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.541026   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.541034   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.545131   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:15.545894   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:15.545917   36356 pod_ready.go:81] duration metric: took 401.034522ms for pod "kube-controller-manager-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.545930   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.740918   36356 request.go:629] Waited for 194.911345ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m03

	I0429 00:00:15.741006   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-274394-m03

	I0429 00:00:15.741012   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.741021   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.741028   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.746377   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:15.940547   36356 request.go:629] Waited for 193.382908ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:15.940633   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:15.940646   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:15.940656   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:15.940661   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:15.946477   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:15.947225   36356 pod_ready.go:92] pod "kube-controller-manager-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:15.947250   36356 pod_ready.go:81] duration metric: took 401.3069ms for pod "kube-controller-manager-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:15.947264   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-4rb7k" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.140188   36356 request.go:629] Waited for 192.839853ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4rb7k

	I0429 00:00:16.140294   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-4rb7k

	I0429 00:00:16.140312   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.140324   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.140332   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.145774   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:16.340228   36356 request.go:629] Waited for 193.697798ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:16.340310   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:16.340317   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.340329   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.340339   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.344612   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:16.345393   36356 pod_ready.go:92] pod "kube-proxy-4rb7k" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:16.345411   36356 pod_ready.go:81] duration metric: took 398.139664ms for pod "kube-proxy-4rb7k" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.345423   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.540629   36356 request.go:629] Waited for 195.13398ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0429 00:00:16.540716   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-g95c9

	I0429 00:00:16.540728   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.540738   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.540747   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.545764   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:16.740862   36356 request.go:629] Waited for 194.341193ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:16.740912   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:16.740917   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.740924   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.740928   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.744945   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:16.745580   36356 pod_ready.go:92] pod "kube-proxy-g95c9" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:16.745613   36356 pod_ready.go:81] duration metric: took 400.179822ms for pod "kube-proxy-g95c9" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.745629   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:16.940209   36356 request.go:629] Waited for 194.512821ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0429 00:00:16.940295   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-proxy-pwbfs

	I0429 00:00:16.940311   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:16.940321   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:16.940332   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:16.944152   36356 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0429 00:00:17.140530   36356 request.go:629] Waited for 195.395948ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.140617   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.140631   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.140641   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.140648   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.146669   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:17.147419   36356 pod_ready.go:92] pod "kube-proxy-pwbfs" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:17.147443   36356 pod_ready.go:81] duration metric: took 401.8052ms for pod "kube-proxy-pwbfs" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.147454   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.340500   36356 request.go:629] Waited for 192.965416ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0429 00:00:17.340634   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394

	I0429 00:00:17.340647   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.340655   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.340670   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.344716   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:17.540937   36356 request.go:629] Waited for 195.33873ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.541019   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394

	I0429 00:00:17.541031   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.541042   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.541052   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.545973   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:17.546666   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:17.546694   36356 pod_ready.go:81] duration metric: took 399.233302ms for pod "kube-scheduler-ha-274394" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.546708   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.740796   36356 request.go:629] Waited for 193.996654ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0429 00:00:17.740856   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m02

	I0429 00:00:17.740862   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.740869   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.740872   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.745935   36356 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0429 00:00:17.940323   36356 request.go:629] Waited for 193.289642ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:17.940410   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m02

	I0429 00:00:17.940419   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:17.940429   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:17.940440   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:17.945223   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:17.946163   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:17.946184   36356 pod_ready.go:81] duration metric: took 399.468104ms for pod "kube-scheduler-ha-274394-m02" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:17.946193   36356 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:18.140175   36356 request.go:629] Waited for 193.91684ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m03

	I0429 00:00:18.140243   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-274394-m03

	I0429 00:00:18.140248   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.140276   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.140289   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.145196   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:18.340751   36356 request.go:629] Waited for 194.401601ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:18.340842   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes/ha-274394-m03

	I0429 00:00:18.340851   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.340862   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.340873   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.344942   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:18.345590   36356 pod_ready.go:92] pod "kube-scheduler-ha-274394-m03" in "kube-system" namespace has status "Ready":"True"

	I0429 00:00:18.345611   36356 pod_ready.go:81] duration metric: took 399.411796ms for pod "kube-scheduler-ha-274394-m03" in "kube-system" namespace to be "Ready" ...

	I0429 00:00:18.345623   36356 pod_ready.go:38] duration metric: took 10.801003405s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0429 00:00:18.345641   36356 api_server.go:52] waiting for apiserver process to appear ...

	I0429 00:00:18.345710   36356 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0429 00:00:18.374589   36356 api_server.go:72] duration metric: took 19.675227263s to wait for apiserver process to appear ...

	I0429 00:00:18.374620   36356 api_server.go:88] waiting for apiserver healthz status ...

	I0429 00:00:18.374648   36356 api_server.go:253] Checking apiserver healthz at https://192.168.39.237:8443/healthz ...

	I0429 00:00:18.379661   36356 api_server.go:279] https://192.168.39.237:8443/healthz returned 200:

	ok

	I0429 00:00:18.379729   36356 round_trippers.go:463] GET https://192.168.39.237:8443/version

	I0429 00:00:18.379740   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.379754   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.379761   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.380937   36356 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I0429 00:00:18.381043   36356 api_server.go:141] control plane version: v1.30.0

	I0429 00:00:18.381061   36356 api_server.go:131] duration metric: took 6.434791ms to wait for apiserver health ...

	I0429 00:00:18.381069   36356 system_pods.go:43] waiting for kube-system pods to appear ...

	I0429 00:00:18.540471   36356 request.go:629] Waited for 159.310973ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.540534   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.540539   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.540546   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.540552   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.553803   36356 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0429 00:00:18.561130   36356 system_pods.go:59] 24 kube-system pods found

	I0429 00:00:18.561159   36356 system_pods.go:61] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0429 00:00:18.561164   36356 system_pods.go:61] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0429 00:00:18.561167   36356 system_pods.go:61] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0429 00:00:18.561171   36356 system_pods.go:61] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0429 00:00:18.561174   36356 system_pods.go:61] "etcd-ha-274394-m03" [64d0cf43-d3cd-4054-b44a-e8b4f8a70b06] Running

	I0429 00:00:18.561176   36356 system_pods.go:61] "kindnet-29qlf" [915875ab-c1aa-46d6-b5e1-b6a7eff8dd64] Running

	I0429 00:00:18.561179   36356 system_pods.go:61] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0429 00:00:18.561182   36356 system_pods.go:61] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0429 00:00:18.561185   36356 system_pods.go:61] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0429 00:00:18.561188   36356 system_pods.go:61] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0429 00:00:18.561191   36356 system_pods.go:61] "kube-apiserver-ha-274394-m03" [a9546d9d-7c2a-45c4-a0a5-a5efea4a04d9] Running

	I0429 00:00:18.561194   36356 system_pods.go:61] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0429 00:00:18.561197   36356 system_pods.go:61] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0429 00:00:18.561200   36356 system_pods.go:61] "kube-controller-manager-ha-274394-m03" [f4094095-5c0c-4fb7-9c76-fb63e6c6eeb2] Running

	I0429 00:00:18.561203   36356 system_pods.go:61] "kube-proxy-4rb7k" [de261499-d4f2-44b0-869b-28ae3505f19f] Running

	I0429 00:00:18.561205   36356 system_pods.go:61] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0429 00:00:18.561209   36356 system_pods.go:61] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0429 00:00:18.561212   36356 system_pods.go:61] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0429 00:00:18.561214   36356 system_pods.go:61] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0429 00:00:18.561217   36356 system_pods.go:61] "kube-scheduler-ha-274394-m03" [7084f6de-4070-4d9b-b313-4b52f51123c7] Running

	I0429 00:00:18.561220   36356 system_pods.go:61] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0429 00:00:18.561222   36356 system_pods.go:61] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0429 00:00:18.561225   36356 system_pods.go:61] "kube-vip-ha-274394-m03" [bd6c2740-2068-4849-a23b-56d9ce0ac21c] Running

	I0429 00:00:18.561227   36356 system_pods.go:61] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0429 00:00:18.561232   36356 system_pods.go:74] duration metric: took 180.158592ms to wait for pod list to return data ...

	I0429 00:00:18.561240   36356 default_sa.go:34] waiting for default service account to be created ...

	I0429 00:00:18.740670   36356 request.go:629] Waited for 179.356953ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0429 00:00:18.740727   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/default/serviceaccounts

	I0429 00:00:18.740739   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.740746   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.740750   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.745356   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:18.745474   36356 default_sa.go:45] found service account: "default"

	I0429 00:00:18.745492   36356 default_sa.go:55] duration metric: took 184.245419ms for default service account to be created ...

	I0429 00:00:18.745502   36356 system_pods.go:116] waiting for k8s-apps to be running ...

	I0429 00:00:18.940811   36356 request.go:629] Waited for 195.241974ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.940863   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/namespaces/kube-system/pods

	I0429 00:00:18.940868   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:18.940874   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:18.940886   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:18.950591   36356 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0429 00:00:18.957766   36356 system_pods.go:86] 24 kube-system pods found

	I0429 00:00:18.957805   36356 system_pods.go:89] "coredns-7db6d8ff4d-rslhx" [b73501ce-7591-45a5-b59e-331f7752c71b] Running

	I0429 00:00:18.957815   36356 system_pods.go:89] "coredns-7db6d8ff4d-xkdcv" [60272694-edd8-4a8c-abd9-707cdb1355ea] Running

	I0429 00:00:18.957821   36356 system_pods.go:89] "etcd-ha-274394" [e951aad6-16ba-42de-bcb6-a90ec5388fc8] Running

	I0429 00:00:18.957830   36356 system_pods.go:89] "etcd-ha-274394-m02" [63565823-56bf-4bd7-b8da-604a1b0d4d30] Running

	I0429 00:00:18.957836   36356 system_pods.go:89] "etcd-ha-274394-m03" [64d0cf43-d3cd-4054-b44a-e8b4f8a70b06] Running

	I0429 00:00:18.957844   36356 system_pods.go:89] "kindnet-29qlf" [915875ab-c1aa-46d6-b5e1-b6a7eff8dd64] Running

	I0429 00:00:18.957851   36356 system_pods.go:89] "kindnet-6qf7q" [f00be25f-cefa-41ac-8c38-1d52f337e8b9] Running

	I0429 00:00:18.957859   36356 system_pods.go:89] "kindnet-p6qmw" [528219cb-5850-471c-97de-c31dcca693b1] Running

	I0429 00:00:18.957872   36356 system_pods.go:89] "kube-apiserver-ha-274394" [f20281d2-0f10-43b0-9a51-495d03b5a5c3] Running

	I0429 00:00:18.957880   36356 system_pods.go:89] "kube-apiserver-ha-274394-m02" [0f8b7b21-a990-447f-a3b8-6acdccf078d3] Running

	I0429 00:00:18.957897   36356 system_pods.go:89] "kube-apiserver-ha-274394-m03" [a9546d9d-7c2a-45c4-a0a5-a5efea4a04d9] Running

	I0429 00:00:18.957905   36356 system_pods.go:89] "kube-controller-manager-ha-274394" [8fb69743-3a7b-4fad-838c-a45e1667724c] Running

	I0429 00:00:18.957913   36356 system_pods.go:89] "kube-controller-manager-ha-274394-m02" [429f2ab6-9771-47b2-b827-d183897f6276] Running

	I0429 00:00:18.957924   36356 system_pods.go:89] "kube-controller-manager-ha-274394-m03" [f4094095-5c0c-4fb7-9c76-fb63e6c6eeb2] Running

	I0429 00:00:18.957932   36356 system_pods.go:89] "kube-proxy-4rb7k" [de261499-d4f2-44b0-869b-28ae3505f19f] Running

	I0429 00:00:18.957940   36356 system_pods.go:89] "kube-proxy-g95c9" [5be866d8-0014-44c7-a4cd-e93655e9c599] Running

	I0429 00:00:18.957947   36356 system_pods.go:89] "kube-proxy-pwbfs" [5303f947-6c3f-47b5-b396-33b92049d48f] Running

	I0429 00:00:18.957956   36356 system_pods.go:89] "kube-scheduler-ha-274394" [22d206f5-49cc-43d0-939e-249961518bb4] Running

	I0429 00:00:18.957968   36356 system_pods.go:89] "kube-scheduler-ha-274394-m02" [3371d359-adb1-4111-8ae1-44934bad24c3] Running

	I0429 00:00:18.957976   36356 system_pods.go:89] "kube-scheduler-ha-274394-m03" [7084f6de-4070-4d9b-b313-4b52f51123c7] Running

	I0429 00:00:18.957987   36356 system_pods.go:89] "kube-vip-ha-274394" [ce6151de-754a-4f15-94d4-71f4fb9cbd21] Running

	I0429 00:00:18.957996   36356 system_pods.go:89] "kube-vip-ha-274394-m02" [f276f128-37bf-4f93-a573-e6b491fa66cd] Running

	I0429 00:00:18.958005   36356 system_pods.go:89] "kube-vip-ha-274394-m03" [bd6c2740-2068-4849-a23b-56d9ce0ac21c] Running

	I0429 00:00:18.958014   36356 system_pods.go:89] "storage-provisioner" [b291d6ca-3a9b-4dd0-b0e9-a183347e7d26] Running

	I0429 00:00:18.958039   36356 system_pods.go:126] duration metric: took 212.530081ms to wait for k8s-apps to be running ...

	I0429 00:00:18.958053   36356 system_svc.go:44] waiting for kubelet service to be running ....

	I0429 00:00:18.958113   36356 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0429 00:00:18.980447   36356 system_svc.go:56] duration metric: took 22.384449ms WaitForService to wait for kubelet

	I0429 00:00:18.980482   36356 kubeadm.go:576] duration metric: took 20.281123012s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0429 00:00:18.980513   36356 node_conditions.go:102] verifying NodePressure condition ...

	I0429 00:00:19.140458   36356 request.go:629] Waited for 159.863326ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.237:8443/api/v1/nodes

	I0429 00:00:19.140539   36356 round_trippers.go:463] GET https://192.168.39.237:8443/api/v1/nodes

	I0429 00:00:19.140546   36356 round_trippers.go:469] Request Headers:

	I0429 00:00:19.140556   36356 round_trippers.go:473]     Accept: application/json, */*

	I0429 00:00:19.140562   36356 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0429 00:00:19.145258   36356 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0429 00:00:19.146414   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 00:00:19.146436   36356 node_conditions.go:123] node cpu capacity is 2

	I0429 00:00:19.146451   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 00:00:19.146457   36356 node_conditions.go:123] node cpu capacity is 2

	I0429 00:00:19.146462   36356 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0429 00:00:19.146466   36356 node_conditions.go:123] node cpu capacity is 2

	I0429 00:00:19.146472   36356 node_conditions.go:105] duration metric: took 165.952797ms to run NodePressure ...

	I0429 00:00:19.146487   36356 start.go:240] waiting for startup goroutines ...

	I0429 00:00:19.146521   36356 start.go:254] writing updated cluster config ...

	I0429 00:00:19.146849   36356 ssh_runner.go:195] Run: rm -f paused

	I0429 00:00:19.201608   36356 start.go:600] kubectl: 1.30.0, cluster: 1.30.0 (minor skew: 0)

	I0429 00:00:19.204410   36356 out.go:177] * Done! kubectl is now configured to use "ha-274394" cluster and "default" namespace by default

	==> CRI-O <==

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.240149097Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349087240125200,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=1a0c2752-fd94-40f7-b340-072e0419d88a name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.240865597Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=d220afe7-38fc-4661-944a-243b33b13ab1 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.241002170Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=d220afe7-38fc-4661-944a-243b33b13ab1 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.241450935Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=d220afe7-38fc-4661-944a-243b33b13ab1 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.306101163Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=8b2d816c-26a5-461f-8a4e-065023519171 name=/runtime.v1.RuntimeService/Version

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.306208691Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=8b2d816c-26a5-461f-8a4e-065023519171 name=/runtime.v1.RuntimeService/Version

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.307806503Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=1801b49e-56e3-40d8-bb65-e7e38ff1c641 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.308602216Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349087308566013,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=1801b49e-56e3-40d8-bb65-e7e38ff1c641 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.309366215Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=e4906760-7f2c-4e23-895c-2a28526c1f50 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.309426836Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=e4906760-7f2c-4e23-895c-2a28526c1f50 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.309702124Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=e4906760-7f2c-4e23-895c-2a28526c1f50 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.362893113Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=0810c950-4c86-4795-829a-fefc9021deaa name=/runtime.v1.RuntimeService/Version

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.363201282Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=0810c950-4c86-4795-829a-fefc9021deaa name=/runtime.v1.RuntimeService/Version

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.364626673Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=6629b142-4eb4-4396-9e58-68a5a7694f9f name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.365235845Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349087365209824,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=6629b142-4eb4-4396-9e58-68a5a7694f9f name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.365692402Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=7a275003-34d2-4f25-b2de-b8968ee5d196 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.365773259Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=7a275003-34d2-4f25-b2de-b8968ee5d196 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.366085478Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=7a275003-34d2-4f25-b2de-b8968ee5d196 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.410726306Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=f7dd1ec5-958d-4cf9-9b59-92f87b8e993d name=/runtime.v1.RuntimeService/Version

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.410810361Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=f7dd1ec5-958d-4cf9-9b59-92f87b8e993d name=/runtime.v1.RuntimeService/Version

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.412684665Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=2bccffa4-3376-46d1-aa3f-7ebba90d14ea name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.413232050Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1714349087413195003,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144960,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=2bccffa4-3376-46d1-aa3f-7ebba90d14ea name=/runtime.v1.ImageService/ImageFsInfo

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.414479563Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=92dfc383-b422-4dfd-b5b1-bf1811acccb6 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.414539990Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=92dfc383-b422-4dfd-b5b1-bf1811acccb6 name=/runtime.v1.RuntimeService/ListContainers

	Apr 29 00:04:47 ha-274394 crio[683]: time="2024-04-29 00:04:47.415241284Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6191db59237ab5701bd22fdbebbfb801f06631a5e7adbe153635a5d5505cede2,PodSandboxId:7dc34422a092b4ee7a5d73148d4ee7273897e70a1fd7f51920f26f1c2f010f94,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1714348823628567057,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-wwl6p,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a6a06956-e991-47ab-986f-34d9467a7dec,},Annotations:map[string]string{io.kubernetes.container.hash: e17bc7e1,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e,PodSandboxId:86b45c3768b5ce0dc71cc92ca53e5f9e28841be8bee91593f00e33ba9337c436,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661893773308,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-rslhx,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b73501ce-7591-45a5-b59e-331f7752c71b,},Annotations:map[string]string{io.kubernetes.container.hash: f16d87b2,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a,PodSandboxId:0a16b0222b33491cc9c639831cc8810dd6cdd337e8669fda79d7ae69e2d92488,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1714348661892775278,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-xkdcv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid:

60272694-edd8-4a8c-abd9-707cdb1355ea,},Annotations:map[string]string{io.kubernetes.container.hash: 6973ef85,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2c766c3729b062ad9523a21758b7f93223bf47884319719f155df69e0c878c0d,PodSandboxId:f1817cc9d2fb29d92226070e777d7f2664e9716deffbfd22958ef7ad13f68141,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNIN

G,CreatedAt:1714348661665524227,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b291d6ca-3a9b-4dd0-b0e9-a183347e7d26,},Annotations:map[string]string{io.kubernetes.container.hash: 6f5d77a8,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627,PodSandboxId:24061593c71f1368aae369b932213e75732db79a91d1d67f1141cc04179081c5,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17143486

59851649944,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-p6qmw,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 528219cb-5850-471c-97de-c31dcca693b1,},Annotations:map[string]string{io.kubernetes.container.hash: d7a973a0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a,PodSandboxId:fe59c57afd7dc0af2da87067f453be22228034ce68bbded8860c92e32aa9dc9f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b,State:CONTAINER_RUNNING,CreatedAt:1714348659690846296,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-pwbfs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5303f947-6c3f-47b5-b396-33b92049d48f,},Annotations:map[string]string{io.kubernetes.container.hash: 8078f455,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:1144436f5b67a8616a5245d67f5f5000b19f39fd4aaa77c30a19d3feaf8eb036,PodSandboxId:f4f6e257f8d6f474550047de14882591cd7346735aaf472bb6094237b186f38f,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1714348643069752665,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: abb76ef860db5fc6bc2bb141383bf5a5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6,PodSandboxId:9792afe7047dae43a78dc12b63c4a105d977d026e12916156d28c16389393f73,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1714348640048328200,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 2ada5cad8658d509e973050889a81f40,},Annotations:map[string]string{io.kubernetes.container.hash: 2b479516,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1,PodSandboxId:fb9c09a8e560907445f7713f1c19f9d784bfebb81837b831f5377dad0605a444,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced,State:CONTAINER_RUNNING,CreatedAt:1714348639992200258,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-

ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d2454bba76a07a5ac0349d2285d97e46,},Annotations:map[string]string{io.kubernetes.container.hash: de199113,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9,PodSandboxId:d6f56935776d1dcd78c5fabfd595024640090664bcf02dab3ffe43581c3d1931,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b,State:CONTAINER_RUNNING,CreatedAt:1714348639895135304,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-274394,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: d48b86fddc4d5249a88aeb3e4377a6f7,},Annotations:map[string]string{io.kubernetes.container.hash: 933c3351,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f,PodSandboxId:974770f9d2d8d35da0a33f54f885619933ec20d5542b45b5d69d7ad325a6cf21,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0,State:CONTAINER_RUNNING,CreatedAt:1714348639938867551,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-274394,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4efe96637929623fb8b0eb26a06bea4f,},Annotations:map[string]string{io.kubernetes.container.hash: a5ad7bfd,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=92dfc383-b422-4dfd-b5b1-bf1811acccb6 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	6191db59237ab       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   4 minutes ago       Running             busybox                   0                   7dc34422a092b       busybox-fc5497c4f-wwl6p

	39cef99138b5e       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      7 minutes ago       Running             coredns                   0                   86b45c3768b5c       coredns-7db6d8ff4d-rslhx

	4b75dd2cf8167       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      7 minutes ago       Running             coredns                   0                   0a16b0222b334       coredns-7db6d8ff4d-xkdcv

	2c766c3729b06       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      7 minutes ago       Running             storage-provisioner       0                   f1817cc9d2fb2       storage-provisioner

	229d446ccd2c1       4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5                                      7 minutes ago       Running             kindnet-cni               0                   24061593c71f1       kindnet-p6qmw

	10c90fba42aa7       a0bf559e280cf431fceb938087d59deeebcf29cbf3706746e07f7ac08e80ba0b                                      7 minutes ago       Running             kube-proxy                0                   fe59c57afd7dc       kube-proxy-pwbfs

	1144436f5b67a       ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a     7 minutes ago       Running             kube-vip                  0                   f4f6e257f8d6f       kube-vip-ha-274394

	a2665b4434106       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      7 minutes ago       Running             etcd                      0                   9792afe7047da       etcd-ha-274394

	cd7d63b0cf58d       259c8277fcbbc9e1cf308bc0b50582a180eb8cb8929dc8b870fa16660934bced                                      7 minutes ago       Running             kube-scheduler            0                   fb9c09a8e5609       kube-scheduler-ha-274394

	d4d50ed07ba22       c42f13656d0b2e905ee7977f67ea7a17715b24fae9daca1fcfb303cdb90728f0                                      7 minutes ago       Running             kube-apiserver            0                   974770f9d2d8d       kube-apiserver-ha-274394

	ec35813faf9fb       c7aad43836fa5bd41152db04ba4c90f8e9451c40e06488442242582e5e112b1b                                      7 minutes ago       Running             kube-controller-manager   0                   d6f56935776d1       kube-controller-manager-ha-274394

	==> coredns [39cef99138b5e744de9aa64d56030b084067eb499318ab415c5d05eb896d5a5e] <==

	[INFO] 10.244.2.2:36735 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000169991s

	[INFO] 10.244.1.2:33891 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000130376s

	[INFO] 10.244.1.2:52014 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000135334s

	[INFO] 10.244.1.2:38829 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00166462s

	[INFO] 10.244.1.2:60722 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000098874s

	[INFO] 10.244.0.4:48543 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000092957s

	[INFO] 10.244.0.4:57804 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001823584s

	[INFO] 10.244.0.4:33350 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000106647s

	[INFO] 10.244.0.4:39835 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000220436s

	[INFO] 10.244.0.4:34474 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000060725s

	[INFO] 10.244.0.4:42677 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000076278s

	[INFO] 10.244.2.2:41566 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000146322s

	[INFO] 10.244.2.2:39633 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000160447s

	[INFO] 10.244.2.2:36533 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000123881s

	[INFO] 10.244.1.2:54710 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000162932s

	[INFO] 10.244.1.2:59010 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000096219s

	[INFO] 10.244.1.2:39468 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000158565s

	[INFO] 10.244.0.4:45378 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000179168s

	[INFO] 10.244.0.4:52678 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000091044s

	[INFO] 10.244.2.2:46078 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000195018s

	[INFO] 10.244.2.2:47504 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000268349s

	[INFO] 10.244.1.2:34168 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000161101s

	[INFO] 10.244.0.4:52891 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000148878s

	[INFO] 10.244.0.4:43079 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000155917s

	[INFO] 10.244.0.4:46898 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000114218s

	==> coredns [4b75dd2cf81672ae9e90ddaf07985754f57d211ce36d7def309b116cb939e12a] <==

	[INFO] 10.244.2.2:46937 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.035529764s

	[INFO] 10.244.2.2:48074 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.014240201s

	[INFO] 10.244.1.2:36196 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 31 0.000184659s

	[INFO] 10.244.1.2:52009 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000114923s

	[INFO] 10.244.0.4:54740 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000078827s

	[INFO] 10.244.0.4:52614 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.00194917s

	[INFO] 10.244.2.2:33162 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000162402s

	[INFO] 10.244.2.2:57592 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.023066556s

	[INFO] 10.244.2.2:57043 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000235049s

	[INFO] 10.244.1.2:47075 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00014599s

	[INFO] 10.244.1.2:60870 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002072779s

	[INFO] 10.244.1.2:46861 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000094825s

	[INFO] 10.244.1.2:46908 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000186676s

	[INFO] 10.244.0.4:60188 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001709235s

	[INFO] 10.244.0.4:43834 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000109382s

	[INFO] 10.244.2.2:42186 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000296079s

	[INFO] 10.244.1.2:44715 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000184251s

	[INFO] 10.244.0.4:45543 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000116414s

	[INFO] 10.244.0.4:47556 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000083226s

	[INFO] 10.244.2.2:59579 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000198403s

	[INFO] 10.244.2.2:42196 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000278968s

	[INFO] 10.244.1.2:34121 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000222019s

	[INFO] 10.244.1.2:54334 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00016838s

	[INFO] 10.244.1.2:37434 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000099473s

	[INFO] 10.244.0.4:58711 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000413259s

	==> describe nodes <==

	Name:               ha-274394

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_04_28T23_57_27_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sun, 28 Apr 2024 23:57:23 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:04:45 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:22 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:22 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:22 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 00:00:31 +0000   Sun, 28 Apr 2024 23:57:41 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.237

	  Hostname:    ha-274394

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 bbc86a402e5548caa48d259a39be78de

	  System UUID:                bbc86a40-2e55-48ca-a48d-259a39be78de

	  Boot ID:                    b8dfffb5-63e7-4c7e-8e52-3cf4873fed01

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-wwl6p              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m27s

	  kube-system                 coredns-7db6d8ff4d-rslhx             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     7m8s

	  kube-system                 coredns-7db6d8ff4d-xkdcv             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     7m8s

	  kube-system                 etcd-ha-274394                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         7m22s

	  kube-system                 kindnet-p6qmw                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      7m9s

	  kube-system                 kube-apiserver-ha-274394             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m21s

	  kube-system                 kube-controller-manager-ha-274394    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m23s

	  kube-system                 kube-proxy-pwbfs                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m9s

	  kube-system                 kube-scheduler-ha-274394             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m21s

	  kube-system                 kube-vip-ha-274394                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m23s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m7s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 7m7s                   kube-proxy       

	  Normal  NodeHasSufficientPID     7m28s (x6 over 7m28s)  kubelet          Node ha-274394 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  7m28s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  Starting                 7m28s                  kubelet          Starting kubelet.

	  Normal  NodeHasSufficientMemory  7m28s (x7 over 7m28s)  kubelet          Node ha-274394 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m28s (x6 over 7m28s)  kubelet          Node ha-274394 status is now: NodeHasNoDiskPressure

	  Normal  Starting                 7m21s                  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  7m21s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  7m21s                  kubelet          Node ha-274394 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m21s                  kubelet          Node ha-274394 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     7m21s                  kubelet          Node ha-274394 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           7m9s                   node-controller  Node ha-274394 event: Registered Node ha-274394 in Controller

	  Normal  NodeReady                7m6s                   kubelet          Node ha-274394 status is now: NodeReady

	  Normal  RegisteredNode           5m54s                  node-controller  Node ha-274394 event: Registered Node ha-274394 in Controller

	  Normal  RegisteredNode           4m34s                  node-controller  Node ha-274394 event: Registered Node ha-274394 in Controller

	Name:               ha-274394-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_28T23_58_39_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sun, 28 Apr 2024 23:58:36 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:01:29 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Mon, 29 Apr 2024 00:00:38 +0000   Mon, 29 Apr 2024 00:02:09 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.43

	  Hostname:    ha-274394-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 b55609ff590f4bdba17fff0e954879c9

	  System UUID:                b55609ff-590f-4bdb-a17f-ff0e954879c9

	  Boot ID:                    855b13e2-38c0-4157-be3d-1ab6ccd7558c

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-tmk6v                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m27s

	  kube-system                 etcd-ha-274394-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m9s

	  kube-system                 kindnet-6qf7q                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m11s

	  kube-system                 kube-apiserver-ha-274394-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m9s

	  kube-system                 kube-controller-manager-ha-274394-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m7s

	  kube-system                 kube-proxy-g95c9                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m11s

	  kube-system                 kube-scheduler-ha-274394-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m7s

	  kube-system                 kube-vip-ha-274394-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m6s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 6m7s                   kube-proxy       

	  Normal  NodeAllocatableEnforced  6m12s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m11s (x8 over 6m12s)  kubelet          Node ha-274394-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m11s (x8 over 6m12s)  kubelet          Node ha-274394-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m11s (x7 over 6m12s)  kubelet          Node ha-274394-m02 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m9s                   node-controller  Node ha-274394-m02 event: Registered Node ha-274394-m02 in Controller

	  Normal  RegisteredNode           5m54s                  node-controller  Node ha-274394-m02 event: Registered Node ha-274394-m02 in Controller

	  Normal  RegisteredNode           4m34s                  node-controller  Node ha-274394-m02 event: Registered Node ha-274394-m02 in Controller

	  Normal  NodeNotReady             2m38s                  node-controller  Node ha-274394-m02 status is now: NodeNotReady

	Name:               ha-274394-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_28T23_59_58_0700

	                    minikube.k8s.io/version=v1.33.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Sun, 28 Apr 2024 23:59:54 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:04:40 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 00:00:25 +0000   Sun, 28 Apr 2024 23:59:54 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 00:00:25 +0000   Sun, 28 Apr 2024 23:59:54 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 00:00:25 +0000   Sun, 28 Apr 2024 23:59:54 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 00:00:25 +0000   Mon, 29 Apr 2024 00:00:07 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.250

	  Hostname:    ha-274394-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 d93714f0c10b4313b4406039da06a844

	  System UUID:                d93714f0-c10b-4313-b440-6039da06a844

	  Boot ID:                    f3fcc183-a68b-4912-a90c-8983fd2d233d

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-kjcqn                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m27s

	  kube-system                 etcd-ha-274394-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m51s

	  kube-system                 kindnet-29qlf                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m53s

	  kube-system                 kube-apiserver-ha-274394-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m51s

	  kube-system                 kube-controller-manager-ha-274394-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m51s

	  kube-system                 kube-proxy-4rb7k                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m53s

	  kube-system                 kube-scheduler-ha-274394-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m51s

	  kube-system                 kube-vip-ha-274394-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m48s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m47s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  4m53s (x8 over 4m53s)  kubelet          Node ha-274394-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m53s (x8 over 4m53s)  kubelet          Node ha-274394-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m53s (x7 over 4m53s)  kubelet          Node ha-274394-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m53s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m49s                  node-controller  Node ha-274394-m03 event: Registered Node ha-274394-m03 in Controller

	  Normal  RegisteredNode           4m49s                  node-controller  Node ha-274394-m03 event: Registered Node ha-274394-m03 in Controller

	  Normal  RegisteredNode           4m34s                  node-controller  Node ha-274394-m03 event: Registered Node ha-274394-m03 in Controller

	Name:               ha-274394-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-274394-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=5aea53309587d5dad960702a78dfdd5fb48b1328

	                    minikube.k8s.io/name=ha-274394

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_29T00_00_59_0700

	                    minikube.k8s.io/version=v1.33.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 29 Apr 2024 00:00:58 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-274394-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 29 Apr 2024 00:04:43 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:00:58 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:00:58 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:00:58 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 29 Apr 2024 00:01:29 +0000   Mon, 29 Apr 2024 00:01:10 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.106

	  Hostname:    ha-274394-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 eda4c6845a404536baab34c56e482672

	  System UUID:                eda4c684-5a40-4536-baab-34c56e482672

	  Boot ID:                    3678260a-6c98-4396-a49b-11d148407cb5

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0

	  Kube-Proxy Version:         v1.30.0

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-r7wp2       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m49s

	  kube-system                 kube-proxy-4h24n    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m49s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m43s                  kube-proxy       

	  Normal  RegisteredNode           3m49s                  node-controller  Node ha-274394-m04 event: Registered Node ha-274394-m04 in Controller

	  Normal  NodeHasSufficientMemory  3m49s (x2 over 3m49s)  kubelet          Node ha-274394-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m49s (x2 over 3m49s)  kubelet          Node ha-274394-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m49s (x2 over 3m49s)  kubelet          Node ha-274394-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m49s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m44s                  node-controller  Node ha-274394-m04 event: Registered Node ha-274394-m04 in Controller

	  Normal  RegisteredNode           3m44s                  node-controller  Node ha-274394-m04 event: Registered Node ha-274394-m04 in Controller

	  Normal  NodeReady                3m37s                  kubelet          Node ha-274394-m04 status is now: NodeReady

	==> dmesg <==

	[Apr28 23:56] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000000] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.052234] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.044810] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.652996] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +3.522934] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[Apr28 23:57] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000008] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +6.108939] systemd-fstab-generator[600]: Ignoring "noauto" option for root device

	[  +0.062174] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.072067] systemd-fstab-generator[612]: Ignoring "noauto" option for root device

	[  +0.188727] systemd-fstab-generator[626]: Ignoring "noauto" option for root device

	[  +0.118445] systemd-fstab-generator[638]: Ignoring "noauto" option for root device

	[  +0.277590] systemd-fstab-generator[668]: Ignoring "noauto" option for root device

	[  +5.051195] systemd-fstab-generator[769]: Ignoring "noauto" option for root device

	[  +0.066175] kauditd_printk_skb: 130 callbacks suppressed

	[  +4.782579] systemd-fstab-generator[952]: Ignoring "noauto" option for root device

	[  +0.939635] kauditd_printk_skb: 46 callbacks suppressed

	[  +6.597447] systemd-fstab-generator[1372]: Ignoring "noauto" option for root device

	[  +0.110049] kauditd_printk_skb: 51 callbacks suppressed

	[ +13.496389] kauditd_printk_skb: 21 callbacks suppressed

	[Apr28 23:58] kauditd_printk_skb: 74 callbacks suppressed

	==> etcd [a2665b4434106a2d34b98c1b4039e0e7f884ea1c8cf13bd5616857e99a0237a6] <==

	{"level":"warn","ts":"2024-04-29T00:04:47.32717Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.427162Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.469473Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.528022Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.627821Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.721212Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.727977Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.733725Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.738272Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.750154Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.75826Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.766765Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.770592Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.775095Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.787294Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.79624Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.806187Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.811679Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.844778Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.849097Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.854347Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.865822Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.873588Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.880638Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-29T00:04:47.927711Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"3f0f97df8a50e0be","from":"3f0f97df8a50e0be","remote-peer-id":"18aaab02e1f36e7","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 00:04:47 up 7 min,  0 users,  load average: 0.06, 0.19, 0.10

	Linux ha-274394 5.10.207 #1 SMP Mon Apr 22 03:02:02 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [229d446ccd2c11d44847ea2f5bb4f2085af2a5709495d0b888fc1d58d8389627] <==

	I0429 00:04:11.424066       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	I0429 00:04:21.442567       1 main.go:223] Handling node with IPs: map[192.168.39.237:{}]

	I0429 00:04:21.442703       1 main.go:227] handling current node

	I0429 00:04:21.442738       1 main.go:223] Handling node with IPs: map[192.168.39.43:{}]

	I0429 00:04:21.442767       1 main.go:250] Node ha-274394-m02 has CIDR [10.244.1.0/24] 

	I0429 00:04:21.443095       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0429 00:04:21.443151       1 main.go:250] Node ha-274394-m03 has CIDR [10.244.2.0/24] 

	I0429 00:04:21.443243       1 main.go:223] Handling node with IPs: map[192.168.39.106:{}]

	I0429 00:04:21.443263       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	I0429 00:04:31.450036       1 main.go:223] Handling node with IPs: map[192.168.39.237:{}]

	I0429 00:04:31.450188       1 main.go:227] handling current node

	I0429 00:04:31.450224       1 main.go:223] Handling node with IPs: map[192.168.39.43:{}]

	I0429 00:04:31.450245       1 main.go:250] Node ha-274394-m02 has CIDR [10.244.1.0/24] 

	I0429 00:04:31.450362       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0429 00:04:31.450383       1 main.go:250] Node ha-274394-m03 has CIDR [10.244.2.0/24] 

	I0429 00:04:31.450445       1 main.go:223] Handling node with IPs: map[192.168.39.106:{}]

	I0429 00:04:31.450463       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	I0429 00:04:41.463500       1 main.go:223] Handling node with IPs: map[192.168.39.237:{}]

	I0429 00:04:41.463651       1 main.go:227] handling current node

	I0429 00:04:41.463685       1 main.go:223] Handling node with IPs: map[192.168.39.43:{}]

	I0429 00:04:41.463713       1 main.go:250] Node ha-274394-m02 has CIDR [10.244.1.0/24] 

	I0429 00:04:41.463832       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0429 00:04:41.463852       1 main.go:250] Node ha-274394-m03 has CIDR [10.244.2.0/24] 

	I0429 00:04:41.464088       1 main.go:223] Handling node with IPs: map[192.168.39.106:{}]

	I0429 00:04:41.464145       1 main.go:250] Node ha-274394-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [d4d50ed07ba2205bdc6b968a0f66deb63c9708a060e4079e707d79f62b78716f] <==

	E0428 23:58:36.868759       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0428 23:58:36.868653       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 13.607µs, panicked: false, err: context canceled, panic-reason: <nil>

	E0428 23:58:36.870554       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0428 23:58:36.870719       1 timeout.go:142] post-timeout activity - time-elapsed: 2.339766ms, POST "/api/v1/namespaces/kube-system/events" result: <nil>

	E0429 00:00:25.137040       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40050: use of closed network connection

	E0429 00:00:25.379481       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40060: use of closed network connection

	E0429 00:00:25.604805       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40076: use of closed network connection

	E0429 00:00:25.871777       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40096: use of closed network connection

	E0429 00:00:26.091618       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40108: use of closed network connection

	E0429 00:00:26.341033       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40122: use of closed network connection

	E0429 00:00:26.594661       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40132: use of closed network connection

	E0429 00:00:26.812137       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40148: use of closed network connection

	E0429 00:00:27.039810       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40166: use of closed network connection

	E0429 00:00:27.395521       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:40194: use of closed network connection

	E0429 00:00:27.600587       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33016: use of closed network connection

	E0429 00:00:27.822892       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33036: use of closed network connection

	E0429 00:00:28.227332       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33060: use of closed network connection

	E0429 00:00:28.448673       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:33082: use of closed network connection

	I0429 00:01:04.494213       1 trace.go:236] Trace[1312671356]: "Get" accept:application/json, */*,audit-id:59ccec51-1525-472a-acd9-d032d2c2bfbf,client:127.0.0.1,api-group:coordination.k8s.io,api-version:v1,name:plndr-cp-lock,subresource:,namespace:kube-system,protocol:HTTP/2.0,resource:leases,scope:resource,url:/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/plndr-cp-lock,user-agent:kube-vip/v0.0.0 (linux/amd64) kubernetes/$Format,verb:GET (29-Apr-2024 00:01:03.965) (total time: 528ms):

	Trace[1312671356]: ---"About to write a response" 528ms (00:01:04.494)

	Trace[1312671356]: [528.544822ms] [528.544822ms] END

	I0429 00:01:04.494822       1 trace.go:236] Trace[213141482]: "Update" accept:application/json, */*,audit-id:7b71b3b8-6c51-4af0-b485-7eb34cb112ec,client:192.168.39.237,api-group:,api-version:v1,name:k8s.io-minikube-hostpath,subresource:,namespace:kube-system,protocol:HTTP/2.0,resource:endpoints,scope:resource,url:/api/v1/namespaces/kube-system/endpoints/k8s.io-minikube-hostpath,user-agent:storage-provisioner/v0.0.0 (linux/amd64) kubernetes/$Format,verb:PUT (29-Apr-2024 00:01:03.939) (total time: 555ms):

	Trace[213141482]: ["GuaranteedUpdate etcd3" audit-id:7b71b3b8-6c51-4af0-b485-7eb34cb112ec,key:/services/endpoints/kube-system/k8s.io-minikube-hostpath,type:*core.Endpoints,resource:endpoints 555ms (00:01:03.939)

	Trace[213141482]:  ---"Txn call completed" 554ms (00:01:04.494)]

	Trace[213141482]: [555.360928ms] [555.360928ms] END

	==> kube-controller-manager [ec35813faf9fb16633b3058ea24f1d8ceeb9683c260758aa3e3ba9895ff7c6e9] <==

	I0428 23:58:38.037991       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-274394-m02"

	E0428 23:59:54.803847       1 certificate_controller.go:146] Sync csr-wdx26 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-wdx26": the object has been modified; please apply your changes to the latest version and try again

	I0428 23:59:54.892346       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-274394-m03\" does not exist"

	I0428 23:59:54.940848       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-274394-m03" podCIDRs=["10.244.2.0/24"]

	I0428 23:59:58.081684       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-274394-m03"

	I0429 00:00:20.257387       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="141.850346ms"

	I0429 00:00:20.462634       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="204.923458ms"

	I0429 00:00:20.642183       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="179.010358ms"

	E0429 00:00:20.642327       1 replica_set.go:557] sync "default/busybox-fc5497c4f" failed with Operation cannot be fulfilled on replicasets.apps "busybox-fc5497c4f": the object has been modified; please apply your changes to the latest version and try again

	I0429 00:00:20.663485       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="21.009121ms"

	I0429 00:00:20.664416       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="60.99µs"

	I0429 00:00:24.116794       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="47.639622ms"

	I0429 00:00:24.116983       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="121.564µs"

	I0429 00:00:24.173133       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="48.902432ms"

	I0429 00:00:24.173525       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="101.207µs"

	I0429 00:00:24.532136       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="19.587076ms"

	I0429 00:00:24.534021       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="133.27µs"

	E0429 00:00:58.696735       1 certificate_controller.go:146] Sync csr-9ztb7 failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-9ztb7": the object has been modified; please apply your changes to the latest version and try again

	I0429 00:00:58.906478       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-274394-m04\" does not exist"

	I0429 00:00:59.000800       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-274394-m04" podCIDRs=["10.244.3.0/24"]

	I0429 00:01:03.130368       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-274394-m04"

	I0429 00:01:10.233626       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-274394-m04"

	I0429 00:02:09.531221       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-274394-m04"

	I0429 00:02:09.671054       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="15.148922ms"

	I0429 00:02:09.671354       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="69.538µs"

	==> kube-proxy [10c90fba42aa799b9c352fe0fc65dba46f9338c9cf37408b442e6ed460a38f2a] <==

	I0428 23:57:40.051962       1 server_linux.go:69] "Using iptables proxy"

	I0428 23:57:40.064077       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.237"]

	I0428 23:57:40.189337       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0428 23:57:40.189412       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0428 23:57:40.189431       1 server_linux.go:165] "Using iptables Proxier"

	I0428 23:57:40.192878       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0428 23:57:40.193163       1 server.go:872] "Version info" version="v1.30.0"

	I0428 23:57:40.193199       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0428 23:57:40.194579       1 config.go:192] "Starting service config controller"

	I0428 23:57:40.194626       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0428 23:57:40.194648       1 config.go:101] "Starting endpoint slice config controller"

	I0428 23:57:40.194651       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0428 23:57:40.195219       1 config.go:319] "Starting node config controller"

	I0428 23:57:40.195253       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0428 23:57:40.301194       1 shared_informer.go:320] Caches are synced for node config

	I0428 23:57:40.301247       1 shared_informer.go:320] Caches are synced for service config

	I0428 23:57:40.301268       1 shared_informer.go:320] Caches are synced for endpoint slice config

	==> kube-scheduler [cd7d63b0cf58d14e6790389b3cd5cf1a8008f4a196309ede930b89edcd473ca1] <==

	W0428 23:57:23.781454       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0428 23:57:23.781572       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	W0428 23:57:23.911255       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0428 23:57:23.911314       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0428 23:57:23.977138       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0428 23:57:23.977200       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0428 23:57:24.127191       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0428 23:57:24.127258       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0428 23:57:24.129643       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0428 23:57:24.129701       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0428 23:57:24.145975       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0428 23:57:24.146030       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0428 23:57:24.181216       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0428 23:57:24.181243       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0428 23:57:24.192501       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0428 23:57:24.192554       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0428 23:57:26.404129       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0429 00:00:20.266398       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-wwl6p\": pod busybox-fc5497c4f-wwl6p is already assigned to node \"ha-274394\"" plugin="DefaultBinder" pod="default/busybox-fc5497c4f-wwl6p" node="ha-274394"

	E0429 00:00:20.266508       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-kjcqn\": pod busybox-fc5497c4f-kjcqn is already assigned to node \"ha-274394-m03\"" plugin="DefaultBinder" pod="default/busybox-fc5497c4f-kjcqn" node="ha-274394-m03"

	E0429 00:00:20.271638       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod a6a06956-e991-47ab-986f-34d9467a7dec(default/busybox-fc5497c4f-wwl6p) wasn't assumed so cannot be forgotten" pod="default/busybox-fc5497c4f-wwl6p"

	E0429 00:00:20.272546       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-wwl6p\": pod busybox-fc5497c4f-wwl6p is already assigned to node \"ha-274394\"" pod="default/busybox-fc5497c4f-wwl6p"

	I0429 00:00:20.273228       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-fc5497c4f-wwl6p" node="ha-274394"

	E0429 00:00:20.271544       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 76314c87-6b7d-4bfa-83ce-3ace75fa7aee(default/busybox-fc5497c4f-kjcqn) wasn't assumed so cannot be forgotten" pod="default/busybox-fc5497c4f-kjcqn"

	E0429 00:00:20.273888       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"busybox-fc5497c4f-kjcqn\": pod busybox-fc5497c4f-kjcqn is already assigned to node \"ha-274394-m03\"" pod="default/busybox-fc5497c4f-kjcqn"

	I0429 00:00:20.274053       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="default/busybox-fc5497c4f-kjcqn" node="ha-274394-m03"

	==> kubelet <==

	Apr 29 00:00:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:00:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:00:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:00:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:00:28 ha-274394 kubelet[1379]: E0429 00:00:28.227727    1379 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:52374->127.0.0.1:41399: write tcp 127.0.0.1:52374->127.0.0.1:41399: write: broken pipe

	Apr 29 00:01:26 ha-274394 kubelet[1379]: E0429 00:01:26.204575    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:01:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:01:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:01:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:01:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:02:26 ha-274394 kubelet[1379]: E0429 00:02:26.204755    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:02:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:02:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:02:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:02:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:03:26 ha-274394 kubelet[1379]: E0429 00:03:26.207355    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:03:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:03:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:03:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:03:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 29 00:04:26 ha-274394 kubelet[1379]: E0429 00:04:26.211104    1379 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 29 00:04:26 ha-274394 kubelet[1379]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 29 00:04:26 ha-274394 kubelet[1379]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 29 00:04:26 ha-274394 kubelet[1379]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 29 00:04:26 ha-274394 kubelet[1379]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-274394 -n ha-274394

helpers_test.go:261: (dbg) Run:  kubectl --context ha-274394 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (52.07s)