=== RUN   TestAddons/Setup

addons_test.go:110: (dbg) Run:  out/minikube-linux-amd64 start -p addons-299362 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:110: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-299362 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: signal: killed (39m59.959500559s)

-- stdout --

	* [addons-299362] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=19112

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19112-8111/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19112-8111/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-299362" primary control-plane node in "addons-299362" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.17

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.15.0

	  - Using image docker.io/marcnuri/yakd:0.0.4

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	  - Using image docker.io/busybox:stable

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	  - Using image docker.io/registry:2.8.3

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.10.1

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.29.0

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image ghcr.io/helm/tiller:v2.17.0

	* Verifying registry addon...

	* Verifying ingress addon...

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-299362 service yakd-dashboard -n yakd-dashboard

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	* Verifying csi-hostpath-driver addon...

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-299362 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: cloud-spanner, nvidia-device-plugin, ingress-dns, storage-provisioner-rancher, storage-provisioner, helm-tiller, inspektor-gadget, metrics-server, yakd, default-storageclass, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

-- /stdout --

** stderr ** 

	I0621 17:41:42.697886   15966 out.go:291] Setting OutFile to fd 1 ...

	I0621 17:41:42.698133   15966 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 17:41:42.698142   15966 out.go:304] Setting ErrFile to fd 2...

	I0621 17:41:42.698148   15966 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 17:41:42.698337   15966 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19112-8111/.minikube/bin

	I0621 17:41:42.698939   15966 out.go:298] Setting JSON to false

	I0621 17:41:42.699713   15966 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":1401,"bootTime":1718990302,"procs":171,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0621 17:41:42.699771   15966 start.go:139] virtualization: kvm guest

	I0621 17:41:42.701917   15966 out.go:177] * [addons-299362] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0621 17:41:42.703374   15966 notify.go:220] Checking for updates...

	I0621 17:41:42.703404   15966 out.go:177]   - MINIKUBE_LOCATION=19112

	I0621 17:41:42.704766   15966 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0621 17:41:42.706466   15966 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 17:41:42.707871   15966 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 17:41:42.709170   15966 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0621 17:41:42.710471   15966 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0621 17:41:42.711846   15966 driver.go:392] Setting default libvirt URI to qemu:///system

	I0621 17:41:42.743225   15966 out.go:177] * Using the kvm2 driver based on user configuration

	I0621 17:41:42.744547   15966 start.go:297] selected driver: kvm2

	I0621 17:41:42.744566   15966 start.go:901] validating driver "kvm2" against <nil>

	I0621 17:41:42.744578   15966 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0621 17:41:42.745243   15966 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 17:41:42.745325   15966 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19112-8111/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0621 17:41:42.759803   15966 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0621 17:41:42.759856   15966 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0621 17:41:42.760085   15966 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0621 17:41:42.760159   15966 cni.go:84] Creating CNI manager for ""

	I0621 17:41:42.760175   15966 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0621 17:41:42.760188   15966 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0621 17:41:42.760242   15966 start.go:340] cluster config:

	{Name:addons-299362 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:addons-299362 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:c

rio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAg

entPID:0 GPUs: AutoPauseInterval:1m0s}

	I0621 17:41:42.760357   15966 iso.go:125] acquiring lock: {Name:mk9bcacef563c74661da696f2e2fb4463daf80f2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 17:41:42.762351   15966 out.go:177] * Starting "addons-299362" primary control-plane node in "addons-299362" cluster

	I0621 17:41:42.763759   15966 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 17:41:42.763796   15966 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4

	I0621 17:41:42.763809   15966 cache.go:56] Caching tarball of preloaded images

	I0621 17:41:42.763882   15966 preload.go:173] Found /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0621 17:41:42.763894   15966 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio

	I0621 17:41:42.764196   15966 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/config.json ...

	I0621 17:41:42.764230   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/config.json: {Name:mk3104766e101924b56e7fa74aaf0b48c56c4c42 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:41:42.764389   15966 start.go:360] acquireMachinesLock for addons-299362: {Name:mkdb5ead19d46168ac3b04a7a163113221efea18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0621 17:41:42.764449   15966 start.go:364] duration metric: took 44.186µs to acquireMachinesLock for "addons-299362"

	I0621 17:41:42.764472   15966 start.go:93] Provisioning new machine with config: &{Name:addons-299362 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.30.2 ClusterName:addons-299362 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 17:41:42.764538   15966 start.go:125] createHost starting for "" (driver="kvm2")

	I0621 17:41:42.766394   15966 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0621 17:41:42.766531   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:41:42.766583   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:41:42.780798   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41689

	I0621 17:41:42.781254   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:41:42.781769   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:41:42.781792   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:41:42.782161   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:41:42.782313   15966 main.go:141] libmachine: (addons-299362) Calling .GetMachineName

	I0621 17:41:42.782443   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:41:42.782578   15966 start.go:159] libmachine.API.Create for "addons-299362" (driver="kvm2")

	I0621 17:41:42.782610   15966 client.go:168] LocalClient.Create starting

	I0621 17:41:42.782653   15966 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem

	I0621 17:41:42.876803   15966 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem

	I0621 17:41:43.080193   15966 main.go:141] libmachine: Running pre-create checks...

	I0621 17:41:43.080218   15966 main.go:141] libmachine: (addons-299362) Calling .PreCreateCheck

	I0621 17:41:43.080689   15966 main.go:141] libmachine: (addons-299362) Calling .GetConfigRaw

	I0621 17:41:43.081132   15966 main.go:141] libmachine: Creating machine...

	I0621 17:41:43.081147   15966 main.go:141] libmachine: (addons-299362) Calling .Create

	I0621 17:41:43.081326   15966 main.go:141] libmachine: (addons-299362) Creating KVM machine...

	I0621 17:41:43.082581   15966 main.go:141] libmachine: (addons-299362) DBG | found existing default KVM network

	I0621 17:41:43.083286   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:43.083149   15988 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1f0}

	I0621 17:41:43.083392   15966 main.go:141] libmachine: (addons-299362) DBG | created network xml: 

	I0621 17:41:43.083424   15966 main.go:141] libmachine: (addons-299362) DBG | <network>

	I0621 17:41:43.083432   15966 main.go:141] libmachine: (addons-299362) DBG |   <name>mk-addons-299362</name>

	I0621 17:41:43.083437   15966 main.go:141] libmachine: (addons-299362) DBG |   <dns enable='no'/>

	I0621 17:41:43.083444   15966 main.go:141] libmachine: (addons-299362) DBG |   

	I0621 17:41:43.083450   15966 main.go:141] libmachine: (addons-299362) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0621 17:41:43.083457   15966 main.go:141] libmachine: (addons-299362) DBG |     <dhcp>

	I0621 17:41:43.083465   15966 main.go:141] libmachine: (addons-299362) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0621 17:41:43.083472   15966 main.go:141] libmachine: (addons-299362) DBG |     </dhcp>

	I0621 17:41:43.083479   15966 main.go:141] libmachine: (addons-299362) DBG |   </ip>

	I0621 17:41:43.083484   15966 main.go:141] libmachine: (addons-299362) DBG |   

	I0621 17:41:43.083489   15966 main.go:141] libmachine: (addons-299362) DBG | </network>

	I0621 17:41:43.083496   15966 main.go:141] libmachine: (addons-299362) DBG | 

	I0621 17:41:43.088859   15966 main.go:141] libmachine: (addons-299362) DBG | trying to create private KVM network mk-addons-299362 192.168.39.0/24...

	I0621 17:41:43.151649   15966 main.go:141] libmachine: (addons-299362) DBG | private KVM network mk-addons-299362 192.168.39.0/24 created

	I0621 17:41:43.151671   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:43.151639   15988 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 17:41:43.151683   15966 main.go:141] libmachine: (addons-299362) Setting up store path in /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362 ...

	I0621 17:41:43.151723   15966 main.go:141] libmachine: (addons-299362) Building disk image from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso

	I0621 17:41:43.151810   15966 main.go:141] libmachine: (addons-299362) Downloading /home/jenkins/minikube-integration/19112-8111/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso...

	I0621 17:41:43.398821   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:43.398697   15988 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa...

	I0621 17:41:43.492201   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:43.492070   15988 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/addons-299362.rawdisk...

	I0621 17:41:43.492231   15966 main.go:141] libmachine: (addons-299362) DBG | Writing magic tar header

	I0621 17:41:43.492242   15966 main.go:141] libmachine: (addons-299362) DBG | Writing SSH key tar header

	I0621 17:41:43.492250   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:43.492214   15988 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362 ...

	I0621 17:41:43.492356   15966 main.go:141] libmachine: (addons-299362) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362

	I0621 17:41:43.492383   15966 main.go:141] libmachine: (addons-299362) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362 (perms=drwx------)

	I0621 17:41:43.492396   15966 main.go:141] libmachine: (addons-299362) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines

	I0621 17:41:43.492408   15966 main.go:141] libmachine: (addons-299362) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines (perms=drwxr-xr-x)

	I0621 17:41:43.492425   15966 main.go:141] libmachine: (addons-299362) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube (perms=drwxr-xr-x)

	I0621 17:41:43.492434   15966 main.go:141] libmachine: (addons-299362) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111 (perms=drwxrwxr-x)

	I0621 17:41:43.492444   15966 main.go:141] libmachine: (addons-299362) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0621 17:41:43.492451   15966 main.go:141] libmachine: (addons-299362) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0621 17:41:43.492457   15966 main.go:141] libmachine: (addons-299362) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 17:41:43.492466   15966 main.go:141] libmachine: (addons-299362) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111

	I0621 17:41:43.492472   15966 main.go:141] libmachine: (addons-299362) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0621 17:41:43.492480   15966 main.go:141] libmachine: (addons-299362) DBG | Checking permissions on dir: /home/jenkins

	I0621 17:41:43.492486   15966 main.go:141] libmachine: (addons-299362) DBG | Checking permissions on dir: /home

	I0621 17:41:43.492492   15966 main.go:141] libmachine: (addons-299362) Creating domain...

	I0621 17:41:43.492497   15966 main.go:141] libmachine: (addons-299362) DBG | Skipping /home - not owner

	I0621 17:41:43.493456   15966 main.go:141] libmachine: (addons-299362) define libvirt domain using xml: 

	I0621 17:41:43.493481   15966 main.go:141] libmachine: (addons-299362) <domain type='kvm'>

	I0621 17:41:43.493492   15966 main.go:141] libmachine: (addons-299362)   <name>addons-299362</name>

	I0621 17:41:43.493503   15966 main.go:141] libmachine: (addons-299362)   <memory unit='MiB'>4000</memory>

	I0621 17:41:43.493593   15966 main.go:141] libmachine: (addons-299362)   <vcpu>2</vcpu>

	I0621 17:41:43.493627   15966 main.go:141] libmachine: (addons-299362)   <features>

	I0621 17:41:43.493639   15966 main.go:141] libmachine: (addons-299362)     <acpi/>

	I0621 17:41:43.493648   15966 main.go:141] libmachine: (addons-299362)     <apic/>

	I0621 17:41:43.493656   15966 main.go:141] libmachine: (addons-299362)     <pae/>

	I0621 17:41:43.493662   15966 main.go:141] libmachine: (addons-299362)     

	I0621 17:41:43.493670   15966 main.go:141] libmachine: (addons-299362)   </features>

	I0621 17:41:43.493678   15966 main.go:141] libmachine: (addons-299362)   <cpu mode='host-passthrough'>

	I0621 17:41:43.493684   15966 main.go:141] libmachine: (addons-299362)   

	I0621 17:41:43.493692   15966 main.go:141] libmachine: (addons-299362)   </cpu>

	I0621 17:41:43.493701   15966 main.go:141] libmachine: (addons-299362)   <os>

	I0621 17:41:43.493710   15966 main.go:141] libmachine: (addons-299362)     <type>hvm</type>

	I0621 17:41:43.493725   15966 main.go:141] libmachine: (addons-299362)     <boot dev='cdrom'/>

	I0621 17:41:43.493742   15966 main.go:141] libmachine: (addons-299362)     <boot dev='hd'/>

	I0621 17:41:43.493752   15966 main.go:141] libmachine: (addons-299362)     <bootmenu enable='no'/>

	I0621 17:41:43.493762   15966 main.go:141] libmachine: (addons-299362)   </os>

	I0621 17:41:43.493771   15966 main.go:141] libmachine: (addons-299362)   <devices>

	I0621 17:41:43.493776   15966 main.go:141] libmachine: (addons-299362)     <disk type='file' device='cdrom'>

	I0621 17:41:43.493785   15966 main.go:141] libmachine: (addons-299362)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/boot2docker.iso'/>

	I0621 17:41:43.493793   15966 main.go:141] libmachine: (addons-299362)       <target dev='hdc' bus='scsi'/>

	I0621 17:41:43.493824   15966 main.go:141] libmachine: (addons-299362)       <readonly/>

	I0621 17:41:43.493835   15966 main.go:141] libmachine: (addons-299362)     </disk>

	I0621 17:41:43.493853   15966 main.go:141] libmachine: (addons-299362)     <disk type='file' device='disk'>

	I0621 17:41:43.493871   15966 main.go:141] libmachine: (addons-299362)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0621 17:41:43.493890   15966 main.go:141] libmachine: (addons-299362)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/addons-299362.rawdisk'/>

	I0621 17:41:43.493904   15966 main.go:141] libmachine: (addons-299362)       <target dev='hda' bus='virtio'/>

	I0621 17:41:43.493912   15966 main.go:141] libmachine: (addons-299362)     </disk>

	I0621 17:41:43.493920   15966 main.go:141] libmachine: (addons-299362)     <interface type='network'>

	I0621 17:41:43.493926   15966 main.go:141] libmachine: (addons-299362)       <source network='mk-addons-299362'/>

	I0621 17:41:43.493933   15966 main.go:141] libmachine: (addons-299362)       <model type='virtio'/>

	I0621 17:41:43.493938   15966 main.go:141] libmachine: (addons-299362)     </interface>

	I0621 17:41:43.493947   15966 main.go:141] libmachine: (addons-299362)     <interface type='network'>

	I0621 17:41:43.493970   15966 main.go:141] libmachine: (addons-299362)       <source network='default'/>

	I0621 17:41:43.493988   15966 main.go:141] libmachine: (addons-299362)       <model type='virtio'/>

	I0621 17:41:43.493999   15966 main.go:141] libmachine: (addons-299362)     </interface>

	I0621 17:41:43.494014   15966 main.go:141] libmachine: (addons-299362)     <serial type='pty'>

	I0621 17:41:43.494026   15966 main.go:141] libmachine: (addons-299362)       <target port='0'/>

	I0621 17:41:43.494038   15966 main.go:141] libmachine: (addons-299362)     </serial>

	I0621 17:41:43.494048   15966 main.go:141] libmachine: (addons-299362)     <console type='pty'>

	I0621 17:41:43.494064   15966 main.go:141] libmachine: (addons-299362)       <target type='serial' port='0'/>

	I0621 17:41:43.494076   15966 main.go:141] libmachine: (addons-299362)     </console>

	I0621 17:41:43.494084   15966 main.go:141] libmachine: (addons-299362)     <rng model='virtio'>

	I0621 17:41:43.494110   15966 main.go:141] libmachine: (addons-299362)       <backend model='random'>/dev/random</backend>

	I0621 17:41:43.494121   15966 main.go:141] libmachine: (addons-299362)     </rng>

	I0621 17:41:43.494132   15966 main.go:141] libmachine: (addons-299362)     

	I0621 17:41:43.494142   15966 main.go:141] libmachine: (addons-299362)     

	I0621 17:41:43.494159   15966 main.go:141] libmachine: (addons-299362)   </devices>

	I0621 17:41:43.494170   15966 main.go:141] libmachine: (addons-299362) </domain>

	I0621 17:41:43.494178   15966 main.go:141] libmachine: (addons-299362) 

	I0621 17:41:43.500417   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4d:41:de in network default

	I0621 17:41:43.500929   15966 main.go:141] libmachine: (addons-299362) Ensuring networks are active...

	I0621 17:41:43.500944   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:43.501623   15966 main.go:141] libmachine: (addons-299362) Ensuring network default is active

	I0621 17:41:43.501987   15966 main.go:141] libmachine: (addons-299362) Ensuring network mk-addons-299362 is active

	I0621 17:41:43.502457   15966 main.go:141] libmachine: (addons-299362) Getting domain xml...

	I0621 17:41:43.503154   15966 main.go:141] libmachine: (addons-299362) Creating domain...

	I0621 17:41:44.900861   15966 main.go:141] libmachine: (addons-299362) Waiting to get IP...

	I0621 17:41:44.901638   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:44.902134   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:44.902161   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:44.902094   15988 retry.go:31] will retry after 238.611118ms: waiting for machine to come up

	I0621 17:41:45.142597   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:45.143212   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:45.143242   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:45.143163   15988 retry.go:31] will retry after 338.04846ms: waiting for machine to come up

	I0621 17:41:45.482659   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:45.483077   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:45.483125   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:45.483030   15988 retry.go:31] will retry after 376.541147ms: waiting for machine to come up

	I0621 17:41:45.861654   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:45.862080   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:45.862098   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:45.862041   15988 retry.go:31] will retry after 591.404874ms: waiting for machine to come up

	I0621 17:41:46.455020   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:46.455416   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:46.455449   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:46.455373   15988 retry.go:31] will retry after 571.185737ms: waiting for machine to come up

	I0621 17:41:47.028301   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:47.028770   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:47.028798   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:47.028701   15988 retry.go:31] will retry after 860.413457ms: waiting for machine to come up

	I0621 17:41:47.890378   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:47.890711   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:47.890734   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:47.890681   15988 retry.go:31] will retry after 863.058243ms: waiting for machine to come up

	I0621 17:41:48.755183   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:48.755540   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:48.755565   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:48.755475   15988 retry.go:31] will retry after 1.274888046s: waiting for machine to come up

	I0621 17:41:50.031810   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:50.032129   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:50.032157   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:50.032081   15988 retry.go:31] will retry after 1.804894555s: waiting for machine to come up

	I0621 17:41:51.839091   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:51.839448   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:51.839475   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:51.839404   15988 retry.go:31] will retry after 1.815264751s: waiting for machine to come up

	I0621 17:41:53.656502   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:53.656947   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:53.656971   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:53.656897   15988 retry.go:31] will retry after 1.771283428s: waiting for machine to come up

	I0621 17:41:55.430864   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:55.431402   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:55.431432   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:55.431354   15988 retry.go:31] will retry after 2.241154508s: waiting for machine to come up

	I0621 17:41:57.676738   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:41:57.678446   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find current IP address of domain addons-299362 in network mk-addons-299362

	I0621 17:41:57.678471   15966 main.go:141] libmachine: (addons-299362) DBG | I0621 17:41:57.678382   15988 retry.go:31] will retry after 4.444265201s: waiting for machine to come up

	I0621 17:42:02.127044   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:02.127524   15966 main.go:141] libmachine: (addons-299362) Found IP for machine: 192.168.39.187

	I0621 17:42:02.127549   15966 main.go:141] libmachine: (addons-299362) Reserving static IP address...

	I0621 17:42:02.127560   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has current primary IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:02.127897   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find host DHCP lease matching {name: "addons-299362", mac: "52:54:00:4a:bb:14", ip: "192.168.39.187"} in network mk-addons-299362

	I0621 17:42:02.204142   15966 main.go:141] libmachine: (addons-299362) DBG | Getting to WaitForSSH function...

	I0621 17:42:02.204168   15966 main.go:141] libmachine: (addons-299362) Reserved static IP address: 192.168.39.187

	I0621 17:42:02.204178   15966 main.go:141] libmachine: (addons-299362) Waiting for SSH to be available...

	I0621 17:42:02.206797   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:02.207083   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362

	I0621 17:42:02.207110   15966 main.go:141] libmachine: (addons-299362) DBG | unable to find defined IP address of network mk-addons-299362 interface with MAC address 52:54:00:4a:bb:14

	I0621 17:42:02.207218   15966 main.go:141] libmachine: (addons-299362) DBG | Using SSH client type: external

	I0621 17:42:02.207236   15966 main.go:141] libmachine: (addons-299362) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa (-rw-------)

	I0621 17:42:02.207295   15966 main.go:141] libmachine: (addons-299362) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 17:42:02.207319   15966 main.go:141] libmachine: (addons-299362) DBG | About to run SSH command:

	I0621 17:42:02.207337   15966 main.go:141] libmachine: (addons-299362) DBG | exit 0

	I0621 17:42:02.219474   15966 main.go:141] libmachine: (addons-299362) DBG | SSH cmd err, output: exit status 255: 

	I0621 17:42:02.219502   15966 main.go:141] libmachine: (addons-299362) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0621 17:42:02.219510   15966 main.go:141] libmachine: (addons-299362) DBG | command : exit 0

	I0621 17:42:02.219515   15966 main.go:141] libmachine: (addons-299362) DBG | err     : exit status 255

	I0621 17:42:02.219530   15966 main.go:141] libmachine: (addons-299362) DBG | output  : 

	I0621 17:42:05.221513   15966 main.go:141] libmachine: (addons-299362) DBG | Getting to WaitForSSH function...

	I0621 17:42:05.223788   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.224187   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.224233   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.224293   15966 main.go:141] libmachine: (addons-299362) DBG | Using SSH client type: external

	I0621 17:42:05.224331   15966 main.go:141] libmachine: (addons-299362) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa (-rw-------)

	I0621 17:42:05.224362   15966 main.go:141] libmachine: (addons-299362) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.187 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 17:42:05.224380   15966 main.go:141] libmachine: (addons-299362) DBG | About to run SSH command:

	I0621 17:42:05.224395   15966 main.go:141] libmachine: (addons-299362) DBG | exit 0

	I0621 17:42:05.345772   15966 main.go:141] libmachine: (addons-299362) DBG | SSH cmd err, output: <nil>: 

	I0621 17:42:05.346107   15966 main.go:141] libmachine: (addons-299362) KVM machine creation complete!

	I0621 17:42:05.346383   15966 main.go:141] libmachine: (addons-299362) Calling .GetConfigRaw

	I0621 17:42:05.346948   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:05.347140   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:05.347292   15966 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0621 17:42:05.347307   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:05.348662   15966 main.go:141] libmachine: Detecting operating system of created instance...

	I0621 17:42:05.348674   15966 main.go:141] libmachine: Waiting for SSH to be available...

	I0621 17:42:05.348679   15966 main.go:141] libmachine: Getting to WaitForSSH function...

	I0621 17:42:05.348686   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:05.351027   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.351393   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.351415   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.351572   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:05.351755   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.351915   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.352052   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:05.352231   15966 main.go:141] libmachine: Using SSH client type: native

	I0621 17:42:05.352452   15966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0621 17:42:05.352465   15966 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0621 17:42:05.449050   15966 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 17:42:05.449075   15966 main.go:141] libmachine: Detecting the provisioner...

	I0621 17:42:05.449083   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:05.451822   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.452184   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.452220   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.452418   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:05.452628   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.452889   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.453085   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:05.453355   15966 main.go:141] libmachine: Using SSH client type: native

	I0621 17:42:05.453517   15966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0621 17:42:05.453551   15966 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0621 17:42:05.550254   15966 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0621 17:42:05.550324   15966 main.go:141] libmachine: found compatible host: buildroot

	I0621 17:42:05.550331   15966 main.go:141] libmachine: Provisioning with buildroot...

	I0621 17:42:05.550338   15966 main.go:141] libmachine: (addons-299362) Calling .GetMachineName

	I0621 17:42:05.550615   15966 buildroot.go:166] provisioning hostname "addons-299362"

	I0621 17:42:05.550643   15966 main.go:141] libmachine: (addons-299362) Calling .GetMachineName

	I0621 17:42:05.550845   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:05.553272   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.553636   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.553669   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.553822   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:05.553997   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.554190   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.554323   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:05.554507   15966 main.go:141] libmachine: Using SSH client type: native

	I0621 17:42:05.554681   15966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0621 17:42:05.554694   15966 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-299362 && echo "addons-299362" | sudo tee /etc/hostname

	I0621 17:42:05.669095   15966 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-299362

	I0621 17:42:05.669119   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:05.671905   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.672218   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.672244   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.672414   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:05.672601   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.672778   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.672964   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:05.673168   15966 main.go:141] libmachine: Using SSH client type: native

	I0621 17:42:05.673330   15966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0621 17:42:05.673346   15966 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-299362' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-299362/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-299362' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0621 17:42:05.777897   15966 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 17:42:05.777944   15966 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19112-8111/.minikube CaCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19112-8111/.minikube}

	I0621 17:42:05.777986   15966 buildroot.go:174] setting up certificates

	I0621 17:42:05.777996   15966 provision.go:84] configureAuth start

	I0621 17:42:05.778008   15966 main.go:141] libmachine: (addons-299362) Calling .GetMachineName

	I0621 17:42:05.778307   15966 main.go:141] libmachine: (addons-299362) Calling .GetIP

	I0621 17:42:05.781090   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.781442   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.781468   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.781624   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:05.784177   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.784569   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.784593   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.784702   15966 provision.go:143] copyHostCerts

	I0621 17:42:05.784787   15966 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem (1082 bytes)

	I0621 17:42:05.784895   15966 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem (1123 bytes)

	I0621 17:42:05.784948   15966 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem (1675 bytes)

	I0621 17:42:05.784994   15966 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem org=jenkins.addons-299362 san=[127.0.0.1 192.168.39.187 addons-299362 localhost minikube]

	I0621 17:42:05.946724   15966 provision.go:177] copyRemoteCerts

	I0621 17:42:05.946787   15966 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0621 17:42:05.946809   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:05.949599   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.949946   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:05.949972   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:05.950186   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:05.950399   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:05.950559   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:05.950735   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:06.027638   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0621 17:42:06.051710   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0621 17:42:06.075118   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0621 17:42:06.099592   15966 provision.go:87] duration metric: took 321.579831ms to configureAuth

	I0621 17:42:06.099629   15966 buildroot.go:189] setting minikube options for container-runtime

	I0621 17:42:06.099849   15966 config.go:182] Loaded profile config "addons-299362": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 17:42:06.099933   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:06.102591   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.102877   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.102905   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.103051   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:06.103251   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:06.103433   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:06.103556   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:06.103714   15966 main.go:141] libmachine: Using SSH client type: native

	I0621 17:42:06.103953   15966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0621 17:42:06.103974   15966 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0621 17:42:06.352481   15966 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0621 17:42:06.352517   15966 main.go:141] libmachine: Checking connection to Docker...

	I0621 17:42:06.352527   15966 main.go:141] libmachine: (addons-299362) Calling .GetURL

	I0621 17:42:06.354266   15966 main.go:141] libmachine: (addons-299362) DBG | Using libvirt version 6000000

	I0621 17:42:06.356398   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.356694   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.356717   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.356835   15966 main.go:141] libmachine: Docker is up and running!

	I0621 17:42:06.356848   15966 main.go:141] libmachine: Reticulating splines...

	I0621 17:42:06.356857   15966 client.go:171] duration metric: took 23.574236273s to LocalClient.Create

	I0621 17:42:06.356883   15966 start.go:167] duration metric: took 23.574306328s to libmachine.API.Create "addons-299362"

	I0621 17:42:06.356896   15966 start.go:293] postStartSetup for "addons-299362" (driver="kvm2")

	I0621 17:42:06.356910   15966 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0621 17:42:06.356933   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:06.357231   15966 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0621 17:42:06.357254   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:06.359398   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.359662   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.359685   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.359883   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:06.360053   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:06.360223   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:06.360353   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:06.440006   15966 ssh_runner.go:195] Run: cat /etc/os-release

	I0621 17:42:06.444022   15966 info.go:137] Remote host: Buildroot 2023.02.9

	I0621 17:42:06.444049   15966 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/addons for local assets ...

	I0621 17:42:06.444132   15966 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/files for local assets ...

	I0621 17:42:06.444165   15966 start.go:296] duration metric: took 87.262372ms for postStartSetup

	I0621 17:42:06.444199   15966 main.go:141] libmachine: (addons-299362) Calling .GetConfigRaw

	I0621 17:42:06.444812   15966 main.go:141] libmachine: (addons-299362) Calling .GetIP

	I0621 17:42:06.447866   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.448192   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.448229   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.448441   15966 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/config.json ...

	I0621 17:42:06.448622   15966 start.go:128] duration metric: took 23.684073365s to createHost

	I0621 17:42:06.448646   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:06.450682   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.451022   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.451044   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.451174   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:06.451338   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:06.451506   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:06.451607   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:06.451749   15966 main.go:141] libmachine: Using SSH client type: native

	I0621 17:42:06.451939   15966 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.187 22 <nil> <nil>}

	I0621 17:42:06.451951   15966 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0621 17:42:06.550384   15966 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718991726.526854340

	I0621 17:42:06.550407   15966 fix.go:216] guest clock: 1718991726.526854340

	I0621 17:42:06.550417   15966 fix.go:229] Guest: 2024-06-21 17:42:06.52685434 +0000 UTC Remote: 2024-06-21 17:42:06.448633994 +0000 UTC m=+23.785691881 (delta=78.220346ms)

	I0621 17:42:06.550468   15966 fix.go:200] guest clock delta is within tolerance: 78.220346ms

	I0621 17:42:06.550477   15966 start.go:83] releasing machines lock for "addons-299362", held for 23.78601619s

	I0621 17:42:06.550507   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:06.550801   15966 main.go:141] libmachine: (addons-299362) Calling .GetIP

	I0621 17:42:06.553730   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.554251   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.554282   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.554431   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:06.554901   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:06.555083   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:06.555170   15966 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0621 17:42:06.555214   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:06.555294   15966 ssh_runner.go:195] Run: cat /version.json

	I0621 17:42:06.555313   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:06.558190   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.558562   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.558591   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.558617   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.558866   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:06.559033   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:06.559060   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:06.559120   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:06.559224   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:06.559293   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:06.559414   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:06.559424   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:06.559548   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:06.559678   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:06.630424   15966 ssh_runner.go:195] Run: systemctl --version

	I0621 17:42:06.667563   15966 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0621 17:42:06.825054   15966 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0621 17:42:06.830805   15966 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0621 17:42:06.830874   15966 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0621 17:42:06.845883   15966 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0621 17:42:06.845906   15966 start.go:494] detecting cgroup driver to use...

	I0621 17:42:06.845986   15966 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0621 17:42:06.861175   15966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0621 17:42:06.874543   15966 docker.go:217] disabling cri-docker service (if available) ...

	I0621 17:42:06.874613   15966 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0621 17:42:06.887577   15966 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0621 17:42:06.900941   15966 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0621 17:42:07.013240   15966 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0621 17:42:07.169491   15966 docker.go:233] disabling docker service ...

	I0621 17:42:07.169554   15966 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0621 17:42:07.182782   15966 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0621 17:42:07.194926   15966 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0621 17:42:07.319587   15966 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0621 17:42:07.434979   15966 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0621 17:42:07.448229   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0621 17:42:07.465009   15966 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0621 17:42:07.465075   15966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 17:42:07.474335   15966 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0621 17:42:07.474402   15966 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 17:42:07.483959   15966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 17:42:07.493204   15966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 17:42:07.502644   15966 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0621 17:42:07.512376   15966 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 17:42:07.521822   15966 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 17:42:07.537627   15966 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 17:42:07.547237   15966 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0621 17:42:07.556102   15966 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0621 17:42:07.556177   15966 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0621 17:42:07.569247   15966 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0621 17:42:07.578625   15966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 17:42:07.697149   15966 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0621 17:42:07.822681   15966 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0621 17:42:07.822790   15966 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0621 17:42:07.827629   15966 start.go:562] Will wait 60s for crictl version

	I0621 17:42:07.827699   15966 ssh_runner.go:195] Run: which crictl

	I0621 17:42:07.831129   15966 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0621 17:42:07.877170   15966 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0621 17:42:07.877294   15966 ssh_runner.go:195] Run: crio --version

	I0621 17:42:07.903177   15966 ssh_runner.go:195] Run: crio --version

	I0621 17:42:07.930861   15966 out.go:177] * Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	I0621 17:42:07.932187   15966 main.go:141] libmachine: (addons-299362) Calling .GetIP

	I0621 17:42:07.935178   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:07.935668   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:07.935689   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:07.935978   15966 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0621 17:42:07.939810   15966 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 17:42:07.951471   15966 kubeadm.go:877] updating cluster {Name:addons-299362 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.

2 ClusterName:addons-299362 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.187 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountT

ype:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0621 17:42:07.951569   15966 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 17:42:07.951615   15966 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 17:42:07.982293   15966 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.2". assuming images are not preloaded.

	I0621 17:42:07.982352   15966 ssh_runner.go:195] Run: which lz4

	I0621 17:42:07.985982   15966 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0621 17:42:07.989625   15966 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0621 17:42:07.989647   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (395071426 bytes)

	I0621 17:42:09.116456   15966 crio.go:462] duration metric: took 1.130505996s to copy over tarball

	I0621 17:42:09.116516   15966 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0621 17:42:11.299990   15966 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.183446688s)

	I0621 17:42:11.300017   15966 crio.go:469] duration metric: took 2.183535442s to extract the tarball

	I0621 17:42:11.300026   15966 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0621 17:42:11.336972   15966 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 17:42:11.375991   15966 crio.go:514] all images are preloaded for cri-o runtime.

	I0621 17:42:11.376019   15966 cache_images.go:84] Images are preloaded, skipping loading

	I0621 17:42:11.376030   15966 kubeadm.go:928] updating node { 192.168.39.187 8443 v1.30.2 crio true true} ...

	I0621 17:42:11.376135   15966 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-299362 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.187

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:addons-299362 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0621 17:42:11.376224   15966 ssh_runner.go:195] Run: crio config

	I0621 17:42:11.423252   15966 cni.go:84] Creating CNI manager for ""

	I0621 17:42:11.423271   15966 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0621 17:42:11.423281   15966 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0621 17:42:11.423302   15966 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.187 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-299362 NodeName:addons-299362 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.187"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.187 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/k

ubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0621 17:42:11.423468   15966 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.187

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-299362"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.187

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.187"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0621 17:42:11.423524   15966 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0621 17:42:11.432845   15966 binaries.go:44] Found k8s binaries, skipping transfer

	I0621 17:42:11.432906   15966 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0621 17:42:11.441479   15966 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0621 17:42:11.456654   15966 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0621 17:42:11.471695   15966 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2157 bytes)

	I0621 17:42:11.487164   15966 ssh_runner.go:195] Run: grep 192.168.39.187	control-plane.minikube.internal$ /etc/hosts

	I0621 17:42:11.490731   15966 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.187	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 17:42:11.501740   15966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 17:42:11.617578   15966 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0621 17:42:11.632752   15966 certs.go:68] Setting up /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362 for IP: 192.168.39.187

	I0621 17:42:11.632779   15966 certs.go:194] generating shared ca certs ...

	I0621 17:42:11.632799   15966 certs.go:226] acquiring lock for ca certs: {Name:mk96df7d45efa699c355b4c4409471361aa3f418 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:11.632965   15966 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key

	I0621 17:42:11.794161   15966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt ...

	I0621 17:42:11.794189   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt: {Name:mk8f2dfff48454b29c625265558b4d00edc690ae Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:11.794374   15966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key ...

	I0621 17:42:11.794389   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key: {Name:mk67f1b3dde9a892db0dbab81bfc255f3e3bedc2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:11.794482   15966 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key

	I0621 17:42:11.985544   15966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt ...

	I0621 17:42:11.985579   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt: {Name:mk2b7bdc6bf617523b8e047d9866ba57f334d595 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:11.985763   15966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key ...

	I0621 17:42:11.985782   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key: {Name:mk5a02b4978b399dbe0a14a04fef6daf646a5580 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:11.985897   15966 certs.go:256] generating profile certs ...

	I0621 17:42:11.985950   15966 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/client.key

	I0621 17:42:11.985978   15966 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/client.crt with IP's: []

	I0621 17:42:12.056502   15966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/client.crt ...

	I0621 17:42:12.056537   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/client.crt: {Name:mk0076a9fb29f804270d559c33955cd82f5a7600 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:12.056723   15966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/client.key ...

	I0621 17:42:12.056737   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/client.key: {Name:mk8a16957c93491ace566c93bedc95891aab321f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:12.056831   15966 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.key.466fd825

	I0621 17:42:12.056854   15966 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.crt.466fd825 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.187]

	I0621 17:42:12.183068   15966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.crt.466fd825 ...

	I0621 17:42:12.183099   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.crt.466fd825: {Name:mked50c174107c240b0f42a35ee64353d1791ac3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:12.183279   15966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.key.466fd825 ...

	I0621 17:42:12.183296   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.key.466fd825: {Name:mkb20bb6af58ef03dc742b7fffb7f29ae14513d9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:12.183388   15966 certs.go:381] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.crt.466fd825 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.crt

	I0621 17:42:12.183477   15966 certs.go:385] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.key.466fd825 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.key

	I0621 17:42:12.183545   15966 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.key

	I0621 17:42:12.183569   15966 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.crt with IP's: []

	I0621 17:42:12.281845   15966 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.crt ...

	I0621 17:42:12.281892   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.crt: {Name:mkdc4b61d943ea7b2a3359cda29c1444c17430ce Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:12.282078   15966 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.key ...

	I0621 17:42:12.282092   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.key: {Name:mk28c8edc46bcdac42f8658d6913f8cee02236df Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:12.282418   15966 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem (1675 bytes)

	I0621 17:42:12.282471   15966 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem (1082 bytes)

	I0621 17:42:12.282505   15966 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem (1123 bytes)

	I0621 17:42:12.282539   15966 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem (1675 bytes)

	I0621 17:42:12.283194   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0621 17:42:12.306681   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0621 17:42:12.330465   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0621 17:42:12.357551   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0621 17:42:12.382724   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0621 17:42:12.405889   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0621 17:42:12.427791   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0621 17:42:12.449756   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/addons-299362/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1675 bytes)

	I0621 17:42:12.471216   15966 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0621 17:42:12.492423   15966 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0621 17:42:12.507309   15966 ssh_runner.go:195] Run: openssl version

	I0621 17:42:12.512918   15966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0621 17:42:12.522678   15966 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0621 17:42:12.526648   15966 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 21 17:42 /usr/share/ca-certificates/minikubeCA.pem

	I0621 17:42:12.526698   15966 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0621 17:42:12.531947   15966 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0621 17:42:12.541993   15966 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0621 17:42:12.546080   15966 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0621 17:42:12.546145   15966 kubeadm.go:391] StartCluster: {Name:addons-299362 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 C

lusterName:addons-299362 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.187 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType

:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0621 17:42:12.546222   15966 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0621 17:42:12.546285   15966 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0621 17:42:12.580883   15966 cri.go:89] found id: ""

	I0621 17:42:12.580947   15966 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0621 17:42:12.590101   15966 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0621 17:42:12.599086   15966 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0621 17:42:12.608171   15966 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0621 17:42:12.608189   15966 kubeadm.go:156] found existing configuration files:

	I0621 17:42:12.608236   15966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0621 17:42:12.616771   15966 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0621 17:42:12.616838   15966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0621 17:42:12.625823   15966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0621 17:42:12.634243   15966 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0621 17:42:12.634298   15966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0621 17:42:12.642838   15966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0621 17:42:12.651102   15966 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0621 17:42:12.651155   15966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0621 17:42:12.659760   15966 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0621 17:42:12.668402   15966 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0621 17:42:12.668447   15966 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0621 17:42:12.677218   15966 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0621 17:42:12.858835   15966 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0621 17:42:23.032614   15966 kubeadm.go:309] [init] Using Kubernetes version: v1.30.2

	I0621 17:42:23.032680   15966 kubeadm.go:309] [preflight] Running pre-flight checks

	I0621 17:42:23.032774   15966 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0621 17:42:23.032886   15966 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0621 17:42:23.033025   15966 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0621 17:42:23.033115   15966 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0621 17:42:23.034700   15966 out.go:204]   - Generating certificates and keys ...

	I0621 17:42:23.034792   15966 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0621 17:42:23.034880   15966 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0621 17:42:23.034986   15966 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0621 17:42:23.035057   15966 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0621 17:42:23.035131   15966 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0621 17:42:23.035204   15966 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0621 17:42:23.035280   15966 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0621 17:42:23.035437   15966 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [addons-299362 localhost] and IPs [192.168.39.187 127.0.0.1 ::1]

	I0621 17:42:23.035511   15966 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0621 17:42:23.035675   15966 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [addons-299362 localhost] and IPs [192.168.39.187 127.0.0.1 ::1]

	I0621 17:42:23.035767   15966 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0621 17:42:23.035858   15966 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0621 17:42:23.035919   15966 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0621 17:42:23.036101   15966 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0621 17:42:23.036229   15966 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0621 17:42:23.036309   15966 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0621 17:42:23.036382   15966 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0621 17:42:23.036468   15966 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0621 17:42:23.036542   15966 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0621 17:42:23.036641   15966 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0621 17:42:23.036729   15966 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0621 17:42:23.038201   15966 out.go:204]   - Booting up control plane ...

	I0621 17:42:23.038425   15966 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0621 17:42:23.038551   15966 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0621 17:42:23.038616   15966 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0621 17:42:23.038706   15966 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0621 17:42:23.038784   15966 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0621 17:42:23.038834   15966 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0621 17:42:23.039024   15966 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0621 17:42:23.039120   15966 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0621 17:42:23.039185   15966 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 500.923437ms

	I0621 17:42:23.039245   15966 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0621 17:42:23.039295   15966 kubeadm.go:309] [api-check] The API server is healthy after 5.002178212s

	I0621 17:42:23.039406   15966 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0621 17:42:23.039519   15966 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0621 17:42:23.039568   15966 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0621 17:42:23.039721   15966 kubeadm.go:309] [mark-control-plane] Marking the node addons-299362 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0621 17:42:23.039770   15966 kubeadm.go:309] [bootstrap-token] Using token: ovr80d.bfmxl3kesmj3l5ma

	I0621 17:42:23.040963   15966 out.go:204]   - Configuring RBAC rules ...

	I0621 17:42:23.041073   15966 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0621 17:42:23.041175   15966 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0621 17:42:23.041367   15966 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0621 17:42:23.041535   15966 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0621 17:42:23.041681   15966 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0621 17:42:23.041790   15966 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0621 17:42:23.041981   15966 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0621 17:42:23.042058   15966 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0621 17:42:23.042135   15966 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0621 17:42:23.042152   15966 kubeadm.go:309] 

	I0621 17:42:23.042246   15966 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0621 17:42:23.042264   15966 kubeadm.go:309] 

	I0621 17:42:23.042385   15966 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0621 17:42:23.042396   15966 kubeadm.go:309] 

	I0621 17:42:23.042443   15966 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0621 17:42:23.042516   15966 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0621 17:42:23.042560   15966 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0621 17:42:23.042568   15966 kubeadm.go:309] 

	I0621 17:42:23.042639   15966 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0621 17:42:23.042654   15966 kubeadm.go:309] 

	I0621 17:42:23.042731   15966 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0621 17:42:23.042745   15966 kubeadm.go:309] 

	I0621 17:42:23.042815   15966 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0621 17:42:23.042907   15966 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0621 17:42:23.042987   15966 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0621 17:42:23.042995   15966 kubeadm.go:309] 

	I0621 17:42:23.043074   15966 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0621 17:42:23.043167   15966 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0621 17:42:23.043179   15966 kubeadm.go:309] 

	I0621 17:42:23.043277   15966 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token ovr80d.bfmxl3kesmj3l5ma \

	I0621 17:42:23.043410   15966 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df \

	I0621 17:42:23.043432   15966 kubeadm.go:309] 	--control-plane 

	I0621 17:42:23.043445   15966 kubeadm.go:309] 

	I0621 17:42:23.043564   15966 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0621 17:42:23.043573   15966 kubeadm.go:309] 

	I0621 17:42:23.043677   15966 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ovr80d.bfmxl3kesmj3l5ma \

	I0621 17:42:23.043814   15966 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df 

	I0621 17:42:23.043840   15966 cni.go:84] Creating CNI manager for ""

	I0621 17:42:23.043851   15966 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0621 17:42:23.045257   15966 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0621 17:42:23.046481   15966 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0621 17:42:23.057341   15966 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0621 17:42:23.075477   15966 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0621 17:42:23.075592   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:23.075600   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-299362 minikube.k8s.io/updated_at=2024_06_21T17_42_23_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=1a0d377c34faa85740cf2404ea12566198300600 minikube.k8s.io/name=addons-299362 minikube.k8s.io/primary=true

	I0621 17:42:23.090769   15966 ops.go:34] apiserver oom_adj: -16

	I0621 17:42:23.207909   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:23.708760   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:24.208930   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:24.708066   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:25.208584   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:25.708163   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:26.208056   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:26.708034   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:27.208146   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:27.708289   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:28.208986   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:28.708553   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:29.208089   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:29.708271   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:30.208284   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:30.708790   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:31.207961   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:31.708278   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:32.207930   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:32.708188   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:33.208002   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:33.708079   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:34.208664   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:34.708165   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:35.208882   15966 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 17:42:35.300898   15966 kubeadm.go:1107] duration metric: took 12.225370332s to wait for elevateKubeSystemPrivileges

	W0621 17:42:35.300945   15966 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0621 17:42:35.300956   15966 kubeadm.go:393] duration metric: took 22.754815293s to StartCluster

	I0621 17:42:35.300979   15966 settings.go:142] acquiring lock: {Name:mkdbb660cad4d8fb446e5c2ca4439ea3326e9592 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:35.301110   15966 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 17:42:35.301657   15966 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/kubeconfig: {Name:mk87038194ab41f67dd50d90b017d32a83c3da4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 17:42:35.301904   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0621 17:42:35.301955   15966 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.187 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 17:42:35.302018   15966 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volcano:true volumesnapshots:true yakd:true]

	I0621 17:42:35.302113   15966 addons.go:69] Setting yakd=true in profile "addons-299362"

	I0621 17:42:35.302133   15966 addons.go:69] Setting inspektor-gadget=true in profile "addons-299362"

	I0621 17:42:35.302157   15966 addons.go:69] Setting volcano=true in profile "addons-299362"

	I0621 17:42:35.302159   15966 addons.go:69] Setting storage-provisioner=true in profile "addons-299362"

	I0621 17:42:35.302178   15966 addons.go:234] Setting addon volcano=true in "addons-299362"

	I0621 17:42:35.302176   15966 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-299362"

	I0621 17:42:35.302216   15966 addons.go:69] Setting volumesnapshots=true in profile "addons-299362"

	I0621 17:42:35.302222   15966 addons.go:69] Setting registry=true in profile "addons-299362"

	I0621 17:42:35.302235   15966 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-299362"

	I0621 17:42:35.302238   15966 addons.go:234] Setting addon volumesnapshots=true in "addons-299362"

	I0621 17:42:35.302249   15966 addons.go:234] Setting addon registry=true in "addons-299362"

	I0621 17:42:35.302270   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302270   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302186   15966 addons.go:69] Setting cloud-spanner=true in profile "addons-299362"

	I0621 17:42:35.302289   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302309   15966 addons.go:234] Setting addon cloud-spanner=true in "addons-299362"

	I0621 17:42:35.302219   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302340   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302179   15966 addons.go:234] Setting addon inspektor-gadget=true in "addons-299362"

	I0621 17:42:35.302421   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302731   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.302740   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.302732   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.302758   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.302773   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.302779   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.302782   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.302766   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.302146   15966 addons.go:234] Setting addon yakd=true in "addons-299362"

	I0621 17:42:35.302797   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.302810   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302196   15966 addons.go:69] Setting default-storageclass=true in profile "addons-299362"

	I0621 17:42:35.302192   15966 config.go:182] Loaded profile config "addons-299362": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 17:42:35.302199   15966 addons.go:69] Setting gcp-auth=true in profile "addons-299362"

	I0621 17:42:35.302862   15966 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-299362"

	I0621 17:42:35.302865   15966 mustload.go:65] Loading cluster: addons-299362

	I0621 17:42:35.302894   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.302955   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.303003   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.303012   15966 config.go:182] Loaded profile config "addons-299362": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 17:42:35.302197   15966 addons.go:234] Setting addon storage-provisioner=true in "addons-299362"

	I0621 17:42:35.302204   15966 addons.go:69] Setting metrics-server=true in profile "addons-299362"

	I0621 17:42:35.303181   15966 addons.go:234] Setting addon metrics-server=true in "addons-299362"

	I0621 17:42:35.302204   15966 addons.go:69] Setting ingress-dns=true in profile "addons-299362"

	I0621 17:42:35.303209   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.303222   15966 addons.go:234] Setting addon ingress-dns=true in "addons-299362"

	I0621 17:42:35.303235   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.303252   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302202   15966 addons.go:69] Setting ingress=true in profile "addons-299362"

	I0621 17:42:35.303322   15966 addons.go:234] Setting addon ingress=true in "addons-299362"

	I0621 17:42:35.303347   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.302208   15966 addons.go:69] Setting helm-tiller=true in profile "addons-299362"

	I0621 17:42:35.303398   15966 addons.go:234] Setting addon helm-tiller=true in "addons-299362"

	I0621 17:42:35.303430   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.303489   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.303566   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.303587   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.302151   15966 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-299362"

	I0621 17:42:35.303642   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.303650   15966 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-299362"

	I0621 17:42:35.303193   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.303656   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.303666   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.302191   15966 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-299362"

	I0621 17:42:35.303795   15966 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-299362"

	I0621 17:42:35.303839   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.303799   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.304124   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.304129   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.304143   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.304159   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.304192   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.304214   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.304234   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.304348   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.304234   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.304436   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.304401   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.305916   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.304328   15966 out.go:177] * Verifying Kubernetes components...

	I0621 17:42:35.315909   15966 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 17:42:35.329867   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33809

	I0621 17:42:35.329960   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43769

	I0621 17:42:35.330065   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44333

	I0621 17:42:35.330113   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40591

	I0621 17:42:35.330164   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42115

	I0621 17:42:35.330501   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.330517   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.330847   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.330919   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.331019   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.331172   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.331182   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.331245   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.331268   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.331305   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.331315   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.331453   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.331469   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.331965   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.331981   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.332043   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.332084   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.332123   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.332161   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.332581   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.332611   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.333264   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.340237   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44497

	I0621 17:42:35.345949   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38661

	I0621 17:42:35.346290   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.346311   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.346320   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.346346   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.346677   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.346714   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.348353   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.348379   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.348471   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39541

	I0621 17:42:35.348641   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.348920   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.349133   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.349153   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.349395   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.349417   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.349500   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.350041   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.350069   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.351504   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.351591   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.351823   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.352486   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.352505   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.353233   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.353407   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.356702   15966 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-299362"

	I0621 17:42:35.356741   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.357105   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.357134   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.358418   15966 addons.go:234] Setting addon default-storageclass=true in "addons-299362"

	I0621 17:42:35.358455   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.358699   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.358720   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.381789   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33647

	I0621 17:42:35.382379   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.382881   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.382901   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.383301   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.383637   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.385117   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:35.385452   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.385495   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.388686   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45329

	I0621 17:42:35.389248   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.389874   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.389914   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.390289   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.390442   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.391396   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46139

	I0621 17:42:35.391602   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33649

	I0621 17:42:35.392029   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.392124   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.392523   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.392540   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.392655   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.392672   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.392896   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.393237   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.393419   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.393462   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.393505   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.395146   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.395762   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41409

	I0621 17:42:35.395896   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.396433   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.396986   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.397009   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.397333   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.397712   15966 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.17

	I0621 17:42:35.397713   15966 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I0621 17:42:35.397875   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.397915   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.398196   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44285

	I0621 17:42:35.398665   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.399131   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.399139   15966 addons.go:431] installing /etc/kubernetes/addons/deployment.yaml

	I0621 17:42:35.399150   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0621 17:42:35.399151   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.399165   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.399169   15966 addons.go:431] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0621 17:42:35.399182   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0621 17:42:35.399199   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.399465   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.399631   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.401544   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.403164   15966 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.15.0

	I0621 17:42:35.403308   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45339

	I0621 17:42:35.403559   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36131

	I0621 17:42:35.403873   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.404296   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.404465   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.404476   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.404565   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.404838   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.404894   15966 addons.go:431] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0621 17:42:35.404911   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0621 17:42:35.404936   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.405014   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.405463   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.405779   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.405793   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.405984   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.406010   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.406083   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.406299   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.406323   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.406350   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.406483   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.406916   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.406958   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.407160   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.407183   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.407362   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.407519   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.407544   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.407685   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.407862   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.409646   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.409819   15966 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4

	I0621 17:42:35.410191   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.410210   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.410502   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.410523   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35221

	I0621 17:42:35.410543   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46823

	I0621 17:42:35.410800   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.410883   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.410958   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.411011   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.411158   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.411191   15966 addons.go:431] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0621 17:42:35.411208   15966 ssh_runner.go:362] scp yakd/yakd-ns.yaml --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0621 17:42:35.411226   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.411389   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.411403   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.411516   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.411534   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.411688   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.412185   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.412216   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.412357   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.412573   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.415179   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.415782   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:35.415799   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:35.415783   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.417453   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38409

	I0621 17:42:35.417556   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:35.417571   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:35.417582   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:35.417592   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:35.417607   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:35.417870   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:35.417879   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:35.417892   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:35.417949   15966 main.go:141] libmachine: () Calling .GetVersion

	W0621 17:42:35.417974   15966 out.go:239] ! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	! Enabling 'volcano' returned an error: running callbacks: [volcano addon does not support crio]

	I0621 17:42:35.418417   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.418433   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.418502   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.418514   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.418683   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.418854   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.419012   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.419162   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.419156   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.419242   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38303

	I0621 17:42:35.419765   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.419843   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.419885   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.423483   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38839

	I0621 17:42:35.424014   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.424403   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39005

	I0621 17:42:35.424484   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.424498   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.424766   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.425098   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.425178   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.425192   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.425522   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.425607   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.425644   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.426033   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.426058   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.426501   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.426518   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.427032   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.427627   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.427651   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.428342   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46061

	I0621 17:42:35.428754   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.429309   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.429325   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.429667   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.429916   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.437598   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45115

	I0621 17:42:35.438131   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.438579   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.438594   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.438897   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.439067   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.440783   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40503

	I0621 17:42:35.441181   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.441960   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.442492   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.442508   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.443153   15966 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0621 17:42:35.443582   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.443637   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44703

	I0621 17:42:35.443905   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.444056   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.444292   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.444305   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.444582   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.444742   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.445828   15966 out.go:177]   - Using image docker.io/busybox:stable

	I0621 17:42:35.446388   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.446913   15966 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0621 17:42:35.446931   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0621 17:42:35.446953   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.446967   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.447184   15966 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0621 17:42:35.447197   15966 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0621 17:42:35.447213   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.447914   15966 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	I0621 17:42:35.449152   15966 addons.go:431] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0621 17:42:35.449170   15966 ssh_runner.go:362] scp metrics-server/metrics-apiservice.yaml --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0621 17:42:35.449190   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.451656   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.452157   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.452177   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.452315   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.452447   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.453114   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.453160   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.453168   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.453490   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.453706   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.453714   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.453725   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.453742   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.454074   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.454142   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.454296   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.454345   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.454469   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.454520   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.454619   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.454623   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.456485   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44523

	I0621 17:42:35.456900   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.457078   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34367

	I0621 17:42:35.457629   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.457650   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.457675   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.458012   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.458172   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.458823   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.458849   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.460178   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.460211   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43525

	I0621 17:42:35.460181   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.460427   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46387

	I0621 17:42:35.460602   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.460863   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.461070   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.461561   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.461584   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.461901   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.461918   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.462116   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.462200   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.462308   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.462419   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.462492   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.462634   15966 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0621 17:42:35.463536   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44181

	I0621 17:42:35.463802   15966 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0621 17:42:35.463876   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.464301   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.464500   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.464515   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.464555   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.464797   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.464856   15966 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0621 17:42:35.464954   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.464982   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36797

	I0621 17:42:35.465009   15966 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 17:42:35.465586   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0621 17:42:35.465604   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.465895   15966 out.go:177]   - Using image docker.io/registry:2.8.3

	I0621 17:42:35.466017   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0621 17:42:35.466072   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.466910   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.467143   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.467292   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.467647   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.468027   15966 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.10.1

	I0621 17:42:35.468286   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:35.468576   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:35.468830   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0621 17:42:35.468846   15966 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0621 17:42:35.468854   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0621 17:42:35.469385   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.469725   15966 addons.go:431] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0621 17:42:35.469742   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0621 17:42:35.469758   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.469827   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.469857   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.470637   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.470777   15966 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0621 17:42:35.470785   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.470792   15966 ssh_runner.go:362] scp volumesnapshots/csi-hostpath-snapshotclass.yaml --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0621 17:42:35.470811   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.470892   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.470961   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.471658   15966 addons.go:431] installing /etc/kubernetes/addons/registry-rc.yaml

	I0621 17:42:35.471672   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)

	I0621 17:42:35.471896   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0621 17:42:35.472017   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.473873   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0621 17:42:35.474553   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.474936   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.474969   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.474980   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.475264   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.475470   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.475566   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.475580   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.475856   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0621 17:42:35.476052   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.475874   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.476223   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.476478   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.476519   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.476684   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.476901   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.477118   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.477134   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.477158   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.477309   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.477454   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.477531   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32917

	I0621 17:42:35.477581   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.478117   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0621 17:42:35.478304   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.478747   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.478764   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.479031   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.479216   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.480556   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.480673   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0621 17:42:35.481697   15966 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.29.0

	I0621 17:42:35.481722   15966 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0621 17:42:35.483059   15966 addons.go:431] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0621 17:42:35.483077   15966 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-attacher.yaml --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0621 17:42:35.483095   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.483095   15966 addons.go:431] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0621 17:42:35.483110   15966 ssh_runner.go:362] scp inspektor-gadget/ig-namespace.yaml --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0621 17:42:35.483138   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.486547   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.486915   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.486943   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.486956   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.487085   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.487234   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.487498   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.487519   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.487536   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.487610   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.487742   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.487852   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.487943   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.488056   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.489931   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46335

	I0621 17:42:35.510219   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:35.510826   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:35.510855   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:35.511182   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:35.511380   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:35.512868   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:35.514677   15966 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0

	I0621 17:42:35.516017   15966 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0621 17:42:35.516033   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)

	I0621 17:42:35.516051   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:35.518841   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.519196   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:35.519222   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:35.519364   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:35.519503   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:35.519644   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:35.519739   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:35.777950   15966 addons.go:431] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0621 17:42:35.777982   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0621 17:42:35.841686   15966 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0621 17:42:35.841716   15966 ssh_runner.go:362] scp helm-tiller/helm-tiller-rbac.yaml --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0621 17:42:35.843168   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0621 17:42:35.851434   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0621 17:42:35.861466   15966 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0621 17:42:35.861521   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0621 17:42:35.864025   15966 addons.go:431] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0621 17:42:35.864045   15966 ssh_runner.go:362] scp metrics-server/metrics-server-rbac.yaml --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0621 17:42:35.893667   15966 addons.go:431] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0621 17:42:35.893692   15966 ssh_runner.go:362] scp yakd/yakd-sa.yaml --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0621 17:42:35.893934   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0621 17:42:36.001987   15966 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0621 17:42:36.002018   15966 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotclasses.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0621 17:42:36.008175   15966 addons.go:431] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0621 17:42:36.008202   15966 ssh_runner.go:362] scp inspektor-gadget/ig-serviceaccount.yaml --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0621 17:42:36.029017   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0621 17:42:36.030664   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0621 17:42:36.038797   15966 addons.go:431] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0621 17:42:36.038814   15966 ssh_runner.go:362] scp helm-tiller/helm-tiller-svc.yaml --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0621 17:42:36.052456   15966 addons.go:431] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0621 17:42:36.052473   15966 ssh_runner.go:362] scp metrics-server/metrics-server-service.yaml --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0621 17:42:36.059269   15966 addons.go:431] installing /etc/kubernetes/addons/registry-svc.yaml

	I0621 17:42:36.059285   15966 ssh_runner.go:362] scp registry/registry-svc.yaml --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0621 17:42:36.100976   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0621 17:42:36.107674   15966 addons.go:431] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0621 17:42:36.107695   15966 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-hostpath.yaml --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0621 17:42:36.146869   15966 addons.go:431] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0621 17:42:36.146894   15966 ssh_runner.go:362] scp yakd/yakd-crb.yaml --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0621 17:42:36.164438   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 17:42:36.187897   15966 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0621 17:42:36.187917   15966 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshotcontents.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0621 17:42:36.193547   15966 addons.go:431] installing /etc/kubernetes/addons/ig-role.yaml

	I0621 17:42:36.193569   15966 ssh_runner.go:362] scp inspektor-gadget/ig-role.yaml --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0621 17:42:36.258007   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0621 17:42:36.271592   15966 addons.go:431] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0621 17:42:36.271614   15966 ssh_runner.go:362] scp yakd/yakd-svc.yaml --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0621 17:42:36.338176   15966 addons.go:431] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0621 17:42:36.338200   15966 ssh_runner.go:362] scp volumesnapshots/snapshot.storage.k8s.io_volumesnapshots.yaml --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0621 17:42:36.347921   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0621 17:42:36.349228   15966 addons.go:431] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0621 17:42:36.349245   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0621 17:42:36.375607   15966 addons.go:431] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0621 17:42:36.375641   15966 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-health-monitor-controller.yaml --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0621 17:42:36.431021   15966 addons.go:431] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0621 17:42:36.431039   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0621 17:42:36.468768   15966 addons.go:431] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0621 17:42:36.468795   15966 ssh_runner.go:362] scp inspektor-gadget/ig-rolebinding.yaml --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0621 17:42:36.552898   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0621 17:42:36.636625   15966 addons.go:431] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0621 17:42:36.636650   15966 ssh_runner.go:362] scp volumesnapshots/rbac-volume-snapshot-controller.yaml --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0621 17:42:36.647164   15966 addons.go:431] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0621 17:42:36.647184   15966 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-provisioner.yaml --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0621 17:42:36.660558   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0621 17:42:36.752035   15966 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0621 17:42:36.752065   15966 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrole.yaml --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0621 17:42:36.860642   15966 addons.go:431] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0621 17:42:36.860670   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0621 17:42:36.946586   15966 addons.go:431] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0621 17:42:36.946620   15966 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-resizer.yaml --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0621 17:42:36.950876   15966 addons.go:431] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0621 17:42:36.950907   15966 ssh_runner.go:362] scp inspektor-gadget/ig-clusterrolebinding.yaml --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0621 17:42:37.261381   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0621 17:42:37.276582   15966 addons.go:431] installing /etc/kubernetes/addons/ig-crd.yaml

	I0621 17:42:37.276607   15966 ssh_runner.go:362] scp inspektor-gadget/ig-crd.yaml --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0621 17:42:37.288084   15966 addons.go:431] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0621 17:42:37.288114   15966 ssh_runner.go:362] scp csi-hostpath-driver/rbac/rbac-external-snapshotter.yaml --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0621 17:42:37.483889   15966 addons.go:431] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0621 17:42:37.483908   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0621 17:42:37.512134   15966 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0621 17:42:37.512155   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0621 17:42:37.843246   15966 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0621 17:42:37.843271   15966 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-driverinfo.yaml --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0621 17:42:37.846023   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0621 17:42:38.117016   15966 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0621 17:42:38.117042   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0621 17:42:38.343086   15966 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0621 17:42:38.343108   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0621 17:42:38.687542   15966 addons.go:431] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0621 17:42:38.687566   15966 ssh_runner.go:362] scp csi-hostpath-driver/deploy/csi-hostpath-storageclass.yaml --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0621 17:42:38.956464   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0621 17:42:40.655005   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (4.811804713s)

	I0621 17:42:40.655028   15966 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (4.793484885s)

	I0621 17:42:40.655046   15966 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0621 17:42:40.655050   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.655064   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.655005   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (4.803534138s)

	I0621 17:42:40.655089   15966 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (4.793599906s)

	I0621 17:42:40.655122   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.655134   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.655142   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (4.761041879s)

	I0621 17:42:40.655166   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.655177   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.655221   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (4.626179398s)

	I0621 17:42:40.655238   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.655246   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.655600   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.655620   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.655628   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.655637   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.655846   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:40.655874   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.655881   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.655888   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.655895   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.655952   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:40.655986   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.655981   15966 node_ready.go:35] waiting up to 6m0s for node "addons-299362" to be "Ready" ...

	I0621 17:42:40.655992   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.656001   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.656008   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.656070   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:40.656100   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.656107   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.656115   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.656123   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.656152   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:40.656176   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.656182   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.656309   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:40.656332   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.656340   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.657250   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:40.657295   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.657305   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.657316   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:40.657343   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.657350   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.746054   15966 node_ready.go:49] node "addons-299362" has status "Ready":"True"

	I0621 17:42:40.746082   15966 node_ready.go:38] duration metric: took 90.08398ms for node "addons-299362" to be "Ready" ...

	I0621 17:42:40.746097   15966 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0621 17:42:40.839186   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:40.839216   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:40.839489   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:40.839511   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:40.843311   15966 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-cnln6" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.166377   15966 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-299362" context rescaled to 1 replicas

	I0621 17:42:41.860281   15966 pod_ready.go:92] pod "coredns-7db6d8ff4d-cnln6" in "kube-system" namespace has status "Ready":"True"

	I0621 17:42:41.860308   15966 pod_ready.go:81] duration metric: took 1.016974069s for pod "coredns-7db6d8ff4d-cnln6" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.860319   15966 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-dh4df" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.874158   15966 pod_ready.go:92] pod "coredns-7db6d8ff4d-dh4df" in "kube-system" namespace has status "Ready":"True"

	I0621 17:42:41.874179   15966 pod_ready.go:81] duration metric: took 13.853929ms for pod "coredns-7db6d8ff4d-dh4df" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.874189   15966 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.882733   15966 pod_ready.go:92] pod "etcd-addons-299362" in "kube-system" namespace has status "Ready":"True"

	I0621 17:42:41.882758   15966 pod_ready.go:81] duration metric: took 8.562278ms for pod "etcd-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.882770   15966 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.892913   15966 pod_ready.go:92] pod "kube-apiserver-addons-299362" in "kube-system" namespace has status "Ready":"True"

	I0621 17:42:41.892939   15966 pod_ready.go:81] duration metric: took 10.16035ms for pod "kube-apiserver-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.892951   15966 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.902027   15966 pod_ready.go:92] pod "kube-controller-manager-addons-299362" in "kube-system" namespace has status "Ready":"True"

	I0621 17:42:41.902051   15966 pod_ready.go:81] duration metric: took 9.088563ms for pod "kube-controller-manager-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:41.902063   15966 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-gml64" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:42.332207   15966 pod_ready.go:92] pod "kube-proxy-gml64" in "kube-system" namespace has status "Ready":"True"

	I0621 17:42:42.332240   15966 pod_ready.go:81] duration metric: took 430.16837ms for pod "kube-proxy-gml64" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:42.332256   15966 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:42.534393   15966 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0621 17:42:42.534425   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:42.537448   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:42.537910   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:42.537937   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:42.538187   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:42.538412   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:42.538595   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:42.538760   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:42.683473   15966 pod_ready.go:92] pod "kube-scheduler-addons-299362" in "kube-system" namespace has status "Ready":"True"

	I0621 17:42:42.683502   15966 pod_ready.go:81] duration metric: took 351.236037ms for pod "kube-scheduler-addons-299362" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:42.683517   15966 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace to be "Ready" ...

	I0621 17:42:43.017016   15966 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0621 17:42:43.209318   15966 addons.go:234] Setting addon gcp-auth=true in "addons-299362"

	I0621 17:42:43.209383   15966 host.go:66] Checking if "addons-299362" exists ...

	I0621 17:42:43.209856   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:43.209893   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:43.225218   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42801

	I0621 17:42:43.225733   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:43.226271   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:43.226293   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:43.226708   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:43.227230   15966 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 17:42:43.227262   15966 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 17:42:43.242404   15966 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41001

	I0621 17:42:43.242938   15966 main.go:141] libmachine: () Calling .GetVersion

	I0621 17:42:43.243432   15966 main.go:141] libmachine: Using API Version  1

	I0621 17:42:43.243448   15966 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 17:42:43.243828   15966 main.go:141] libmachine: () Calling .GetMachineName

	I0621 17:42:43.244019   15966 main.go:141] libmachine: (addons-299362) Calling .GetState

	I0621 17:42:43.245392   15966 main.go:141] libmachine: (addons-299362) Calling .DriverName

	I0621 17:42:43.245643   15966 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0621 17:42:43.245680   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHHostname

	I0621 17:42:43.248264   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:43.248611   15966 main.go:141] libmachine: (addons-299362) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:4a:bb:14", ip: ""} in network mk-addons-299362: {Iface:virbr1 ExpiryTime:2024-06-21 18:41:56 +0000 UTC Type:0 Mac:52:54:00:4a:bb:14 Iaid: IPaddr:192.168.39.187 Prefix:24 Hostname:addons-299362 Clientid:01:52:54:00:4a:bb:14}

	I0621 17:42:43.248643   15966 main.go:141] libmachine: (addons-299362) DBG | domain addons-299362 has defined IP address 192.168.39.187 and MAC address 52:54:00:4a:bb:14 in network mk-addons-299362

	I0621 17:42:43.248801   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHPort

	I0621 17:42:43.248969   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHKeyPath

	I0621 17:42:43.249108   15966 main.go:141] libmachine: (addons-299362) Calling .GetSSHUsername

	I0621 17:42:43.249236   15966 sshutil.go:53] new ssh client: &{IP:192.168.39.187 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/addons-299362/id_rsa Username:docker}

	I0621 17:42:43.465573   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.434875903s)

	I0621 17:42:43.465624   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.465584   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (7.364569769s)

	I0621 17:42:43.465666   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.301197025s)

	I0621 17:42:43.465672   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.465705   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.465711   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.465717   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.465633   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.465761   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.207722411s)

	I0621 17:42:43.465813   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.465815   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (7.117872414s)

	I0621 17:42:43.465822   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.465872   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (6.912949956s)

	I0621 17:42:43.465887   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.465897   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.465836   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.465940   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466079   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (6.805487844s)

	I0621 17:42:43.466108   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466119   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466251   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.466276   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.466291   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.204873647s)

	I0621 17:42:43.466308   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	W0621 17:42:43.466314   15966 addons.go:457] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0621 17:42:43.466323   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.466338   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.466335   15966 retry.go:31] will retry after 334.406266ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0621 17:42:43.466356   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.466363   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.466373   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466377   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.466381   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466387   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.466395   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466394   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (5.620334971s)

	I0621 17:42:43.466403   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466417   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466427   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466427   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.466435   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.466443   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466450   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466476   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.466486   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.466493   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.466499   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.466506   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.466514   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466522   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466543   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.466500   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466560   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466613   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.466620   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.466628   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.466635   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.466687   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.466707   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.466713   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.467014   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.467106   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.467124   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.467894   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.467929   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.467937   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.467983   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.468008   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.468037   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.468044   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.468052   15966 addons.go:475] Verifying addon registry=true in "addons-299362"

	I0621 17:42:43.468181   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.468203   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.468210   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.468217   15966 addons.go:475] Verifying addon ingress=true in "addons-299362"

	I0621 17:42:43.468132   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.469737   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.469748   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.469755   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.468149   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.468166   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.469825   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.470281   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.470316   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.470342   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.470358   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.470034   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.470478   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.470051   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.470649   15966 out.go:177] * Verifying registry addon...

	I0621 17:42:43.470730   15966 out.go:177] * Verifying ingress addon...

	I0621 17:42:43.470800   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:43.470805   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.471234   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.471245   15966 addons.go:475] Verifying addon metrics-server=true in "addons-299362"

	I0621 17:42:43.471509   15966 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-299362 service yakd-dashboard -n yakd-dashboard

	I0621 17:42:43.472482   15966 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0621 17:42:43.473271   15966 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0621 17:42:43.506033   15966 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0621 17:42:43.506053   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:43.506133   15966 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0621 17:42:43.506155   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:43.547750   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:43.547769   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:43.548160   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:43.548177   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:43.801897   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0621 17:42:43.977586   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:43.978064   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:44.493733   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:44.493780   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:44.715169   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:42:45.006706   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:45.036508   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:45.163329   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.206802363s)

	I0621 17:42:45.163379   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:45.163388   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:45.163342   15966 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (1.917674402s)

	I0621 17:42:45.163624   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:45.163671   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:45.163695   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:45.163707   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:45.163950   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:45.163965   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:45.163975   15966 addons.go:475] Verifying addon csi-hostpath-driver=true in "addons-299362"

	I0621 17:42:45.165241   15966 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.1

	I0621 17:42:45.165252   15966 out.go:177] * Verifying csi-hostpath-driver addon...

	I0621 17:42:45.167194   15966 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0621 17:42:45.168134   15966 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0621 17:42:45.168457   15966 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0621 17:42:45.168479   15966 ssh_runner.go:362] scp gcp-auth/gcp-auth-ns.yaml --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0621 17:42:45.195545   15966 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0621 17:42:45.195567   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:45.232464   15966 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0621 17:42:45.232489   15966 ssh_runner.go:362] scp gcp-auth/gcp-auth-service.yaml --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0621 17:42:45.367650   15966 addons.go:431] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0621 17:42:45.367683   15966 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0621 17:42:45.420787   15966 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0621 17:42:45.477546   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:45.495114   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:45.679352   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:45.837163   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.035204096s)

	I0621 17:42:45.837231   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:45.837248   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:45.837599   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:45.837622   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:45.837634   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:45.837642   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:45.837650   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:45.837932   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:45.837968   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:45.837977   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:45.978334   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:45.979254   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:46.174010   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:46.484004   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:46.492302   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:46.702071   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:46.731153   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:42:46.784765   15966 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.363926475s)

	I0621 17:42:46.784810   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:46.784822   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:46.785085   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:46.785136   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:46.785140   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:46.785172   15966 main.go:141] libmachine: Making call to close driver server

	I0621 17:42:46.785183   15966 main.go:141] libmachine: (addons-299362) Calling .Close

	I0621 17:42:46.785399   15966 main.go:141] libmachine: Successfully made call to close driver server

	I0621 17:42:46.785415   15966 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 17:42:46.785434   15966 main.go:141] libmachine: (addons-299362) DBG | Closing plugin on server side

	I0621 17:42:46.787076   15966 addons.go:475] Verifying addon gcp-auth=true in "addons-299362"

	I0621 17:42:46.788660   15966 out.go:177] * Verifying gcp-auth addon...

	I0621 17:42:46.790965   15966 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0621 17:42:46.796730   15966 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0621 17:42:46.796745   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:46.980763   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:46.994084   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:47.175556   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:47.294873   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:47.476883   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:47.477989   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:47.673964   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:47.795356   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:47.986089   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:47.987021   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:48.174250   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:48.295664   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:48.479086   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:48.479527   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:48.675498   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:48.795049   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:48.980473   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:48.980721   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:49.179674   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:49.193205   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:42:49.294943   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:49.481711   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:49.481721   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:49.673290   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:49.794919   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:49.977996   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:49.989318   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:50.173584   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:50.294082   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:50.478570   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:50.479682   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:50.674178   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:50.794187   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:50.977391   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:50.978133   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:51.173448   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:51.297608   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:51.478097   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:51.479599   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:51.673173   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:51.689301   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:42:51.794600   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:51.981884   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:51.982029   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:52.173676   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:52.294759   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:52.477031   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:52.477186   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:52.673756   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:52.795432   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:52.977982   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:52.978546   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:53.174055   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:53.295304   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:53.478397   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:53.478720   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:53.674242   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:53.689925   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:42:53.794999   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:53.978126   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:53.978200   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:54.174105   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:54.294563   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:54.477320   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:54.477853   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:54.674595   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:54.794821   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:54.978808   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:54.983119   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:55.173353   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:55.294314   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:55.479693   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:55.480517   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:55.674422   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:55.794783   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:55.978078   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:55.978367   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:56.174677   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:56.189612   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:42:56.294386   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:56.478043   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:56.478490   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:56.676742   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:56.794674   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:56.979740   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:56.980858   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:57.174336   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:57.296549   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:57.478558   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:57.478759   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:57.673513   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:57.794482   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:57.978165   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:57.978384   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:58.174788   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:58.294788   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:58.477731   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:58.478282   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:58.674031   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:58.689645   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:42:58.794540   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:58.978673   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:58.979232   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:59.173209   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:59.295029   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:59.479361   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:42:59.483553   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:59.673681   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:42:59.794472   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:42:59.982930   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:42:59.984374   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:00.173983   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:00.295256   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:00.477956   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:00.478077   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:00.674145   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:00.794595   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:00.978232   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:00.978597   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:01.172993   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:01.189326   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:01.294322   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:01.477896   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:01.477988   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:01.674008   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:01.795437   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:01.977199   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:01.979331   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:02.173032   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:02.295800   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:02.477287   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:02.477487   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:02.673631   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:02.794880   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:02.977935   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:02.978410   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:03.173738   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:03.189875   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:03.295654   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:03.477898   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:03.479445   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:03.673570   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:03.794844   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:03.977267   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:03.980115   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:04.174607   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:04.295032   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:04.477737   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:04.478703   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:04.675618   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:04.795393   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:04.979212   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:04.982324   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:05.174736   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:05.190146   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:05.296510   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:05.479225   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:05.480905   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:05.674585   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:05.794753   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:05.976888   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:05.978648   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:06.174361   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:06.294531   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:06.478839   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:06.482267   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:06.674345   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:07.231119   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:07.231490   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:07.232221   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:07.232658   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:07.236166   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:07.295054   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:07.477038   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:07.479246   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:07.675412   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:07.794867   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:07.976698   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:07.977390   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:08.173659   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:08.295312   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:08.479131   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:08.479166   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:08.673352   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:08.794878   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:08.977004   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:08.978809   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:09.174832   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:09.295247   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:09.478022   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:09.478338   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:09.674767   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:09.688748   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:09.795031   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:09.979868   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:09.980398   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:10.174976   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:10.294746   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:10.477238   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:10.479525   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:10.673887   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:10.799572   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:10.978292   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:10.978567   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:11.174085   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:11.294507   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:11.477943   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:11.478182   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:11.675449   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:11.689935   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:11.795755   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:11.977603   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:11.979871   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:12.173759   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:12.297123   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:12.689412   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:12.689975   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:12.690852   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:12.794148   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:12.977731   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:12.978105   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:13.174057   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:13.294920   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:13.478313   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:13.478705   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:13.675490   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:13.691056   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:13.795283   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:13.978328   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:13.978670   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:14.173669   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:14.295236   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:14.478153   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:14.478252   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:14.675081   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:14.794462   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:14.980872   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:14.981768   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:15.173196   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:15.295328   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:15.480539   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:15.480697   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:15.673897   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:15.694877   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:15.795074   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:15.976738   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:15.977812   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:16.175952   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:16.296102   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:16.477670   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:16.478470   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:16.673929   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:16.794771   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:16.976925   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:16.979006   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:17.172717   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:17.294805   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:17.476723   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:17.480484   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:17.674220   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:17.795014   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:17.978849   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:17.979740   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:18.173243   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:18.189663   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:18.294775   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:18.477846   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:18.479168   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:18.680823   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:18.794237   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:18.980458   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:18.982233   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:19.174529   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:19.294839   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:19.481245   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:19.482500   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:20.075373   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:20.075796   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:20.078073   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:20.078259   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:20.173745   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:20.194179   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:20.299142   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:20.490532   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:20.491312   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:20.676458   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:20.795092   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:20.977867   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:20.978040   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:21.175081   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:21.295201   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:21.477672   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:21.478215   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:21.673431   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:21.794521   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:21.977986   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:21.978313   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:22.173915   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:22.297484   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:22.479146   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:22.481552   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:22.672815   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:22.689952   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:22.795374   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:22.976987   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:22.979782   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:23.173353   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:23.296261   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:23.477910   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:23.478000   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:23.676188   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:23.794386   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:23.977513   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:23.978664   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:24.173152   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:24.295319   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:24.478712   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:24.479714   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:24.674005   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:24.795366   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:24.979309   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:24.979669   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:25.172574   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:25.188909   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:25.295363   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:25.478426   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:25.479058   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:25.675316   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:25.793921   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:25.977994   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:25.978528   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:26.173943   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:26.294620   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:26.477704   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:26.477785   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:26.676310   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:26.795814   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:26.977860   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:26.980381   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:27.181481   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:27.295345   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:27.477365   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:27.477517   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:27.674671   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:27.689351   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:27.794987   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:27.979026   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:27.979951   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:28.174283   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:28.294821   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:28.477131   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:28.479882   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:28.673537   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:28.795337   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:28.978456   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:28.979126   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:29.173387   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:29.295319   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:29.477978   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:29.478589   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:29.673500   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:29.711031   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:29.799770   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:29.978005   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:29.978062   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:30.174188   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:30.294253   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:30.740363   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:30.740808   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:30.742354   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:30.795464   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:30.978072   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:30.978355   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:31.174309   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:31.294764   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:31.478104   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:31.478450   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:31.672850   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:31.794653   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:31.977023   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:31.977757   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:32.173740   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:32.188814   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:32.295553   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:32.478343   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:32.478581   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:32.674580   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:32.795361   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:32.977773   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:32.978278   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:33.194268   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:33.294387   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:33.479546   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:33.479743   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:33.674098   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:33.794115   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:33.978050   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:33.980589   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:34.174004   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:34.189273   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:34.294238   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:34.478532   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:34.479027   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:34.673564   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:34.794976   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:34.978356   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:34.979273   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:35.175562   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:35.295420   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:35.479570   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:35.479670   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:35.683078   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:36.066285   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:36.067285   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:36.069881   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:36.174782   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:36.295728   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:36.479467   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:36.480503   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:36.674860   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:36.691433   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:36.799854   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:36.981328   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:36.983112   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:37.173783   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:37.294027   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:37.477054   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0621 17:43:37.481292   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:37.673963   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:37.795009   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:37.979452   15966 kapi.go:107] duration metric: took 54.506967938s to wait for kubernetes.io/minikube-addons=registry ...

	I0621 17:43:37.980075   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:38.173542   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:38.294990   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:38.478275   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:38.673736   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:38.795481   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:38.978357   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:39.173869   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:39.189363   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:39.295293   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:39.478404   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:39.673962   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:39.795692   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:39.977143   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:40.173753   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:40.294291   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:40.478082   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:40.683399   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:40.794644   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:40.978826   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:41.173259   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:41.301562   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:41.478271   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:41.673781   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:41.692767   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:41.794699   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:41.985673   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:42.174635   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:42.294799   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:42.477774   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:42.673247   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:42.795914   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:42.978806   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:43.173973   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:43.294984   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:43.477904   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:43.673395   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:43.794494   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:43.977415   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:44.176355   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:44.188424   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:44.294544   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:44.477632   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:44.674798   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:44.794628   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:44.977482   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:45.174432   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:45.296436   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:45.478863   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:45.673578   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:45.795040   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:45.977706   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:46.192532   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:46.207958   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:46.298990   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:46.479693   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:46.676561   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:46.794876   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:46.981483   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:47.175696   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:47.297487   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:47.477571   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:47.674383   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:47.796230   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:47.980399   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:48.174137   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:48.294756   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:48.477284   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:48.677206   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:48.691172   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:48.796143   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:48.979294   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:49.175672   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:49.294911   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:49.479460   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:49.676324   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:49.797178   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:49.978055   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:50.173939   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:50.295538   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:50.783673   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:50.784312   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:50.788579   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:50.802037   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:50.978481   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:51.174656   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:51.294943   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:51.478362   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:51.678211   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:51.798555   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:51.977032   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:52.173906   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:52.294781   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:52.477978   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:52.674240   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:52.795131   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:52.978714   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:53.173548   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:53.189444   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:53.294210   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:53.478553   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:53.673712   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:53.795402   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:53.977968   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:54.330785   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:54.333591   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:54.477588   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:54.674481   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:54.794969   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:54.977973   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:55.175969   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:55.294833   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:55.478670   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:55.676962   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:55.691684   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:55.795117   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:55.977644   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:56.176225   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:56.294187   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:56.478294   15966 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0621 17:43:56.676667   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:56.795455   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:56.977661   15966 kapi.go:107] duration metric: took 1m13.504390194s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0621 17:43:57.173229   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:57.295520   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:57.673112   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:57.794805   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:58.173751   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:58.189339   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:43:58.294320   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:58.674160   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:58.795002   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:59.174318   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:43:59.294611   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:43:59.676102   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:00.239407   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:44:00.247917   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:00.249148   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:00.295878   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0621 17:44:00.674591   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:00.797566   15966 kapi.go:107] duration metric: took 1m14.006599614s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0621 17:44:00.799494   15966 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-299362 cluster.

	I0621 17:44:00.800830   15966 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0621 17:44:00.802396   15966 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0621 17:44:01.175969   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:01.674442   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:02.173247   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:02.675669   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:02.698380   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:03.174772   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:03.674164   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:04.174292   15966 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0621 17:44:04.673714   15966 kapi.go:107] duration metric: took 1m19.505578984s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0621 17:44:04.675679   15966 out.go:177] * Enabled addons: cloud-spanner, nvidia-device-plugin, ingress-dns, storage-provisioner-rancher, storage-provisioner, helm-tiller, inspektor-gadget, metrics-server, yakd, default-storageclass, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I0621 17:44:04.677311   15966 addons.go:510] duration metric: took 1m29.375305798s for enable addons: enabled=[cloud-spanner nvidia-device-plugin ingress-dns storage-provisioner-rancher storage-provisioner helm-tiller inspektor-gadget metrics-server yakd default-storageclass volumesnapshots registry ingress gcp-auth csi-hostpath-driver]

	I0621 17:44:05.189934   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:07.699152   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:10.189427   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:12.190529   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:14.191019   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:16.696604   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:19.189886   15966 pod_ready.go:102] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"False"

	I0621 17:44:20.689689   15966 pod_ready.go:92] pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace has status "Ready":"True"

	I0621 17:44:20.689711   15966 pod_ready.go:81] duration metric: took 1m38.006186795s for pod "metrics-server-c59844bb4-7bhms" in "kube-system" namespace to be "Ready" ...

	I0621 17:44:20.689722   15966 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-mqvml" in "kube-system" namespace to be "Ready" ...

	I0621 17:44:20.693780   15966 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-mqvml" in "kube-system" namespace has status "Ready":"True"

	I0621 17:44:20.693829   15966 pod_ready.go:81] duration metric: took 4.099075ms for pod "nvidia-device-plugin-daemonset-mqvml" in "kube-system" namespace to be "Ready" ...

	I0621 17:44:20.693847   15966 pod_ready.go:38] duration metric: took 1m39.947737623s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0621 17:44:20.693864   15966 api_server.go:52] waiting for apiserver process to appear ...

	I0621 17:44:20.693893   15966 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0621 17:44:20.693943   15966 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0621 17:44:20.746187   15966 cri.go:89] found id: "172afe1c8df78cb13c4d14aaa3e2c96955a434c495b931ec0025355728cc0c84"

	I0621 17:44:20.746210   15966 cri.go:89] found id: ""

	I0621 17:44:20.746217   15966 logs.go:276] 1 containers: [172afe1c8df78cb13c4d14aaa3e2c96955a434c495b931ec0025355728cc0c84]

	I0621 17:44:20.746259   15966 ssh_runner.go:195] Run: which crictl

	I0621 17:44:20.750551   15966 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0621 17:44:20.750606   15966 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0621 17:44:20.795548   15966 cri.go:89] found id: "903013fcca540f8bf0261458099a781f4f5a3d4f41a57a029a65b1a79085884f"

	I0621 17:44:20.795571   15966 cri.go:89] found id: ""

	I0621 17:44:20.795579   15966 logs.go:276] 1 containers: [903013fcca540f8bf0261458099a781f4f5a3d4f41a57a029a65b1a79085884f]

	I0621 17:44:20.795622   15966 ssh_runner.go:195] Run: which crictl

	I0621 17:44:20.800048   15966 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0621 17:44:20.800105   15966 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0621 17:44:20.837272   15966 cri.go:89] found id: "6c64fdd9272b3121b4e27f465daa7b64faa8d158e73909ea192346309140ef9a"

	I0621 17:44:20.837296   15966 cri.go:89] found id: ""

	I0621 17:44:20.837305   15966 logs.go:276] 1 containers: [6c64fdd9272b3121b4e27f465daa7b64faa8d158e73909ea192346309140ef9a]

	I0621 17:44:20.837349   15966 ssh_runner.go:195] Run: which crictl

	I0621 17:44:20.841825   15966 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0621 17:44:20.841900   15966 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0621 17:44:20.877916   15966 cri.go:89] found id: "9a1850def884a4ee493921bc6e0cf02cd984de3b810c1f4f58373179d9cdb59b"

	I0621 17:44:20.877953   15966 cri.go:89] found id: ""

	I0621 17:44:20.877960   15966 logs.go:276] 1 containers: [9a1850def884a4ee493921bc6e0cf02cd984de3b810c1f4f58373179d9cdb59b]

	I0621 17:44:20.878002   15966 ssh_runner.go:195] Run: which crictl

	I0621 17:44:20.881813   15966 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0621 17:44:20.881897   15966 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0621 17:44:20.924319   15966 cri.go:89] found id: "425ded3f5fbd127782447ba12f42c1d2d75dfc2a65d10c76feceeb8a17534377"

	I0621 17:44:20.924338   15966 cri.go:89] found id: ""

	I0621 17:44:20.924344   15966 logs.go:276] 1 containers: [425ded3f5fbd127782447ba12f42c1d2d75dfc2a65d10c76feceeb8a17534377]

	I0621 17:44:20.924387   15966 ssh_runner.go:195] Run: which crictl

	I0621 17:44:20.928248   15966 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0621 17:44:20.928329   15966 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0621 17:44:20.964969   15966 cri.go:89] found id: "39db13f3025dac0d47c10c12ef2c49faae53c5faf8f19f2c7934b1e8345a7b16"

	I0621 17:44:20.964993   15966 cri.go:89] found id: ""

	I0621 17:44:20.965000   15966 logs.go:276] 1 containers: [39db13f3025dac0d47c10c12ef2c49faae53c5faf8f19f2c7934b1e8345a7b16]

	I0621 17:44:20.965046   15966 ssh_runner.go:195] Run: which crictl

	I0621 17:44:20.969732   15966 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0621 17:44:20.969786   15966 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0621 17:44:21.020696   15966 cri.go:89] found id: ""

	I0621 17:44:21.020719   15966 logs.go:276] 0 containers: []

	W0621 17:44:21.020728   15966 logs.go:278] No container was found matching "kindnet"

	I0621 17:44:21.020738   15966 logs.go:123] Gathering logs for container status ...

	I0621 17:44:21.020753   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0621 17:44:21.066899   15966 logs.go:123] Gathering logs for describe nodes ...

	I0621 17:44:21.066932   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0621 17:44:21.204819   15966 logs.go:123] Gathering logs for etcd [903013fcca540f8bf0261458099a781f4f5a3d4f41a57a029a65b1a79085884f] ...

	I0621 17:44:21.204848   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 903013fcca540f8bf0261458099a781f4f5a3d4f41a57a029a65b1a79085884f"

	I0621 17:44:21.268619   15966 logs.go:123] Gathering logs for coredns [6c64fdd9272b3121b4e27f465daa7b64faa8d158e73909ea192346309140ef9a] ...

	I0621 17:44:21.268649   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6c64fdd9272b3121b4e27f465daa7b64faa8d158e73909ea192346309140ef9a"

	I0621 17:44:21.304783   15966 logs.go:123] Gathering logs for kube-scheduler [9a1850def884a4ee493921bc6e0cf02cd984de3b810c1f4f58373179d9cdb59b] ...

	I0621 17:44:21.304818   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9a1850def884a4ee493921bc6e0cf02cd984de3b810c1f4f58373179d9cdb59b"

	I0621 17:44:21.362492   15966 logs.go:123] Gathering logs for kube-proxy [425ded3f5fbd127782447ba12f42c1d2d75dfc2a65d10c76feceeb8a17534377] ...

	I0621 17:44:21.362523   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 425ded3f5fbd127782447ba12f42c1d2d75dfc2a65d10c76feceeb8a17534377"

	I0621 17:44:21.397649   15966 logs.go:123] Gathering logs for kube-controller-manager [39db13f3025dac0d47c10c12ef2c49faae53c5faf8f19f2c7934b1e8345a7b16] ...

	I0621 17:44:21.397680   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 39db13f3025dac0d47c10c12ef2c49faae53c5faf8f19f2c7934b1e8345a7b16"

	I0621 17:44:21.463414   15966 logs.go:123] Gathering logs for CRI-O ...

	I0621 17:44:21.463447   15966 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

** /stderr **

addons_test.go:112: out/minikube-linux-amd64 start -p addons-299362 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --addons=volcano --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: signal: killed

--- FAIL: TestAddons/Setup (2400.06s)

=== RUN   TestMultiControlPlane/serial/StartCluster

ha_test.go:101: (dbg) Run:  out/minikube-linux-amd64 start -p ha-406291 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=kvm2  --container-runtime=crio

ha_test.go:101: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p ha-406291 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=kvm2  --container-runtime=crio: exit status 80 (2m12.649039424s)

-- stdout --

	* [ha-406291] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=19112

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19112-8111/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19112-8111/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "ha-406291" primary control-plane node in "ha-406291" cluster

	* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring CNI (Container Networking Interface) ...

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	* Enabled addons: storage-provisioner, default-storageclass

	* Starting "ha-406291-m02" control-plane node in "ha-406291" cluster

	* Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	* Found network options:

	  - NO_PROXY=192.168.39.198

	* Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	  - env NO_PROXY=192.168.39.198

-- /stdout --

** stderr ** 

	I0621 18:26:42.447747   30068 out.go:291] Setting OutFile to fd 1 ...

	I0621 18:26:42.447858   30068 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 18:26:42.447867   30068 out.go:304] Setting ErrFile to fd 2...

	I0621 18:26:42.447871   30068 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 18:26:42.448064   30068 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19112-8111/.minikube/bin

	I0621 18:26:42.448611   30068 out.go:298] Setting JSON to false

	I0621 18:26:42.449397   30068 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":4100,"bootTime":1718990302,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0621 18:26:42.449454   30068 start.go:139] virtualization: kvm guest

	I0621 18:26:42.451750   30068 out.go:177] * [ha-406291] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0621 18:26:42.453097   30068 out.go:177]   - MINIKUBE_LOCATION=19112

	I0621 18:26:42.453116   30068 notify.go:220] Checking for updates...

	I0621 18:26:42.456195   30068 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0621 18:26:42.457398   30068 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:26:42.458579   30068 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.459798   30068 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0621 18:26:42.461088   30068 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0621 18:26:42.462525   30068 driver.go:392] Setting default libvirt URI to qemu:///system

	I0621 18:26:42.497263   30068 out.go:177] * Using the kvm2 driver based on user configuration

	I0621 18:26:42.498734   30068 start.go:297] selected driver: kvm2

	I0621 18:26:42.498753   30068 start.go:901] validating driver "kvm2" against <nil>

	I0621 18:26:42.498763   30068 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0621 18:26:42.499421   30068 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 18:26:42.499483   30068 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19112-8111/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0621 18:26:42.513772   30068 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0621 18:26:42.513840   30068 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0621 18:26:42.514036   30068 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0621 18:26:42.514063   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:26:42.514070   30068 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0621 18:26:42.514080   30068 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0621 18:26:42.514119   30068 start.go:340] cluster config:

	{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0621 18:26:42.514203   30068 iso.go:125] acquiring lock: {Name:mk9bcacef563c74661da696f2e2fb4463daf80f2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 18:26:42.515839   30068 out.go:177] * Starting "ha-406291" primary control-plane node in "ha-406291" cluster

	I0621 18:26:42.516925   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:26:42.516952   30068 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4

	I0621 18:26:42.516960   30068 cache.go:56] Caching tarball of preloaded images

	I0621 18:26:42.517025   30068 preload.go:173] Found /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0621 18:26:42.517035   30068 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio

	I0621 18:26:42.517302   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:26:42.517325   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json: {Name:mkd43eceea282503c79b6e4b90bbf7258fcf8b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:26:42.517445   30068 start.go:360] acquireMachinesLock for ha-406291: {Name:mkdb5ead19d46168ac3b04a7a163113221efea18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0621 18:26:42.517470   30068 start.go:364] duration metric: took 13.314µs to acquireMachinesLock for "ha-406291"

	I0621 18:26:42.517485   30068 start.go:93] Provisioning new machine with config: &{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:26:42.517531   30068 start.go:125] createHost starting for "" (driver="kvm2")

	I0621 18:26:42.518937   30068 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0621 18:26:42.519071   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:26:42.519109   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:26:42.533235   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36669

	I0621 18:26:42.533669   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:26:42.534312   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:26:42.534360   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:26:42.534665   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:26:42.534880   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:26:42.535018   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:26:42.535180   30068 start.go:159] libmachine.API.Create for "ha-406291" (driver="kvm2")

	I0621 18:26:42.535209   30068 client.go:168] LocalClient.Create starting

	I0621 18:26:42.535233   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem

	I0621 18:26:42.535267   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:26:42.535282   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:26:42.535339   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem

	I0621 18:26:42.535357   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:26:42.535367   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:26:42.535383   30068 main.go:141] libmachine: Running pre-create checks...

	I0621 18:26:42.535396   30068 main.go:141] libmachine: (ha-406291) Calling .PreCreateCheck

	I0621 18:26:42.535734   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:26:42.536101   30068 main.go:141] libmachine: Creating machine...

	I0621 18:26:42.536113   30068 main.go:141] libmachine: (ha-406291) Calling .Create

	I0621 18:26:42.536232   30068 main.go:141] libmachine: (ha-406291) Creating KVM machine...

	I0621 18:26:42.537484   30068 main.go:141] libmachine: (ha-406291) DBG | found existing default KVM network

	I0621 18:26:42.538310   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.538153   30091 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1e0}

	I0621 18:26:42.538339   30068 main.go:141] libmachine: (ha-406291) DBG | created network xml: 

	I0621 18:26:42.538346   30068 main.go:141] libmachine: (ha-406291) DBG | <network>

	I0621 18:26:42.538355   30068 main.go:141] libmachine: (ha-406291) DBG |   <name>mk-ha-406291</name>

	I0621 18:26:42.538371   30068 main.go:141] libmachine: (ha-406291) DBG |   <dns enable='no'/>

	I0621 18:26:42.538385   30068 main.go:141] libmachine: (ha-406291) DBG |   

	I0621 18:26:42.538392   30068 main.go:141] libmachine: (ha-406291) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0621 18:26:42.538400   30068 main.go:141] libmachine: (ha-406291) DBG |     <dhcp>

	I0621 18:26:42.538412   30068 main.go:141] libmachine: (ha-406291) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0621 18:26:42.538421   30068 main.go:141] libmachine: (ha-406291) DBG |     </dhcp>

	I0621 18:26:42.538439   30068 main.go:141] libmachine: (ha-406291) DBG |   </ip>

	I0621 18:26:42.538451   30068 main.go:141] libmachine: (ha-406291) DBG |   

	I0621 18:26:42.538458   30068 main.go:141] libmachine: (ha-406291) DBG | </network>

	I0621 18:26:42.538470   30068 main.go:141] libmachine: (ha-406291) DBG | 

	I0621 18:26:42.543401   30068 main.go:141] libmachine: (ha-406291) DBG | trying to create private KVM network mk-ha-406291 192.168.39.0/24...

	I0621 18:26:42.606041   30068 main.go:141] libmachine: (ha-406291) DBG | private KVM network mk-ha-406291 192.168.39.0/24 created

	I0621 18:26:42.606072   30068 main.go:141] libmachine: (ha-406291) Setting up store path in /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 ...

	I0621 18:26:42.606091   30068 main.go:141] libmachine: (ha-406291) Building disk image from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso

	I0621 18:26:42.606165   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.606075   30091 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.606280   30068 main.go:141] libmachine: (ha-406291) Downloading /home/jenkins/minikube-integration/19112-8111/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso...

	I0621 18:26:42.829374   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.829262   30091 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa...

	I0621 18:26:42.941790   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.941666   30091 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/ha-406291.rawdisk...

	I0621 18:26:42.941834   30068 main.go:141] libmachine: (ha-406291) DBG | Writing magic tar header

	I0621 18:26:42.941844   30068 main.go:141] libmachine: (ha-406291) DBG | Writing SSH key tar header

	I0621 18:26:42.941852   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.941778   30091 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 ...

	I0621 18:26:42.941909   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291

	I0621 18:26:42.941989   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 (perms=drwx------)

	I0621 18:26:42.942007   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines

	I0621 18:26:42.942019   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines (perms=drwxr-xr-x)

	I0621 18:26:42.942033   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube (perms=drwxr-xr-x)

	I0621 18:26:42.942053   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111 (perms=drwxrwxr-x)

	I0621 18:26:42.942060   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.942069   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111

	I0621 18:26:42.942075   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0621 18:26:42.942080   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0621 18:26:42.942088   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins

	I0621 18:26:42.942104   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0621 18:26:42.942117   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home

	I0621 18:26:42.942128   30068 main.go:141] libmachine: (ha-406291) DBG | Skipping /home - not owner

	I0621 18:26:42.942142   30068 main.go:141] libmachine: (ha-406291) Creating domain...

	I0621 18:26:42.943154   30068 main.go:141] libmachine: (ha-406291) define libvirt domain using xml: 

	I0621 18:26:42.943176   30068 main.go:141] libmachine: (ha-406291) <domain type='kvm'>

	I0621 18:26:42.943183   30068 main.go:141] libmachine: (ha-406291)   <name>ha-406291</name>

	I0621 18:26:42.943188   30068 main.go:141] libmachine: (ha-406291)   <memory unit='MiB'>2200</memory>

	I0621 18:26:42.943199   30068 main.go:141] libmachine: (ha-406291)   <vcpu>2</vcpu>

	I0621 18:26:42.943203   30068 main.go:141] libmachine: (ha-406291)   <features>

	I0621 18:26:42.943208   30068 main.go:141] libmachine: (ha-406291)     <acpi/>

	I0621 18:26:42.943212   30068 main.go:141] libmachine: (ha-406291)     <apic/>

	I0621 18:26:42.943217   30068 main.go:141] libmachine: (ha-406291)     <pae/>

	I0621 18:26:42.943223   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943229   30068 main.go:141] libmachine: (ha-406291)   </features>

	I0621 18:26:42.943234   30068 main.go:141] libmachine: (ha-406291)   <cpu mode='host-passthrough'>

	I0621 18:26:42.943255   30068 main.go:141] libmachine: (ha-406291)   

	I0621 18:26:42.943266   30068 main.go:141] libmachine: (ha-406291)   </cpu>

	I0621 18:26:42.943284   30068 main.go:141] libmachine: (ha-406291)   <os>

	I0621 18:26:42.943318   30068 main.go:141] libmachine: (ha-406291)     <type>hvm</type>

	I0621 18:26:42.943328   30068 main.go:141] libmachine: (ha-406291)     <boot dev='cdrom'/>

	I0621 18:26:42.943333   30068 main.go:141] libmachine: (ha-406291)     <boot dev='hd'/>

	I0621 18:26:42.943341   30068 main.go:141] libmachine: (ha-406291)     <bootmenu enable='no'/>

	I0621 18:26:42.943345   30068 main.go:141] libmachine: (ha-406291)   </os>

	I0621 18:26:42.943355   30068 main.go:141] libmachine: (ha-406291)   <devices>

	I0621 18:26:42.943360   30068 main.go:141] libmachine: (ha-406291)     <disk type='file' device='cdrom'>

	I0621 18:26:42.943371   30068 main.go:141] libmachine: (ha-406291)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/boot2docker.iso'/>

	I0621 18:26:42.943384   30068 main.go:141] libmachine: (ha-406291)       <target dev='hdc' bus='scsi'/>

	I0621 18:26:42.943397   30068 main.go:141] libmachine: (ha-406291)       <readonly/>

	I0621 18:26:42.943404   30068 main.go:141] libmachine: (ha-406291)     </disk>

	I0621 18:26:42.943417   30068 main.go:141] libmachine: (ha-406291)     <disk type='file' device='disk'>

	I0621 18:26:42.943429   30068 main.go:141] libmachine: (ha-406291)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0621 18:26:42.943445   30068 main.go:141] libmachine: (ha-406291)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/ha-406291.rawdisk'/>

	I0621 18:26:42.943456   30068 main.go:141] libmachine: (ha-406291)       <target dev='hda' bus='virtio'/>

	I0621 18:26:42.943478   30068 main.go:141] libmachine: (ha-406291)     </disk>

	I0621 18:26:42.943499   30068 main.go:141] libmachine: (ha-406291)     <interface type='network'>

	I0621 18:26:42.943509   30068 main.go:141] libmachine: (ha-406291)       <source network='mk-ha-406291'/>

	I0621 18:26:42.943513   30068 main.go:141] libmachine: (ha-406291)       <model type='virtio'/>

	I0621 18:26:42.943519   30068 main.go:141] libmachine: (ha-406291)     </interface>

	I0621 18:26:42.943526   30068 main.go:141] libmachine: (ha-406291)     <interface type='network'>

	I0621 18:26:42.943532   30068 main.go:141] libmachine: (ha-406291)       <source network='default'/>

	I0621 18:26:42.943539   30068 main.go:141] libmachine: (ha-406291)       <model type='virtio'/>

	I0621 18:26:42.943544   30068 main.go:141] libmachine: (ha-406291)     </interface>

	I0621 18:26:42.943549   30068 main.go:141] libmachine: (ha-406291)     <serial type='pty'>

	I0621 18:26:42.943554   30068 main.go:141] libmachine: (ha-406291)       <target port='0'/>

	I0621 18:26:42.943560   30068 main.go:141] libmachine: (ha-406291)     </serial>

	I0621 18:26:42.943565   30068 main.go:141] libmachine: (ha-406291)     <console type='pty'>

	I0621 18:26:42.943571   30068 main.go:141] libmachine: (ha-406291)       <target type='serial' port='0'/>

	I0621 18:26:42.943583   30068 main.go:141] libmachine: (ha-406291)     </console>

	I0621 18:26:42.943593   30068 main.go:141] libmachine: (ha-406291)     <rng model='virtio'>

	I0621 18:26:42.943602   30068 main.go:141] libmachine: (ha-406291)       <backend model='random'>/dev/random</backend>

	I0621 18:26:42.943609   30068 main.go:141] libmachine: (ha-406291)     </rng>

	I0621 18:26:42.943617   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943621   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943627   30068 main.go:141] libmachine: (ha-406291)   </devices>

	I0621 18:26:42.943631   30068 main.go:141] libmachine: (ha-406291) </domain>

	I0621 18:26:42.943638   30068 main.go:141] libmachine: (ha-406291) 

	I0621 18:26:42.948298   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:44:10:c4 in network default

	I0621 18:26:42.948968   30068 main.go:141] libmachine: (ha-406291) Ensuring networks are active...

	I0621 18:26:42.948988   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:42.949710   30068 main.go:141] libmachine: (ha-406291) Ensuring network default is active

	I0621 18:26:42.950033   30068 main.go:141] libmachine: (ha-406291) Ensuring network mk-ha-406291 is active

	I0621 18:26:42.950493   30068 main.go:141] libmachine: (ha-406291) Getting domain xml...

	I0621 18:26:42.951151   30068 main.go:141] libmachine: (ha-406291) Creating domain...

	I0621 18:26:44.128421   30068 main.go:141] libmachine: (ha-406291) Waiting to get IP...

	I0621 18:26:44.129183   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.129530   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.129550   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.129513   30091 retry.go:31] will retry after 273.280189ms: waiting for machine to come up

	I0621 18:26:44.404590   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.405440   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.405467   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.405386   30091 retry.go:31] will retry after 363.287979ms: waiting for machine to come up

	I0621 18:26:44.769749   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.770188   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.770217   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.770146   30091 retry.go:31] will retry after 445.9009ms: waiting for machine to come up

	I0621 18:26:45.217708   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:45.218113   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:45.218132   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:45.218075   30091 retry.go:31] will retry after 497.769852ms: waiting for machine to come up

	I0621 18:26:45.717913   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:45.718380   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:45.718402   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:45.718333   30091 retry.go:31] will retry after 609.412902ms: waiting for machine to come up

	I0621 18:26:46.329589   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:46.330043   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:46.330077   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:46.330033   30091 retry.go:31] will retry after 668.226784ms: waiting for machine to come up

	I0621 18:26:46.999851   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:47.000352   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:47.000399   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:47.000310   30091 retry.go:31] will retry after 928.90777ms: waiting for machine to come up

	I0621 18:26:47.931043   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:47.931568   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:47.931598   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:47.931527   30091 retry.go:31] will retry after 1.407643188s: waiting for machine to come up

	I0621 18:26:49.341126   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:49.341529   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:49.341557   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:49.341489   30091 retry.go:31] will retry after 1.657120945s: waiting for machine to come up

	I0621 18:26:51.001518   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:51.001999   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:51.002022   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:51.001955   30091 retry.go:31] will retry after 1.506025988s: waiting for machine to come up

	I0621 18:26:52.509823   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:52.510314   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:52.510342   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:52.510269   30091 retry.go:31] will retry after 2.859818514s: waiting for machine to come up

	I0621 18:26:55.371181   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:55.371726   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:55.371755   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:55.371678   30091 retry.go:31] will retry after 3.374080501s: waiting for machine to come up

	I0621 18:26:58.747494   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:58.748019   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:58.748039   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:58.747991   30091 retry.go:31] will retry after 4.386740875s: waiting for machine to come up

	I0621 18:27:03.136546   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.137046   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has current primary IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.137063   30068 main.go:141] libmachine: (ha-406291) Found IP for machine: 192.168.39.198

	I0621 18:27:03.137079   30068 main.go:141] libmachine: (ha-406291) Reserving static IP address...

	I0621 18:27:03.137427   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find host DHCP lease matching {name: "ha-406291", mac: "52:54:00:38:dc:46", ip: "192.168.39.198"} in network mk-ha-406291

	I0621 18:27:03.211473   30068 main.go:141] libmachine: (ha-406291) DBG | Getting to WaitForSSH function...

	I0621 18:27:03.211506   30068 main.go:141] libmachine: (ha-406291) Reserved static IP address: 192.168.39.198

	I0621 18:27:03.211519   30068 main.go:141] libmachine: (ha-406291) Waiting for SSH to be available...

	I0621 18:27:03.214029   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.214477   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291

	I0621 18:27:03.214509   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find defined IP address of network mk-ha-406291 interface with MAC address 52:54:00:38:dc:46

	I0621 18:27:03.214661   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH client type: external

	I0621 18:27:03.214702   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa (-rw-------)

	I0621 18:27:03.214745   30068 main.go:141] libmachine: (ha-406291) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:03.214771   30068 main.go:141] libmachine: (ha-406291) DBG | About to run SSH command:

	I0621 18:27:03.214784   30068 main.go:141] libmachine: (ha-406291) DBG | exit 0

	I0621 18:27:03.218578   30068 main.go:141] libmachine: (ha-406291) DBG | SSH cmd err, output: exit status 255: 

	I0621 18:27:03.218603   30068 main.go:141] libmachine: (ha-406291) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0621 18:27:03.218614   30068 main.go:141] libmachine: (ha-406291) DBG | command : exit 0

	I0621 18:27:03.218630   30068 main.go:141] libmachine: (ha-406291) DBG | err     : exit status 255

	I0621 18:27:03.218643   30068 main.go:141] libmachine: (ha-406291) DBG | output  : 

	I0621 18:27:06.220803   30068 main.go:141] libmachine: (ha-406291) DBG | Getting to WaitForSSH function...

	I0621 18:27:06.223287   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.223552   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.223591   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.223725   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH client type: external

	I0621 18:27:06.223751   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa (-rw-------)

	I0621 18:27:06.223775   30068 main.go:141] libmachine: (ha-406291) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.198 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:06.223788   30068 main.go:141] libmachine: (ha-406291) DBG | About to run SSH command:

	I0621 18:27:06.223797   30068 main.go:141] libmachine: (ha-406291) DBG | exit 0

	I0621 18:27:06.345962   30068 main.go:141] libmachine: (ha-406291) DBG | SSH cmd err, output: <nil>: 

	I0621 18:27:06.346198   30068 main.go:141] libmachine: (ha-406291) KVM machine creation complete!

	I0621 18:27:06.346530   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:27:06.347151   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:06.347376   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:06.347539   30068 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0621 18:27:06.347553   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:06.349257   30068 main.go:141] libmachine: Detecting operating system of created instance...

	I0621 18:27:06.349272   30068 main.go:141] libmachine: Waiting for SSH to be available...

	I0621 18:27:06.349278   30068 main.go:141] libmachine: Getting to WaitForSSH function...

	I0621 18:27:06.349284   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.351365   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.351709   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.351738   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.351848   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.352053   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.352215   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.352441   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.352676   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.352926   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.352939   30068 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0621 18:27:06.449038   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:06.449066   30068 main.go:141] libmachine: Detecting the provisioner...

	I0621 18:27:06.449077   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.451811   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.452202   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.452223   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.452405   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.452602   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.452762   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.452898   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.453074   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.453321   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.453334   30068 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0621 18:27:06.550539   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0621 18:27:06.550611   30068 main.go:141] libmachine: found compatible host: buildroot

	I0621 18:27:06.550618   30068 main.go:141] libmachine: Provisioning with buildroot...

	I0621 18:27:06.550625   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.550871   30068 buildroot.go:166] provisioning hostname "ha-406291"

	I0621 18:27:06.550891   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.551068   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.553701   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.554112   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.554138   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.554279   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.554452   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.554601   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.554725   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.554869   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.555029   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.555040   30068 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-406291 && echo "ha-406291" | sudo tee /etc/hostname

	I0621 18:27:06.664012   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-406291

	I0621 18:27:06.664038   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.666600   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.666923   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.666952   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.667091   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.667277   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.667431   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.667559   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.667745   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.667932   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.667949   30068 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-406291' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-406291/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-406291' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0621 18:27:06.778156   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:06.778199   30068 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19112-8111/.minikube CaCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19112-8111/.minikube}

	I0621 18:27:06.778224   30068 buildroot.go:174] setting up certificates

	I0621 18:27:06.778237   30068 provision.go:84] configureAuth start

	I0621 18:27:06.778250   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.778526   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:06.781267   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.781583   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.781610   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.781773   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.784225   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.784546   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.784564   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.784717   30068 provision.go:143] copyHostCerts

	I0621 18:27:06.784747   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:06.784796   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem, removing ...

	I0621 18:27:06.784813   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:06.784893   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem (1675 bytes)

	I0621 18:27:06.784992   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:06.785017   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem, removing ...

	I0621 18:27:06.785023   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:06.785064   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem (1082 bytes)

	I0621 18:27:06.785126   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:06.785153   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem, removing ...

	I0621 18:27:06.785162   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:06.785194   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem (1123 bytes)

	I0621 18:27:06.785257   30068 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem org=jenkins.ha-406291 san=[127.0.0.1 192.168.39.198 ha-406291 localhost minikube]

	I0621 18:27:06.904910   30068 provision.go:177] copyRemoteCerts

	I0621 18:27:06.904976   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0621 18:27:06.905004   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.907600   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.907883   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.907916   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.908115   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.908308   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.908462   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.908599   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:06.987463   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0621 18:27:06.987540   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0621 18:27:07.009572   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0621 18:27:07.009661   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)

	I0621 18:27:07.031219   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0621 18:27:07.031333   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0621 18:27:07.052682   30068 provision.go:87] duration metric: took 274.433059ms to configureAuth

	I0621 18:27:07.052709   30068 buildroot.go:189] setting minikube options for container-runtime

	I0621 18:27:07.052895   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:07.052984   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.055368   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.055720   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.055742   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.055971   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.056161   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.056324   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.056453   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.056615   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:07.056785   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:07.056814   30068 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0621 18:27:07.307055   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0621 18:27:07.307083   30068 main.go:141] libmachine: Checking connection to Docker...

	I0621 18:27:07.307105   30068 main.go:141] libmachine: (ha-406291) Calling .GetURL

	I0621 18:27:07.308373   30068 main.go:141] libmachine: (ha-406291) DBG | Using libvirt version 6000000

	I0621 18:27:07.310322   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.310631   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.310658   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.310756   30068 main.go:141] libmachine: Docker is up and running!

	I0621 18:27:07.310768   30068 main.go:141] libmachine: Reticulating splines...

	I0621 18:27:07.310774   30068 client.go:171] duration metric: took 24.775558818s to LocalClient.Create

	I0621 18:27:07.310795   30068 start.go:167] duration metric: took 24.775614868s to libmachine.API.Create "ha-406291"

	I0621 18:27:07.310807   30068 start.go:293] postStartSetup for "ha-406291" (driver="kvm2")

	I0621 18:27:07.310818   30068 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0621 18:27:07.310835   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.311186   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0621 18:27:07.311208   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.313308   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.313543   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.313581   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.313682   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.313855   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.314042   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.314209   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.391859   30068 ssh_runner.go:195] Run: cat /etc/os-release

	I0621 18:27:07.396062   30068 info.go:137] Remote host: Buildroot 2023.02.9

	I0621 18:27:07.396083   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/addons for local assets ...

	I0621 18:27:07.396132   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/files for local assets ...

	I0621 18:27:07.396193   30068 filesync.go:149] local asset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> 153292.pem in /etc/ssl/certs

	I0621 18:27:07.396202   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /etc/ssl/certs/153292.pem

	I0621 18:27:07.396289   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0621 18:27:07.405435   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:07.427927   30068 start.go:296] duration metric: took 117.075834ms for postStartSetup

	I0621 18:27:07.427984   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:27:07.428562   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:07.431157   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.431479   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.431523   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.431791   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:07.431969   30068 start.go:128] duration metric: took 24.914429669s to createHost

	I0621 18:27:07.431990   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.434121   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.434421   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.434445   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.434510   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.434692   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.434865   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.435009   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.435168   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:07.435372   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:07.435384   30068 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0621 18:27:07.530141   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718994427.508226463

	I0621 18:27:07.530165   30068 fix.go:216] guest clock: 1718994427.508226463

	I0621 18:27:07.530173   30068 fix.go:229] Guest: 2024-06-21 18:27:07.508226463 +0000 UTC Remote: 2024-06-21 18:27:07.431981059 +0000 UTC m=+25.016949864 (delta=76.245404ms)

	I0621 18:27:07.530199   30068 fix.go:200] guest clock delta is within tolerance: 76.245404ms

	I0621 18:27:07.530204   30068 start.go:83] releasing machines lock for "ha-406291", held for 25.012726918s

	I0621 18:27:07.530222   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.530466   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:07.532753   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.533110   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.533151   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.533275   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533702   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533877   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533978   30068 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0621 18:27:07.534028   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.534087   30068 ssh_runner.go:195] Run: cat /version.json

	I0621 18:27:07.534115   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.536489   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536798   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.536828   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536845   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536983   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.537154   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.537312   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.537330   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.537337   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.537509   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.537507   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.537675   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.537830   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.537968   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.610886   30068 ssh_runner.go:195] Run: systemctl --version

	I0621 18:27:07.648150   30068 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0621 18:27:07.798080   30068 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0621 18:27:07.803683   30068 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0621 18:27:07.803731   30068 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0621 18:27:07.820345   30068 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0621 18:27:07.820363   30068 start.go:494] detecting cgroup driver to use...

	I0621 18:27:07.820412   30068 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0621 18:27:07.835960   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0621 18:27:07.849269   30068 docker.go:217] disabling cri-docker service (if available) ...

	I0621 18:27:07.849324   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0621 18:27:07.861858   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0621 18:27:07.874371   30068 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0621 18:27:07.984965   30068 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0621 18:27:08.126897   30068 docker.go:233] disabling docker service ...

	I0621 18:27:08.126973   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0621 18:27:08.140294   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0621 18:27:08.152460   30068 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0621 18:27:08.289101   30068 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0621 18:27:08.414578   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0621 18:27:08.428193   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0621 18:27:08.445335   30068 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0621 18:27:08.445406   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.454715   30068 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0621 18:27:08.454780   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.464286   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.473688   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.483215   30068 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0621 18:27:08.492907   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.502386   30068 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.518138   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.527822   30068 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0621 18:27:08.536491   30068 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0621 18:27:08.536537   30068 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0621 18:27:08.548343   30068 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0621 18:27:08.557395   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:27:08.668782   30068 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0621 18:27:08.793146   30068 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0621 18:27:08.793228   30068 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0621 18:27:08.797886   30068 start.go:562] Will wait 60s for crictl version

	I0621 18:27:08.797933   30068 ssh_runner.go:195] Run: which crictl

	I0621 18:27:08.801183   30068 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0621 18:27:08.838953   30068 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0621 18:27:08.839028   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:27:08.865047   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:27:08.892059   30068 out.go:177] * Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	I0621 18:27:08.893365   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:08.895801   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:08.896174   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:08.896198   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:08.896377   30068 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0621 18:27:08.900124   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:27:08.912152   30068 kubeadm.go:877] updating cluster {Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0621 18:27:08.912252   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:27:08.912299   30068 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 18:27:08.941267   30068 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.2". assuming images are not preloaded.

	I0621 18:27:08.941328   30068 ssh_runner.go:195] Run: which lz4

	I0621 18:27:08.944757   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0621 18:27:08.944843   30068 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0621 18:27:08.948482   30068 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0621 18:27:08.948507   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (395071426 bytes)

	I0621 18:27:10.186487   30068 crio.go:462] duration metric: took 1.241671996s to copy over tarball

	I0621 18:27:10.186568   30068 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0621 18:27:12.219224   30068 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.032622286s)

	I0621 18:27:12.219256   30068 crio.go:469] duration metric: took 2.032747658s to extract the tarball

	I0621 18:27:12.219265   30068 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0621 18:27:12.255526   30068 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 18:27:12.297692   30068 crio.go:514] all images are preloaded for cri-o runtime.

	I0621 18:27:12.297715   30068 cache_images.go:84] Images are preloaded, skipping loading

	I0621 18:27:12.297725   30068 kubeadm.go:928] updating node { 192.168.39.198 8443 v1.30.2 crio true true} ...

	I0621 18:27:12.297863   30068 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-406291 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.198

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0621 18:27:12.297956   30068 ssh_runner.go:195] Run: crio config

	I0621 18:27:12.347243   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:27:12.347276   30068 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0621 18:27:12.347288   30068 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0621 18:27:12.347314   30068 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.198 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-406291 NodeName:ha-406291 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.198"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.198 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0621 18:27:12.347487   30068 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.198

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-406291"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.198

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.198"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0621 18:27:12.347514   30068 kube-vip.go:115] generating kube-vip config ...

	I0621 18:27:12.347563   30068 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0621 18:27:12.362180   30068 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0621 18:27:12.362273   30068 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0621 18:27:12.362316   30068 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0621 18:27:12.371448   30068 binaries.go:44] Found k8s binaries, skipping transfer

	I0621 18:27:12.371499   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0621 18:27:12.380031   30068 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0621 18:27:12.395354   30068 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0621 18:27:12.410533   30068 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0621 18:27:12.425474   30068 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0621 18:27:12.440059   30068 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0621 18:27:12.443523   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:27:12.454828   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:27:12.572486   30068 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0621 18:27:12.589057   30068 certs.go:68] Setting up /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291 for IP: 192.168.39.198

	I0621 18:27:12.589078   30068 certs.go:194] generating shared ca certs ...

	I0621 18:27:12.589095   30068 certs.go:226] acquiring lock for ca certs: {Name:mk96df7d45efa699c355b4c4409471361aa3f418 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.589221   30068 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key

	I0621 18:27:12.589272   30068 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key

	I0621 18:27:12.589282   30068 certs.go:256] generating profile certs ...

	I0621 18:27:12.589333   30068 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key

	I0621 18:27:12.589346   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt with IP's: []

	I0621 18:27:12.759863   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt ...

	I0621 18:27:12.759890   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt: {Name:mk1350197087e6f37ca28e80a43c199beace4f91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.760090   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key ...

	I0621 18:27:12.760104   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key: {Name:mk90994b992a268304b337419707e3332d3f039a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.760206   30068 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92

	I0621 18:27:12.760222   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.198 192.168.39.254]

	I0621 18:27:13.132336   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 ...

	I0621 18:27:13.132362   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92: {Name:mke7daa70ff2d7bf8fa87eea51b1ed6731c0dd6d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.132530   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92 ...

	I0621 18:27:13.132546   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92: {Name:mk310235904dba1c4db66ef73b8dcc06ff030051 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.132647   30068 certs.go:381] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt

	I0621 18:27:13.132737   30068 certs.go:385] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key

	I0621 18:27:13.132790   30068 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key

	I0621 18:27:13.132806   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt with IP's: []

	I0621 18:27:13.317891   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt ...

	I0621 18:27:13.317927   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt: {Name:mk5e450ef3633fa54e81eaeb94f9408c94729912 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.318119   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key ...

	I0621 18:27:13.318132   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key: {Name:mk3a1443924b05c36251566d5313d0eeb467e0fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.318220   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0621 18:27:13.318241   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0621 18:27:13.318251   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0621 18:27:13.318264   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0621 18:27:13.318274   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0621 18:27:13.318290   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0621 18:27:13.318302   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0621 18:27:13.318314   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0621 18:27:13.318363   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem (1338 bytes)

	W0621 18:27:13.318396   30068 certs.go:480] ignoring /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329_empty.pem, impossibly tiny 0 bytes

	I0621 18:27:13.318406   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem (1675 bytes)

	I0621 18:27:13.318428   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem (1082 bytes)

	I0621 18:27:13.318449   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem (1123 bytes)

	I0621 18:27:13.318469   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem (1675 bytes)

	I0621 18:27:13.318506   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:13.318531   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.318544   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.318556   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem -> /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.319121   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0621 18:27:13.345382   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0621 18:27:13.379289   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0621 18:27:13.406853   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0621 18:27:13.430624   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0621 18:27:13.452498   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0621 18:27:13.474381   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0621 18:27:13.497475   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0621 18:27:13.520548   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /usr/share/ca-certificates/153292.pem (1708 bytes)

	I0621 18:27:13.543849   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0621 18:27:13.569722   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem --> /usr/share/ca-certificates/15329.pem (1338 bytes)

	I0621 18:27:13.594191   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0621 18:27:13.611312   30068 ssh_runner.go:195] Run: openssl version

	I0621 18:27:13.616881   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15329.pem && ln -fs /usr/share/ca-certificates/15329.pem /etc/ssl/certs/15329.pem"

	I0621 18:27:13.627054   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.631162   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 21 18:22 /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.631214   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.636845   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15329.pem /etc/ssl/certs/51391683.0"

	I0621 18:27:13.648132   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/153292.pem && ln -fs /usr/share/ca-certificates/153292.pem /etc/ssl/certs/153292.pem"

	I0621 18:27:13.658846   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.663074   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 21 18:22 /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.663140   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.668358   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/153292.pem /etc/ssl/certs/3ec20f2e.0"

	I0621 18:27:13.678369   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0621 18:27:13.688293   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.692517   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 21 17:42 /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.692581   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.697837   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0621 18:27:13.707967   30068 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0621 18:27:13.711761   30068 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0621 18:27:13.711821   30068 kubeadm.go:391] StartCluster: {Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0621 18:27:13.711887   30068 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0621 18:27:13.711960   30068 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0621 18:27:13.752929   30068 cri.go:89] found id: ""

	I0621 18:27:13.753017   30068 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0621 18:27:13.762514   30068 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0621 18:27:13.771612   30068 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0621 18:27:13.781740   30068 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0621 18:27:13.781758   30068 kubeadm.go:156] found existing configuration files:

	I0621 18:27:13.781811   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0621 18:27:13.790876   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0621 18:27:13.790943   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0621 18:27:13.800011   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0621 18:27:13.809117   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0621 18:27:13.809168   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0621 18:27:13.818279   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0621 18:27:13.827522   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0621 18:27:13.827584   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0621 18:27:13.836671   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0621 18:27:13.845242   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0621 18:27:13.845298   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0621 18:27:13.854365   30068 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0621 18:27:13.951888   30068 kubeadm.go:309] [init] Using Kubernetes version: v1.30.2

	I0621 18:27:13.951970   30068 kubeadm.go:309] [preflight] Running pre-flight checks

	I0621 18:27:14.081675   30068 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0621 18:27:14.081845   30068 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0621 18:27:14.081983   30068 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0621 18:27:14.292951   30068 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0621 18:27:14.423174   30068 out.go:204]   - Generating certificates and keys ...

	I0621 18:27:14.423287   30068 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0621 18:27:14.423355   30068 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0621 18:27:14.524306   30068 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0621 18:27:14.693249   30068 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0621 18:27:14.771462   30068 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0621 18:27:14.965492   30068 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0621 18:27:15.095342   30068 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0621 18:27:15.095646   30068 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-406291 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]

	I0621 18:27:15.247328   30068 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0621 18:27:15.247729   30068 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-406291 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]

	I0621 18:27:15.326656   30068 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0621 18:27:15.470979   30068 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0621 18:27:15.620090   30068 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0621 18:27:15.620402   30068 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0621 18:27:15.715693   30068 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0621 18:27:16.259484   30068 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0621 18:27:16.704626   30068 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0621 18:27:16.836633   30068 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0621 18:27:16.996818   30068 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0621 18:27:16.997517   30068 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0621 18:27:16.999949   30068 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0621 18:27:17.001874   30068 out.go:204]   - Booting up control plane ...

	I0621 18:27:17.001982   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0621 18:27:17.002874   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0621 18:27:17.003729   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0621 18:27:17.018894   30068 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0621 18:27:17.019816   30068 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0621 18:27:17.019944   30068 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0621 18:27:17.138099   30068 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0621 18:27:17.138195   30068 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0621 18:27:17.639115   30068 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 501.282189ms

	I0621 18:27:17.639214   30068 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0621 18:27:23.502026   30068 kubeadm.go:309] [api-check] The API server is healthy after 5.864418149s

	I0621 18:27:23.512938   30068 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0621 18:27:23.528670   30068 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0621 18:27:24.059886   30068 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0621 18:27:24.060060   30068 kubeadm.go:309] [mark-control-plane] Marking the node ha-406291 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0621 18:27:24.071607   30068 kubeadm.go:309] [bootstrap-token] Using token: ha2utu.p9k0bq1xsr5791t7

	I0621 18:27:24.073185   30068 out.go:204]   - Configuring RBAC rules ...

	I0621 18:27:24.073336   30068 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0621 18:27:24.084336   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0621 18:27:24.092265   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0621 18:27:24.096415   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0621 18:27:24.101175   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0621 18:27:24.104689   30068 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0621 18:27:24.121568   30068 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0621 18:27:24.349610   30068 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0621 18:27:24.907607   30068 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0621 18:27:24.908452   30068 kubeadm.go:309] 

	I0621 18:27:24.908529   30068 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0621 18:27:24.908541   30068 kubeadm.go:309] 

	I0621 18:27:24.908607   30068 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0621 18:27:24.908645   30068 kubeadm.go:309] 

	I0621 18:27:24.908698   30068 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0621 18:27:24.908780   30068 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0621 18:27:24.908863   30068 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0621 18:27:24.908873   30068 kubeadm.go:309] 

	I0621 18:27:24.908975   30068 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0621 18:27:24.908993   30068 kubeadm.go:309] 

	I0621 18:27:24.909038   30068 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0621 18:27:24.909045   30068 kubeadm.go:309] 

	I0621 18:27:24.909086   30068 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0621 18:27:24.909160   30068 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0621 18:27:24.909256   30068 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0621 18:27:24.909274   30068 kubeadm.go:309] 

	I0621 18:27:24.909401   30068 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0621 18:27:24.909522   30068 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0621 18:27:24.909544   30068 kubeadm.go:309] 

	I0621 18:27:24.909671   30068 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token ha2utu.p9k0bq1xsr5791t7 \

	I0621 18:27:24.909771   30068 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df \

	I0621 18:27:24.909810   30068 kubeadm.go:309] 	--control-plane 

	I0621 18:27:24.909824   30068 kubeadm.go:309] 

	I0621 18:27:24.909898   30068 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0621 18:27:24.909904   30068 kubeadm.go:309] 

	I0621 18:27:24.909977   30068 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ha2utu.p9k0bq1xsr5791t7 \

	I0621 18:27:24.910064   30068 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df 

	I0621 18:27:24.910664   30068 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0621 18:27:24.910700   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:27:24.910708   30068 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0621 18:27:24.912398   30068 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0621 18:27:24.913676   30068 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0621 18:27:24.919660   30068 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.2/kubectl ...

	I0621 18:27:24.919677   30068 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0621 18:27:24.938734   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0621 18:27:25.303975   30068 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0621 18:27:25.304070   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:25.304073   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-406291 minikube.k8s.io/updated_at=2024_06_21T18_27_25_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=1a0d377c34faa85740cf2404ea12566198300600 minikube.k8s.io/name=ha-406291 minikube.k8s.io/primary=true

	I0621 18:27:25.334777   30068 ops.go:34] apiserver oom_adj: -16

	I0621 18:27:25.436873   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:25.937461   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:26.436991   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:26.937206   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:27.437152   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:27.937860   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:28.437177   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:28.937036   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:29.437007   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:29.937140   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:30.437060   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:30.937199   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:31.437695   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:31.937675   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:32.437034   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:32.937808   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:33.437793   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:33.937401   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:34.437307   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:34.937172   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:35.437428   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:35.937146   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:36.436951   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:36.937873   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:37.039583   30068 kubeadm.go:1107] duration metric: took 11.735587948s to wait for elevateKubeSystemPrivileges

	W0621 18:27:37.039626   30068 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0621 18:27:37.039635   30068 kubeadm.go:393] duration metric: took 23.327819322s to StartCluster

	I0621 18:27:37.039654   30068 settings.go:142] acquiring lock: {Name:mkdbb660cad4d8fb446e5c2ca4439ea3326e9592 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:37.039737   30068 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:27:37.040362   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/kubeconfig: {Name:mk87038194ab41f67dd50d90b017d32a83c3da4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:37.040584   30068 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:27:37.040604   30068 start.go:240] waiting for startup goroutines ...

	I0621 18:27:37.040603   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0621 18:27:37.040612   30068 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0621 18:27:37.040669   30068 addons.go:69] Setting storage-provisioner=true in profile "ha-406291"

	I0621 18:27:37.040677   30068 addons.go:69] Setting default-storageclass=true in profile "ha-406291"

	I0621 18:27:37.040699   30068 addons.go:234] Setting addon storage-provisioner=true in "ha-406291"

	I0621 18:27:37.040730   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:27:37.040700   30068 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-406291"

	I0621 18:27:37.040772   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:37.041052   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.041075   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.041146   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.041174   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.055583   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42699

	I0621 18:27:37.056062   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.056549   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.056570   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.056894   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.057371   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.057399   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.061343   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44857

	I0621 18:27:37.061846   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.062393   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.062418   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.062721   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.062885   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.065021   30068 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:27:37.065351   30068 kapi.go:59] client config for ha-406291: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt", KeyFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key", CAFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cf98a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0621 18:27:37.065825   30068 cert_rotation.go:137] Starting client certificate rotation controller

	I0621 18:27:37.066065   30068 addons.go:234] Setting addon default-storageclass=true in "ha-406291"

	I0621 18:27:37.066106   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:27:37.066471   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.066512   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.072759   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39433

	I0621 18:27:37.073274   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.073791   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.073819   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.074169   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.074346   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.076096   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:37.078312   30068 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0621 18:27:37.079815   30068 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 18:27:37.079840   30068 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0621 18:27:37.079864   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:37.081896   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41569

	I0621 18:27:37.082293   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.082859   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.082878   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.083163   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.083202   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.083607   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.083648   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.083733   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:37.083752   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.083817   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:37.083990   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:37.084135   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:37.084288   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:37.103512   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42081

	I0621 18:27:37.103937   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.104456   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.104473   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.104853   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.105052   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.106976   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:37.107211   30068 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0621 18:27:37.107231   30068 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0621 18:27:37.107252   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:37.110295   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.110729   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:37.110755   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.110870   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:37.111030   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:37.111197   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:37.111314   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:37.137868   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0621 18:27:37.228739   30068 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 18:27:37.290397   30068 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0621 18:27:37.684619   30068 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0621 18:27:37.902862   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.902882   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.902957   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.902988   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903179   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903194   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903203   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.903210   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903287   30068 main.go:141] libmachine: (ha-406291) DBG | Closing plugin on server side

	I0621 18:27:37.903300   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903312   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903321   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.903328   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903474   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903485   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903513   30068 main.go:141] libmachine: (ha-406291) DBG | Closing plugin on server side

	I0621 18:27:37.903578   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903595   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903740   30068 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0621 18:27:37.903767   30068 round_trippers.go:469] Request Headers:

	I0621 18:27:37.903778   30068 round_trippers.go:473]     Accept: application/json, */*

	I0621 18:27:37.903784   30068 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0621 18:27:37.922164   30068 round_trippers.go:574] Response Status: 200 OK in 18 milliseconds

	I0621 18:27:37.922691   30068 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0621 18:27:37.922706   30068 round_trippers.go:469] Request Headers:

	I0621 18:27:37.922713   30068 round_trippers.go:473]     Accept: application/json, */*

	I0621 18:27:37.922718   30068 round_trippers.go:473]     Content-Type: application/json

	I0621 18:27:37.922720   30068 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0621 18:27:37.926249   30068 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0621 18:27:37.926491   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.926512   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.926731   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.926748   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.928515   30068 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0621 18:27:37.930095   30068 addons.go:510] duration metric: took 889.47949ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I0621 18:27:37.930127   30068 start.go:245] waiting for cluster config update ...

	I0621 18:27:37.930137   30068 start.go:254] writing updated cluster config ...

	I0621 18:27:37.931687   30068 out.go:177] 

	I0621 18:27:37.933039   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:37.933102   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:37.934716   30068 out.go:177] * Starting "ha-406291-m02" control-plane node in "ha-406291" cluster

	I0621 18:27:37.935953   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:27:37.935970   30068 cache.go:56] Caching tarball of preloaded images

	I0621 18:27:37.936052   30068 preload.go:173] Found /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0621 18:27:37.936063   30068 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio

	I0621 18:27:37.936142   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:37.936325   30068 start.go:360] acquireMachinesLock for ha-406291-m02: {Name:mkdb5ead19d46168ac3b04a7a163113221efea18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0621 18:27:37.936370   30068 start.go:364] duration metric: took 24.972µs to acquireMachinesLock for "ha-406291-m02"

	I0621 18:27:37.936392   30068 start.go:93] Provisioning new machine with config: &{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:27:37.936481   30068 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0621 18:27:37.938349   30068 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0621 18:27:37.938428   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.938450   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.952767   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34515

	I0621 18:27:37.953176   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.953649   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.953669   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.953963   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.954162   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:37.954301   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:37.954431   30068 start.go:159] libmachine.API.Create for "ha-406291" (driver="kvm2")

	I0621 18:27:37.954456   30068 client.go:168] LocalClient.Create starting

	I0621 18:27:37.954488   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem

	I0621 18:27:37.954518   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:27:37.954538   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:27:37.954589   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem

	I0621 18:27:37.954607   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:27:37.954621   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:27:37.954636   30068 main.go:141] libmachine: Running pre-create checks...

	I0621 18:27:37.954644   30068 main.go:141] libmachine: (ha-406291-m02) Calling .PreCreateCheck

	I0621 18:27:37.954836   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:37.955238   30068 main.go:141] libmachine: Creating machine...

	I0621 18:27:37.955253   30068 main.go:141] libmachine: (ha-406291-m02) Calling .Create

	I0621 18:27:37.955404   30068 main.go:141] libmachine: (ha-406291-m02) Creating KVM machine...

	I0621 18:27:37.956748   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found existing default KVM network

	I0621 18:27:37.956951   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found existing private KVM network mk-ha-406291

	I0621 18:27:37.957069   30068 main.go:141] libmachine: (ha-406291-m02) Setting up store path in /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 ...

	I0621 18:27:37.957091   30068 main.go:141] libmachine: (ha-406291-m02) Building disk image from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso

	I0621 18:27:37.957139   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:37.957062   30460 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:27:37.957278   30068 main.go:141] libmachine: (ha-406291-m02) Downloading /home/jenkins/minikube-integration/19112-8111/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso...

	I0621 18:27:38.178433   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.178291   30460 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa...

	I0621 18:27:38.322659   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.322470   30460 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/ha-406291-m02.rawdisk...

	I0621 18:27:38.322709   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 (perms=drwx------)

	I0621 18:27:38.322719   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Writing magic tar header

	I0621 18:27:38.322734   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Writing SSH key tar header

	I0621 18:27:38.322745   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.322583   30460 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 ...

	I0621 18:27:38.322758   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02

	I0621 18:27:38.322822   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines

	I0621 18:27:38.322839   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines (perms=drwxr-xr-x)

	I0621 18:27:38.322855   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube (perms=drwxr-xr-x)

	I0621 18:27:38.322864   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111 (perms=drwxrwxr-x)

	I0621 18:27:38.322874   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0621 18:27:38.322882   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0621 18:27:38.322896   30068 main.go:141] libmachine: (ha-406291-m02) Creating domain...

	I0621 18:27:38.322919   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:27:38.322939   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111

	I0621 18:27:38.322950   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0621 18:27:38.322968   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins

	I0621 18:27:38.322980   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home

	I0621 18:27:38.322988   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Skipping /home - not owner

	I0621 18:27:38.324031   30068 main.go:141] libmachine: (ha-406291-m02) define libvirt domain using xml: 

	I0621 18:27:38.324058   30068 main.go:141] libmachine: (ha-406291-m02) <domain type='kvm'>

	I0621 18:27:38.324071   30068 main.go:141] libmachine: (ha-406291-m02)   <name>ha-406291-m02</name>

	I0621 18:27:38.324078   30068 main.go:141] libmachine: (ha-406291-m02)   <memory unit='MiB'>2200</memory>

	I0621 18:27:38.324087   30068 main.go:141] libmachine: (ha-406291-m02)   <vcpu>2</vcpu>

	I0621 18:27:38.324098   30068 main.go:141] libmachine: (ha-406291-m02)   <features>

	I0621 18:27:38.324107   30068 main.go:141] libmachine: (ha-406291-m02)     <acpi/>

	I0621 18:27:38.324116   30068 main.go:141] libmachine: (ha-406291-m02)     <apic/>

	I0621 18:27:38.324125   30068 main.go:141] libmachine: (ha-406291-m02)     <pae/>

	I0621 18:27:38.324134   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324149   30068 main.go:141] libmachine: (ha-406291-m02)   </features>

	I0621 18:27:38.324164   30068 main.go:141] libmachine: (ha-406291-m02)   <cpu mode='host-passthrough'>

	I0621 18:27:38.324173   30068 main.go:141] libmachine: (ha-406291-m02)   

	I0621 18:27:38.324184   30068 main.go:141] libmachine: (ha-406291-m02)   </cpu>

	I0621 18:27:38.324199   30068 main.go:141] libmachine: (ha-406291-m02)   <os>

	I0621 18:27:38.324209   30068 main.go:141] libmachine: (ha-406291-m02)     <type>hvm</type>

	I0621 18:27:38.324220   30068 main.go:141] libmachine: (ha-406291-m02)     <boot dev='cdrom'/>

	I0621 18:27:38.324231   30068 main.go:141] libmachine: (ha-406291-m02)     <boot dev='hd'/>

	I0621 18:27:38.324258   30068 main.go:141] libmachine: (ha-406291-m02)     <bootmenu enable='no'/>

	I0621 18:27:38.324280   30068 main.go:141] libmachine: (ha-406291-m02)   </os>

	I0621 18:27:38.324293   30068 main.go:141] libmachine: (ha-406291-m02)   <devices>

	I0621 18:27:38.324310   30068 main.go:141] libmachine: (ha-406291-m02)     <disk type='file' device='cdrom'>

	I0621 18:27:38.324333   30068 main.go:141] libmachine: (ha-406291-m02)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/boot2docker.iso'/>

	I0621 18:27:38.324344   30068 main.go:141] libmachine: (ha-406291-m02)       <target dev='hdc' bus='scsi'/>

	I0621 18:27:38.324350   30068 main.go:141] libmachine: (ha-406291-m02)       <readonly/>

	I0621 18:27:38.324357   30068 main.go:141] libmachine: (ha-406291-m02)     </disk>

	I0621 18:27:38.324363   30068 main.go:141] libmachine: (ha-406291-m02)     <disk type='file' device='disk'>

	I0621 18:27:38.324375   30068 main.go:141] libmachine: (ha-406291-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0621 18:27:38.324390   30068 main.go:141] libmachine: (ha-406291-m02)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/ha-406291-m02.rawdisk'/>

	I0621 18:27:38.324401   30068 main.go:141] libmachine: (ha-406291-m02)       <target dev='hda' bus='virtio'/>

	I0621 18:27:38.324412   30068 main.go:141] libmachine: (ha-406291-m02)     </disk>

	I0621 18:27:38.324421   30068 main.go:141] libmachine: (ha-406291-m02)     <interface type='network'>

	I0621 18:27:38.324431   30068 main.go:141] libmachine: (ha-406291-m02)       <source network='mk-ha-406291'/>

	I0621 18:27:38.324442   30068 main.go:141] libmachine: (ha-406291-m02)       <model type='virtio'/>

	I0621 18:27:38.324453   30068 main.go:141] libmachine: (ha-406291-m02)     </interface>

	I0621 18:27:38.324465   30068 main.go:141] libmachine: (ha-406291-m02)     <interface type='network'>

	I0621 18:27:38.324474   30068 main.go:141] libmachine: (ha-406291-m02)       <source network='default'/>

	I0621 18:27:38.324481   30068 main.go:141] libmachine: (ha-406291-m02)       <model type='virtio'/>

	I0621 18:27:38.324493   30068 main.go:141] libmachine: (ha-406291-m02)     </interface>

	I0621 18:27:38.324503   30068 main.go:141] libmachine: (ha-406291-m02)     <serial type='pty'>

	I0621 18:27:38.324516   30068 main.go:141] libmachine: (ha-406291-m02)       <target port='0'/>

	I0621 18:27:38.324527   30068 main.go:141] libmachine: (ha-406291-m02)     </serial>

	I0621 18:27:38.324540   30068 main.go:141] libmachine: (ha-406291-m02)     <console type='pty'>

	I0621 18:27:38.324553   30068 main.go:141] libmachine: (ha-406291-m02)       <target type='serial' port='0'/>

	I0621 18:27:38.324562   30068 main.go:141] libmachine: (ha-406291-m02)     </console>

	I0621 18:27:38.324572   30068 main.go:141] libmachine: (ha-406291-m02)     <rng model='virtio'>

	I0621 18:27:38.324596   30068 main.go:141] libmachine: (ha-406291-m02)       <backend model='random'>/dev/random</backend>

	I0621 18:27:38.324609   30068 main.go:141] libmachine: (ha-406291-m02)     </rng>

	I0621 18:27:38.324630   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324640   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324648   30068 main.go:141] libmachine: (ha-406291-m02)   </devices>

	I0621 18:27:38.324660   30068 main.go:141] libmachine: (ha-406291-m02) </domain>

	I0621 18:27:38.324670   30068 main.go:141] libmachine: (ha-406291-m02) 

	I0621 18:27:38.332042   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:20:08:0e in network default

	I0621 18:27:38.332641   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring networks are active...

	I0621 18:27:38.332676   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:38.333428   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring network default is active

	I0621 18:27:38.333804   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring network mk-ha-406291 is active

	I0621 18:27:38.334296   30068 main.go:141] libmachine: (ha-406291-m02) Getting domain xml...

	I0621 18:27:38.335120   30068 main.go:141] libmachine: (ha-406291-m02) Creating domain...

	I0621 18:27:39.549305   30068 main.go:141] libmachine: (ha-406291-m02) Waiting to get IP...

	I0621 18:27:39.550967   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:39.551951   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:39.551976   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:39.551936   30460 retry.go:31] will retry after 267.635955ms: waiting for machine to come up

	I0621 18:27:39.821522   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:39.821997   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:39.822029   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:39.821946   30460 retry.go:31] will retry after 374.873977ms: waiting for machine to come up

	I0621 18:27:40.198386   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:40.198873   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:40.198904   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:40.198809   30460 retry.go:31] will retry after 315.815993ms: waiting for machine to come up

	I0621 18:27:40.516366   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:40.516862   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:40.516886   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:40.516817   30460 retry.go:31] will retry after 541.866776ms: waiting for machine to come up

	I0621 18:27:41.060525   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:41.061206   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:41.061240   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:41.061128   30460 retry.go:31] will retry after 493.062164ms: waiting for machine to come up

	I0621 18:27:41.555747   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:41.556109   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:41.556139   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:41.556061   30460 retry.go:31] will retry after 805.68132ms: waiting for machine to come up

	I0621 18:27:42.362929   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:42.363432   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:42.363464   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:42.363390   30460 retry.go:31] will retry after 986.445399ms: waiting for machine to come up

	I0621 18:27:43.351818   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:43.352265   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:43.352293   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:43.352201   30460 retry.go:31] will retry after 1.001415085s: waiting for machine to come up

	I0621 18:27:44.355253   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:44.355689   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:44.355710   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:44.355671   30460 retry.go:31] will retry after 1.270979624s: waiting for machine to come up

	I0621 18:27:45.627787   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:45.628323   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:45.628354   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:45.628272   30460 retry.go:31] will retry after 2.328221347s: waiting for machine to come up

	I0621 18:27:47.958352   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:47.958918   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:47.958945   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:47.958858   30460 retry.go:31] will retry after 2.603205559s: waiting for machine to come up

	I0621 18:27:50.565502   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:50.565956   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:50.565982   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:50.565839   30460 retry.go:31] will retry after 3.267607258s: waiting for machine to come up

	I0621 18:27:53.834801   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:53.835311   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:53.835344   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:53.835270   30460 retry.go:31] will retry after 4.450176964s: waiting for machine to come up

	I0621 18:27:58.286744   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.287205   30068 main.go:141] libmachine: (ha-406291-m02) Found IP for machine: 192.168.39.89

	I0621 18:27:58.287228   30068 main.go:141] libmachine: (ha-406291-m02) Reserving static IP address...

	I0621 18:27:58.287241   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has current primary IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.287601   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find host DHCP lease matching {name: "ha-406291-m02", mac: "52:54:00:a6:9a:09", ip: "192.168.39.89"} in network mk-ha-406291

	I0621 18:27:58.359643   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Getting to WaitForSSH function...

	I0621 18:27:58.359672   30068 main.go:141] libmachine: (ha-406291-m02) Reserved static IP address: 192.168.39.89

	I0621 18:27:58.359686   30068 main.go:141] libmachine: (ha-406291-m02) Waiting for SSH to be available...

	I0621 18:27:58.362234   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.362656   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:minikube Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.362687   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.362831   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using SSH client type: external

	I0621 18:27:58.362856   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa (-rw-------)

	I0621 18:27:58.362889   30068 main.go:141] libmachine: (ha-406291-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.89 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:58.362901   30068 main.go:141] libmachine: (ha-406291-m02) DBG | About to run SSH command:

	I0621 18:27:58.362914   30068 main.go:141] libmachine: (ha-406291-m02) DBG | exit 0

	I0621 18:27:58.489760   30068 main.go:141] libmachine: (ha-406291-m02) DBG | SSH cmd err, output: <nil>: 

	I0621 18:27:58.490247   30068 main.go:141] libmachine: (ha-406291-m02) KVM machine creation complete!

	I0621 18:27:58.490512   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:58.491093   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:58.491338   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:58.491506   30068 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0621 18:27:58.491523   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetState

	I0621 18:27:58.492807   30068 main.go:141] libmachine: Detecting operating system of created instance...

	I0621 18:27:58.492820   30068 main.go:141] libmachine: Waiting for SSH to be available...

	I0621 18:27:58.492825   30068 main.go:141] libmachine: Getting to WaitForSSH function...

	I0621 18:27:58.492853   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.495422   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.495802   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.495822   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.496013   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.496199   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.496377   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.496515   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.496690   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.496943   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.496957   30068 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0621 18:27:58.609072   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:58.609094   30068 main.go:141] libmachine: Detecting the provisioner...

	I0621 18:27:58.609101   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.611976   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.612412   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.612450   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.612655   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.612869   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.613083   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.613234   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.613421   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.613617   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.613629   30068 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0621 18:27:58.726636   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0621 18:27:58.726736   30068 main.go:141] libmachine: found compatible host: buildroot

	I0621 18:27:58.726751   30068 main.go:141] libmachine: Provisioning with buildroot...

	I0621 18:27:58.726768   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.727017   30068 buildroot.go:166] provisioning hostname "ha-406291-m02"

	I0621 18:27:58.727040   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.727234   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.729851   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.730255   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.730296   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.730453   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.730628   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.730787   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.730932   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.731090   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.731271   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.731295   30068 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-406291-m02 && echo "ha-406291-m02" | sudo tee /etc/hostname

	I0621 18:27:58.855682   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-406291-m02

	I0621 18:27:58.855710   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.858373   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.858679   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.858702   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.858921   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.859107   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.859289   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.859473   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.859613   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.859768   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.859784   30068 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-406291-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-406291-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-406291-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0621 18:27:58.979692   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:58.979722   30068 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19112-8111/.minikube CaCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19112-8111/.minikube}

	I0621 18:27:58.979735   30068 buildroot.go:174] setting up certificates

	I0621 18:27:58.979743   30068 provision.go:84] configureAuth start

	I0621 18:27:58.979750   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.980076   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:58.982730   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.983078   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.983110   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.983252   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.985344   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.985701   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.985721   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.985890   30068 provision.go:143] copyHostCerts

	I0621 18:27:58.985924   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:58.985962   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem, removing ...

	I0621 18:27:58.985976   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:58.986057   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem (1082 bytes)

	I0621 18:27:58.986156   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:58.986180   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem, removing ...

	I0621 18:27:58.986187   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:58.986229   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem (1123 bytes)

	I0621 18:27:58.986293   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:58.986317   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem, removing ...

	I0621 18:27:58.986326   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:58.986360   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem (1675 bytes)

	I0621 18:27:58.986426   30068 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem org=jenkins.ha-406291-m02 san=[127.0.0.1 192.168.39.89 ha-406291-m02 localhost minikube]

	I0621 18:27:59.066564   30068 provision.go:177] copyRemoteCerts

	I0621 18:27:59.066626   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0621 18:27:59.066653   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.069578   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.069924   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.069947   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.070132   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.070298   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.070432   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.070553   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.157218   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0621 18:27:59.157315   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0621 18:27:59.181198   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0621 18:27:59.181277   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0621 18:27:59.204590   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0621 18:27:59.204671   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0621 18:27:59.228836   30068 provision.go:87] duration metric: took 249.081961ms to configureAuth

	I0621 18:27:59.228857   30068 buildroot.go:189] setting minikube options for container-runtime

	I0621 18:27:59.229023   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:59.229086   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.231759   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.232083   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.232114   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.232338   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.232525   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.232684   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.232859   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.233030   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:59.233222   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:59.233247   30068 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0621 18:27:59.513149   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0621 18:27:59.513176   30068 main.go:141] libmachine: Checking connection to Docker...

	I0621 18:27:59.513184   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetURL

	I0621 18:27:59.514352   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using libvirt version 6000000

	I0621 18:27:59.516825   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.517208   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.517232   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.517421   30068 main.go:141] libmachine: Docker is up and running!

	I0621 18:27:59.517438   30068 main.go:141] libmachine: Reticulating splines...

	I0621 18:27:59.517446   30068 client.go:171] duration metric: took 21.562982419s to LocalClient.Create

	I0621 18:27:59.517469   30068 start.go:167] duration metric: took 21.563040702s to libmachine.API.Create "ha-406291"

	I0621 18:27:59.517482   30068 start.go:293] postStartSetup for "ha-406291-m02" (driver="kvm2")

	I0621 18:27:59.517494   30068 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0621 18:27:59.517516   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.517768   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0621 18:27:59.517792   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.520113   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.520510   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.520540   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.520681   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.520881   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.521084   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.521256   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.607755   30068 ssh_runner.go:195] Run: cat /etc/os-release

	I0621 18:27:59.611555   30068 info.go:137] Remote host: Buildroot 2023.02.9

	I0621 18:27:59.611581   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/addons for local assets ...

	I0621 18:27:59.611696   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/files for local assets ...

	I0621 18:27:59.611804   30068 filesync.go:149] local asset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> 153292.pem in /etc/ssl/certs

	I0621 18:27:59.611817   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /etc/ssl/certs/153292.pem

	I0621 18:27:59.611939   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0621 18:27:59.620359   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:59.643420   30068 start.go:296] duration metric: took 125.923821ms for postStartSetup

	I0621 18:27:59.643465   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:59.644062   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:59.646345   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.646685   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.646713   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.646924   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:59.647158   30068 start.go:128] duration metric: took 21.710666055s to createHost

	I0621 18:27:59.647181   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.649469   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.649766   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.649808   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.649962   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.650164   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.650334   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.650463   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.650585   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:59.650778   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:59.650790   30068 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0621 18:27:59.762223   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718994479.737744516

	I0621 18:27:59.762248   30068 fix.go:216] guest clock: 1718994479.737744516

	I0621 18:27:59.762259   30068 fix.go:229] Guest: 2024-06-21 18:27:59.737744516 +0000 UTC Remote: 2024-06-21 18:27:59.647170431 +0000 UTC m=+77.232139235 (delta=90.574085ms)

	I0621 18:27:59.762274   30068 fix.go:200] guest clock delta is within tolerance: 90.574085ms

	I0621 18:27:59.762279   30068 start.go:83] releasing machines lock for "ha-406291-m02", held for 21.825898335s

	I0621 18:27:59.762294   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.762550   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:59.765379   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.765744   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.765772   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.768017   30068 out.go:177] * Found network options:

	I0621 18:27:59.769201   30068 out.go:177]   - NO_PROXY=192.168.39.198

	W0621 18:27:59.770311   30068 proxy.go:119] fail to check proxy env: Error ip not in block

	I0621 18:27:59.770350   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.770853   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.771049   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.771143   30068 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0621 18:27:59.771180   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	W0621 18:27:59.771247   30068 proxy.go:119] fail to check proxy env: Error ip not in block

	I0621 18:27:59.771305   30068 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0621 18:27:59.771322   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.774073   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774210   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774455   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.774482   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774586   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.774595   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.774615   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774740   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.774796   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.774875   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.774963   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.775030   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.775150   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.775184   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:28:00.009851   30068 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0621 18:28:00.016373   30068 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0621 18:28:00.016450   30068 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0621 18:28:00.032199   30068 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0621 18:28:00.032221   30068 start.go:494] detecting cgroup driver to use...

	I0621 18:28:00.032283   30068 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0621 18:28:00.047343   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0621 18:28:00.061720   30068 docker.go:217] disabling cri-docker service (if available) ...

	I0621 18:28:00.061774   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0621 18:28:00.074668   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0621 18:28:00.087919   30068 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0621 18:28:00.213060   30068 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0621 18:28:00.376339   30068 docker.go:233] disabling docker service ...

	I0621 18:28:00.376406   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0621 18:28:00.391732   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0621 18:28:00.405305   30068 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0621 18:28:00.525867   30068 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0621 18:28:00.642362   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0621 18:28:00.656276   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0621 18:28:00.673811   30068 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0621 18:28:00.673883   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.683794   30068 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0621 18:28:00.683849   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.693601   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.703298   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.712924   30068 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0621 18:28:00.722921   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.733272   30068 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.749781   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.759708   30068 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0621 18:28:00.768749   30068 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0621 18:28:00.768811   30068 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0621 18:28:00.780758   30068 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0621 18:28:00.789993   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:28:00.904855   30068 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0621 18:28:01.039631   30068 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0621 18:28:01.039706   30068 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0621 18:28:01.044480   30068 start.go:562] Will wait 60s for crictl version

	I0621 18:28:01.044536   30068 ssh_runner.go:195] Run: which crictl

	I0621 18:28:01.048220   30068 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0621 18:28:01.089333   30068 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0621 18:28:01.089402   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:28:01.115665   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:28:01.144585   30068 out.go:177] * Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	I0621 18:28:01.145952   30068 out.go:177]   - env NO_PROXY=192.168.39.198

	I0621 18:28:01.147149   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:28:01.149745   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:28:01.150121   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:28:01.150153   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:28:01.150424   30068 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0621 18:28:01.154395   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:28:01.167802   30068 mustload.go:65] Loading cluster: ha-406291

	I0621 18:28:01.168024   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:28:01.168528   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:28:01.168581   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:28:01.183458   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35465

	I0621 18:28:01.183955   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:28:01.184452   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:28:01.184472   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:28:01.184809   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:28:01.185006   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:28:01.186504   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:28:01.186796   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:28:01.186838   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:28:01.201898   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38995

	I0621 18:28:01.202307   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:28:01.202715   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:28:01.202735   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:28:01.203060   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:28:01.203242   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:28:01.203402   30068 certs.go:68] Setting up /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291 for IP: 192.168.39.89

	I0621 18:28:01.203414   30068 certs.go:194] generating shared ca certs ...

	I0621 18:28:01.203427   30068 certs.go:226] acquiring lock for ca certs: {Name:mk96df7d45efa699c355b4c4409471361aa3f418 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.203536   30068 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key

	I0621 18:28:01.203569   30068 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key

	I0621 18:28:01.203578   30068 certs.go:256] generating profile certs ...

	I0621 18:28:01.203637   30068 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key

	I0621 18:28:01.203663   30068 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63

	I0621 18:28:01.203682   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.198 192.168.39.89 192.168.39.254]

	I0621 18:28:01.277240   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 ...

	I0621 18:28:01.277269   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63: {Name:mk0eb1e86875fe5e87f845f9e621f66001c859bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.277433   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63 ...

	I0621 18:28:01.277446   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63: {Name:mk95e28e76a927e44fae3dabafa76ecc474c70ef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.277517   30068 certs.go:381] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt

	I0621 18:28:01.277686   30068 certs.go:385] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key

	I0621 18:28:01.277852   30068 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key

	I0621 18:28:01.277870   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0621 18:28:01.277883   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0621 18:28:01.277894   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0621 18:28:01.277906   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0621 18:28:01.277922   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0621 18:28:01.277934   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0621 18:28:01.277946   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0621 18:28:01.277957   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0621 18:28:01.278003   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem (1338 bytes)

	W0621 18:28:01.278030   30068 certs.go:480] ignoring /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329_empty.pem, impossibly tiny 0 bytes

	I0621 18:28:01.278039   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem (1675 bytes)

	I0621 18:28:01.278059   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem (1082 bytes)

	I0621 18:28:01.278080   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem (1123 bytes)

	I0621 18:28:01.278100   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem (1675 bytes)

	I0621 18:28:01.278136   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:28:01.278162   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.278179   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem -> /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.278191   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.278220   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:28:01.281289   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:28:01.281749   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:28:01.281771   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:28:01.281960   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:28:01.282180   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:28:01.282351   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:28:01.282534   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:28:01.350153   30068 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.pub

	I0621 18:28:01.355146   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0621 18:28:01.366317   30068 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/sa.key

	I0621 18:28:01.370418   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0621 18:28:01.381527   30068 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.crt

	I0621 18:28:01.385371   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0621 18:28:01.395583   30068 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/front-proxy-ca.key

	I0621 18:28:01.399523   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0621 18:28:01.409427   30068 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.crt

	I0621 18:28:01.413340   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0621 18:28:01.424281   30068 ssh_runner.go:195] Run: stat -c %s /var/lib/minikube/certs/etcd/ca.key

	I0621 18:28:01.428574   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0621 18:28:01.443501   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0621 18:28:01.467141   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0621 18:28:01.489464   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0621 18:28:01.512839   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0621 18:28:01.536345   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0621 18:28:01.560903   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0621 18:28:01.585228   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0621 18:28:01.609236   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0621 18:28:01.632797   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0621 18:28:01.657717   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem --> /usr/share/ca-certificates/15329.pem (1338 bytes)

	I0621 18:28:01.680728   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /usr/share/ca-certificates/153292.pem (1708 bytes)

	I0621 18:28:01.704813   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0621 18:28:01.722206   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0621 18:28:01.739548   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0621 18:28:01.757066   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0621 18:28:01.773769   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0621 18:28:01.790648   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0621 18:28:01.807019   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0621 18:28:01.824606   30068 ssh_runner.go:195] Run: openssl version

	I0621 18:28:01.830760   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0621 18:28:01.841994   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.846701   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 21 17:42 /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.846753   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.852556   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0621 18:28:01.863407   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15329.pem && ln -fs /usr/share/ca-certificates/15329.pem /etc/ssl/certs/15329.pem"

	I0621 18:28:01.874586   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.879134   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 21 18:22 /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.879185   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.884636   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15329.pem /etc/ssl/certs/51391683.0"

	I0621 18:28:01.895639   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/153292.pem && ln -fs /usr/share/ca-certificates/153292.pem /etc/ssl/certs/153292.pem"

	I0621 18:28:01.907107   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.911747   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 21 18:22 /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.911813   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.917537   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/153292.pem /etc/ssl/certs/3ec20f2e.0"

	I0621 18:28:01.928452   30068 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0621 18:28:01.932569   30068 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0621 18:28:01.932640   30068 kubeadm.go:928] updating node {m02 192.168.39.89 8443 v1.30.2 crio true true} ...

	I0621 18:28:01.932831   30068 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-406291-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.89

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0621 18:28:01.932869   30068 kube-vip.go:115] generating kube-vip config ...

	I0621 18:28:01.932919   30068 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0621 18:28:01.949970   30068 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0621 18:28:01.950046   30068 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0621 18:28:01.950102   30068 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0621 18:28:01.960116   30068 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.2': No such file or directory

	Initiating transfer...

	I0621 18:28:01.960197   30068 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.2

	I0621 18:28:01.969893   30068 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubectl.sha256

	I0621 18:28:01.969926   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubectl -> /var/lib/minikube/binaries/v1.30.2/kubectl

	I0621 18:28:01.969997   30068 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.30.2/kubectl

	I0621 18:28:01.970033   30068 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm

	I0621 18:28:01.970001   30068 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubelet

	I0621 18:28:01.974344   30068 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubectl: stat -c "%s %y" /var/lib/minikube/binaries/v1.30.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubectl': No such file or directory

	I0621 18:28:01.974375   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubectl --> /var/lib/minikube/binaries/v1.30.2/kubectl (51454104 bytes)

	I0621 18:28:02.755689   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm -> /var/lib/minikube/binaries/v1.30.2/kubeadm

	I0621 18:28:02.755764   30068 ssh_runner.go:195] Run: stat -c "%s %y" /var/lib/minikube/binaries/v1.30.2/kubeadm

	I0621 18:28:02.760415   30068 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubeadm: stat -c "%s %y" /var/lib/minikube/binaries/v1.30.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubeadm': No such file or directory

	I0621 18:28:02.760448   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm --> /var/lib/minikube/binaries/v1.30.2/kubeadm (50249880 bytes)

	I0621 18:28:55.051081   30068 out.go:177] 

	W0621 18:28:55.052955   30068 out.go:239] X Exiting due to GUEST_START: failed to start node: adding node: update node: downloading binaries: downloading kubelet: download failed: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256 Dst:/home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0] Decompressors:map[bz2:0xc000769610 gz:0xc000769618 tar:0xc0007695c0 tar.bz2:0xc0007695d0 tar.gz:0xc0007695e0 tar.xz:0xc0007695f0 tar.zst:0xc000769600 tbz2:0xc0007695d0 tgz:0xc0007695e0 txz:0xc0007695f0 tzst:0xc000769600 xz:0xc000769620 zip:0xc000769630 zst:0xc000769628] Getters:map[file:0xc0009371c0 http:0xc

0008bcf50 https:0xc0008bcfa0] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: read tcp 10.154.0.3:46716->151.101.193.55:443: read: connection reset by peer

	X Exiting due to GUEST_START: failed to start node: adding node: update node: downloading binaries: downloading kubelet: download failed: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256 Dst:/home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0] Decompressors:map[bz2:0xc000769610 gz:0xc000769618 tar:0xc0007695c0 tar.bz2:0xc0007695d0 tar.gz:0xc0007695e0 tar.xz:0xc0007695f0 tar.zst:0xc000769600 tbz2:0xc0007695d0 tgz:0xc0007695e0 txz:0xc0007695f0 tzst:0xc000769600 xz:0xc000769620 zip:0xc000769630 zst:0xc000769628] Getters:map[file:0xc0009371c0 http:0xc0008bcf50 https:0xc0008bcfa0] Dir:false Pr

ogressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: read tcp 10.154.0.3:46716->151.101.193.55:443: read: connection reset by peer

	W0621 18:28:55.052979   30068 out.go:239] * 

	* 

	W0621 18:28:55.053829   30068 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0621 18:28:55.055312   30068 out.go:177] 

** /stderr **

ha_test.go:103: failed to fresh-start ha (multi-control plane) cluster. args "out/minikube-linux-amd64 start -p ha-406291 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=kvm2  --container-runtime=crio" : exit status 80

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-406291 -n ha-406291

helpers_test.go:244: <<< TestMultiControlPlane/serial/StartCluster FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StartCluster]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-406291 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-406291 logs -n 25: (1.168929886s)

helpers_test.go:252: TestMultiControlPlane/serial/StartCluster logs: 

-- stdout --

	==> Audit <==

	|----------------|---------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	|    Command     |                                   Args                                    |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|----------------|---------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| ssh            | functional-620822 ssh sudo cat                                            | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | /etc/test/nested/copy/15329/hosts                                         |                   |         |         |                     |                     |

	| image          | functional-620822 image ls                                                | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| image          | functional-620822 image load --daemon                                     | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | gcr.io/google-containers/addon-resizer:functional-620822                  |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| service        | functional-620822 service                                                 | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | hello-node-connect --url                                                  |                   |         |         |                     |                     |

	| update-context | functional-620822                                                         | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | update-context                                                            |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2                                                    |                   |         |         |                     |                     |

	| update-context | functional-620822                                                         | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | update-context                                                            |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2                                                    |                   |         |         |                     |                     |

	| update-context | functional-620822                                                         | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | update-context                                                            |                   |         |         |                     |                     |

	|                | --alsologtostderr -v=2                                                    |                   |         |         |                     |                     |

	| image          | functional-620822 image ls                                                | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| image          | functional-620822 image load --daemon                                     | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | gcr.io/google-containers/addon-resizer:functional-620822                  |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822 image ls                                                | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| image          | functional-620822 image save                                              | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | gcr.io/google-containers/addon-resizer:functional-620822                  |                   |         |         |                     |                     |

	|                | /home/jenkins/workspace/KVM_Linux_crio_integration/addon-resizer-save.tar |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822 image rm                                                | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | gcr.io/google-containers/addon-resizer:functional-620822                  |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822 image ls                                                | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| image          | functional-620822 image load                                              | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | /home/jenkins/workspace/KVM_Linux_crio_integration/addon-resizer-save.tar |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822 image ls                                                | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| image          | functional-620822 image save --daemon                                     | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | gcr.io/google-containers/addon-resizer:functional-620822                  |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822                                                         | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | image ls --format short                                                   |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822                                                         | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | image ls --format yaml                                                    |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822                                                         | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | image ls --format json                                                    |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| image          | functional-620822                                                         | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | image ls --format table                                                   |                   |         |         |                     |                     |

	|                | --alsologtostderr                                                         |                   |         |         |                     |                     |

	| ssh            | functional-620822 ssh pgrep                                               | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC |                     |

	|                | buildkitd                                                                 |                   |         |         |                     |                     |

	| image          | functional-620822 image build -t                                          | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	|                | localhost/my-image:functional-620822                                      |                   |         |         |                     |                     |

	|                | testdata/build --alsologtostderr                                          |                   |         |         |                     |                     |

	| image          | functional-620822 image ls                                                | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| delete         | -p functional-620822                                                      | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| start          | -p ha-406291 --wait=true                                                  | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC |                     |

	|                | --memory=2200 --ha                                                        |                   |         |         |                     |                     |

	|                | -v=7 --alsologtostderr                                                    |                   |         |         |                     |                     |

	|                | --driver=kvm2                                                             |                   |         |         |                     |                     |

	|                | --container-runtime=crio                                                  |                   |         |         |                     |                     |

	|----------------|---------------------------------------------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/06/21 18:26:42

	Running on machine: ubuntu-20-agent-8

	Binary: Built with gc go1.22.4 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0621 18:26:42.447747   30068 out.go:291] Setting OutFile to fd 1 ...

	I0621 18:26:42.447858   30068 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 18:26:42.447867   30068 out.go:304] Setting ErrFile to fd 2...

	I0621 18:26:42.447871   30068 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 18:26:42.448064   30068 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19112-8111/.minikube/bin

	I0621 18:26:42.448611   30068 out.go:298] Setting JSON to false

	I0621 18:26:42.449397   30068 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":4100,"bootTime":1718990302,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0621 18:26:42.449454   30068 start.go:139] virtualization: kvm guest

	I0621 18:26:42.451750   30068 out.go:177] * [ha-406291] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0621 18:26:42.453097   30068 out.go:177]   - MINIKUBE_LOCATION=19112

	I0621 18:26:42.453116   30068 notify.go:220] Checking for updates...

	I0621 18:26:42.456195   30068 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0621 18:26:42.457398   30068 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:26:42.458579   30068 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.459798   30068 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0621 18:26:42.461088   30068 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0621 18:26:42.462525   30068 driver.go:392] Setting default libvirt URI to qemu:///system

	I0621 18:26:42.497263   30068 out.go:177] * Using the kvm2 driver based on user configuration

	I0621 18:26:42.498734   30068 start.go:297] selected driver: kvm2

	I0621 18:26:42.498753   30068 start.go:901] validating driver "kvm2" against <nil>

	I0621 18:26:42.498763   30068 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0621 18:26:42.499421   30068 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 18:26:42.499483   30068 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19112-8111/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0621 18:26:42.513772   30068 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0621 18:26:42.513840   30068 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0621 18:26:42.514036   30068 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0621 18:26:42.514063   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:26:42.514070   30068 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0621 18:26:42.514080   30068 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0621 18:26:42.514119   30068 start.go:340] cluster config:

	{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0621 18:26:42.514203   30068 iso.go:125] acquiring lock: {Name:mk9bcacef563c74661da696f2e2fb4463daf80f2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 18:26:42.515839   30068 out.go:177] * Starting "ha-406291" primary control-plane node in "ha-406291" cluster

	I0621 18:26:42.516925   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:26:42.516952   30068 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4

	I0621 18:26:42.516960   30068 cache.go:56] Caching tarball of preloaded images

	I0621 18:26:42.517025   30068 preload.go:173] Found /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0621 18:26:42.517035   30068 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio

	I0621 18:26:42.517302   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:26:42.517325   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json: {Name:mkd43eceea282503c79b6e4b90bbf7258fcf8b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:26:42.517445   30068 start.go:360] acquireMachinesLock for ha-406291: {Name:mkdb5ead19d46168ac3b04a7a163113221efea18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0621 18:26:42.517470   30068 start.go:364] duration metric: took 13.314µs to acquireMachinesLock for "ha-406291"

	I0621 18:26:42.517485   30068 start.go:93] Provisioning new machine with config: &{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:26:42.517531   30068 start.go:125] createHost starting for "" (driver="kvm2")

	I0621 18:26:42.518937   30068 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0621 18:26:42.519071   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:26:42.519109   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:26:42.533235   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36669

	I0621 18:26:42.533669   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:26:42.534312   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:26:42.534360   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:26:42.534665   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:26:42.534880   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:26:42.535018   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:26:42.535180   30068 start.go:159] libmachine.API.Create for "ha-406291" (driver="kvm2")

	I0621 18:26:42.535209   30068 client.go:168] LocalClient.Create starting

	I0621 18:26:42.535233   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem

	I0621 18:26:42.535267   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:26:42.535282   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:26:42.535339   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem

	I0621 18:26:42.535357   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:26:42.535367   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:26:42.535383   30068 main.go:141] libmachine: Running pre-create checks...

	I0621 18:26:42.535396   30068 main.go:141] libmachine: (ha-406291) Calling .PreCreateCheck

	I0621 18:26:42.535734   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:26:42.536101   30068 main.go:141] libmachine: Creating machine...

	I0621 18:26:42.536113   30068 main.go:141] libmachine: (ha-406291) Calling .Create

	I0621 18:26:42.536232   30068 main.go:141] libmachine: (ha-406291) Creating KVM machine...

	I0621 18:26:42.537484   30068 main.go:141] libmachine: (ha-406291) DBG | found existing default KVM network

	I0621 18:26:42.538310   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.538153   30091 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1e0}

	I0621 18:26:42.538339   30068 main.go:141] libmachine: (ha-406291) DBG | created network xml: 

	I0621 18:26:42.538346   30068 main.go:141] libmachine: (ha-406291) DBG | <network>

	I0621 18:26:42.538355   30068 main.go:141] libmachine: (ha-406291) DBG |   <name>mk-ha-406291</name>

	I0621 18:26:42.538371   30068 main.go:141] libmachine: (ha-406291) DBG |   <dns enable='no'/>

	I0621 18:26:42.538385   30068 main.go:141] libmachine: (ha-406291) DBG |   

	I0621 18:26:42.538392   30068 main.go:141] libmachine: (ha-406291) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0621 18:26:42.538400   30068 main.go:141] libmachine: (ha-406291) DBG |     <dhcp>

	I0621 18:26:42.538412   30068 main.go:141] libmachine: (ha-406291) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0621 18:26:42.538421   30068 main.go:141] libmachine: (ha-406291) DBG |     </dhcp>

	I0621 18:26:42.538439   30068 main.go:141] libmachine: (ha-406291) DBG |   </ip>

	I0621 18:26:42.538451   30068 main.go:141] libmachine: (ha-406291) DBG |   

	I0621 18:26:42.538458   30068 main.go:141] libmachine: (ha-406291) DBG | </network>

	I0621 18:26:42.538470   30068 main.go:141] libmachine: (ha-406291) DBG | 

	I0621 18:26:42.543401   30068 main.go:141] libmachine: (ha-406291) DBG | trying to create private KVM network mk-ha-406291 192.168.39.0/24...

	I0621 18:26:42.606041   30068 main.go:141] libmachine: (ha-406291) DBG | private KVM network mk-ha-406291 192.168.39.0/24 created

	I0621 18:26:42.606072   30068 main.go:141] libmachine: (ha-406291) Setting up store path in /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 ...

	I0621 18:26:42.606091   30068 main.go:141] libmachine: (ha-406291) Building disk image from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso

	I0621 18:26:42.606165   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.606075   30091 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.606280   30068 main.go:141] libmachine: (ha-406291) Downloading /home/jenkins/minikube-integration/19112-8111/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso...

	I0621 18:26:42.829374   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.829262   30091 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa...

	I0621 18:26:42.941790   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.941666   30091 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/ha-406291.rawdisk...

	I0621 18:26:42.941834   30068 main.go:141] libmachine: (ha-406291) DBG | Writing magic tar header

	I0621 18:26:42.941844   30068 main.go:141] libmachine: (ha-406291) DBG | Writing SSH key tar header

	I0621 18:26:42.941852   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.941778   30091 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 ...

	I0621 18:26:42.941909   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291

	I0621 18:26:42.941989   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 (perms=drwx------)

	I0621 18:26:42.942007   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines

	I0621 18:26:42.942019   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines (perms=drwxr-xr-x)

	I0621 18:26:42.942033   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube (perms=drwxr-xr-x)

	I0621 18:26:42.942053   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111 (perms=drwxrwxr-x)

	I0621 18:26:42.942060   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.942069   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111

	I0621 18:26:42.942075   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0621 18:26:42.942080   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0621 18:26:42.942088   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins

	I0621 18:26:42.942104   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0621 18:26:42.942117   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home

	I0621 18:26:42.942128   30068 main.go:141] libmachine: (ha-406291) DBG | Skipping /home - not owner

	I0621 18:26:42.942142   30068 main.go:141] libmachine: (ha-406291) Creating domain...

	I0621 18:26:42.943154   30068 main.go:141] libmachine: (ha-406291) define libvirt domain using xml: 

	I0621 18:26:42.943176   30068 main.go:141] libmachine: (ha-406291) <domain type='kvm'>

	I0621 18:26:42.943183   30068 main.go:141] libmachine: (ha-406291)   <name>ha-406291</name>

	I0621 18:26:42.943188   30068 main.go:141] libmachine: (ha-406291)   <memory unit='MiB'>2200</memory>

	I0621 18:26:42.943199   30068 main.go:141] libmachine: (ha-406291)   <vcpu>2</vcpu>

	I0621 18:26:42.943203   30068 main.go:141] libmachine: (ha-406291)   <features>

	I0621 18:26:42.943208   30068 main.go:141] libmachine: (ha-406291)     <acpi/>

	I0621 18:26:42.943212   30068 main.go:141] libmachine: (ha-406291)     <apic/>

	I0621 18:26:42.943217   30068 main.go:141] libmachine: (ha-406291)     <pae/>

	I0621 18:26:42.943223   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943229   30068 main.go:141] libmachine: (ha-406291)   </features>

	I0621 18:26:42.943234   30068 main.go:141] libmachine: (ha-406291)   <cpu mode='host-passthrough'>

	I0621 18:26:42.943255   30068 main.go:141] libmachine: (ha-406291)   

	I0621 18:26:42.943266   30068 main.go:141] libmachine: (ha-406291)   </cpu>

	I0621 18:26:42.943284   30068 main.go:141] libmachine: (ha-406291)   <os>

	I0621 18:26:42.943318   30068 main.go:141] libmachine: (ha-406291)     <type>hvm</type>

	I0621 18:26:42.943328   30068 main.go:141] libmachine: (ha-406291)     <boot dev='cdrom'/>

	I0621 18:26:42.943333   30068 main.go:141] libmachine: (ha-406291)     <boot dev='hd'/>

	I0621 18:26:42.943341   30068 main.go:141] libmachine: (ha-406291)     <bootmenu enable='no'/>

	I0621 18:26:42.943345   30068 main.go:141] libmachine: (ha-406291)   </os>

	I0621 18:26:42.943355   30068 main.go:141] libmachine: (ha-406291)   <devices>

	I0621 18:26:42.943360   30068 main.go:141] libmachine: (ha-406291)     <disk type='file' device='cdrom'>

	I0621 18:26:42.943371   30068 main.go:141] libmachine: (ha-406291)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/boot2docker.iso'/>

	I0621 18:26:42.943384   30068 main.go:141] libmachine: (ha-406291)       <target dev='hdc' bus='scsi'/>

	I0621 18:26:42.943397   30068 main.go:141] libmachine: (ha-406291)       <readonly/>

	I0621 18:26:42.943404   30068 main.go:141] libmachine: (ha-406291)     </disk>

	I0621 18:26:42.943417   30068 main.go:141] libmachine: (ha-406291)     <disk type='file' device='disk'>

	I0621 18:26:42.943429   30068 main.go:141] libmachine: (ha-406291)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0621 18:26:42.943445   30068 main.go:141] libmachine: (ha-406291)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/ha-406291.rawdisk'/>

	I0621 18:26:42.943456   30068 main.go:141] libmachine: (ha-406291)       <target dev='hda' bus='virtio'/>

	I0621 18:26:42.943478   30068 main.go:141] libmachine: (ha-406291)     </disk>

	I0621 18:26:42.943499   30068 main.go:141] libmachine: (ha-406291)     <interface type='network'>

	I0621 18:26:42.943509   30068 main.go:141] libmachine: (ha-406291)       <source network='mk-ha-406291'/>

	I0621 18:26:42.943513   30068 main.go:141] libmachine: (ha-406291)       <model type='virtio'/>

	I0621 18:26:42.943519   30068 main.go:141] libmachine: (ha-406291)     </interface>

	I0621 18:26:42.943526   30068 main.go:141] libmachine: (ha-406291)     <interface type='network'>

	I0621 18:26:42.943532   30068 main.go:141] libmachine: (ha-406291)       <source network='default'/>

	I0621 18:26:42.943539   30068 main.go:141] libmachine: (ha-406291)       <model type='virtio'/>

	I0621 18:26:42.943544   30068 main.go:141] libmachine: (ha-406291)     </interface>

	I0621 18:26:42.943549   30068 main.go:141] libmachine: (ha-406291)     <serial type='pty'>

	I0621 18:26:42.943554   30068 main.go:141] libmachine: (ha-406291)       <target port='0'/>

	I0621 18:26:42.943560   30068 main.go:141] libmachine: (ha-406291)     </serial>

	I0621 18:26:42.943565   30068 main.go:141] libmachine: (ha-406291)     <console type='pty'>

	I0621 18:26:42.943571   30068 main.go:141] libmachine: (ha-406291)       <target type='serial' port='0'/>

	I0621 18:26:42.943583   30068 main.go:141] libmachine: (ha-406291)     </console>

	I0621 18:26:42.943593   30068 main.go:141] libmachine: (ha-406291)     <rng model='virtio'>

	I0621 18:26:42.943602   30068 main.go:141] libmachine: (ha-406291)       <backend model='random'>/dev/random</backend>

	I0621 18:26:42.943609   30068 main.go:141] libmachine: (ha-406291)     </rng>

	I0621 18:26:42.943617   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943621   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943627   30068 main.go:141] libmachine: (ha-406291)   </devices>

	I0621 18:26:42.943631   30068 main.go:141] libmachine: (ha-406291) </domain>

	I0621 18:26:42.943638   30068 main.go:141] libmachine: (ha-406291) 

	I0621 18:26:42.948298   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:44:10:c4 in network default

	I0621 18:26:42.948968   30068 main.go:141] libmachine: (ha-406291) Ensuring networks are active...

	I0621 18:26:42.948988   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:42.949710   30068 main.go:141] libmachine: (ha-406291) Ensuring network default is active

	I0621 18:26:42.950033   30068 main.go:141] libmachine: (ha-406291) Ensuring network mk-ha-406291 is active

	I0621 18:26:42.950493   30068 main.go:141] libmachine: (ha-406291) Getting domain xml...

	I0621 18:26:42.951151   30068 main.go:141] libmachine: (ha-406291) Creating domain...

	I0621 18:26:44.128421   30068 main.go:141] libmachine: (ha-406291) Waiting to get IP...

	I0621 18:26:44.129183   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.129530   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.129550   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.129513   30091 retry.go:31] will retry after 273.280189ms: waiting for machine to come up

	I0621 18:26:44.404590   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.405440   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.405467   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.405386   30091 retry.go:31] will retry after 363.287979ms: waiting for machine to come up

	I0621 18:26:44.769749   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.770188   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.770217   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.770146   30091 retry.go:31] will retry after 445.9009ms: waiting for machine to come up

	I0621 18:26:45.217708   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:45.218113   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:45.218132   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:45.218075   30091 retry.go:31] will retry after 497.769852ms: waiting for machine to come up

	I0621 18:26:45.717913   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:45.718380   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:45.718402   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:45.718333   30091 retry.go:31] will retry after 609.412902ms: waiting for machine to come up

	I0621 18:26:46.329589   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:46.330043   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:46.330077   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:46.330033   30091 retry.go:31] will retry after 668.226784ms: waiting for machine to come up

	I0621 18:26:46.999851   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:47.000352   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:47.000399   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:47.000310   30091 retry.go:31] will retry after 928.90777ms: waiting for machine to come up

	I0621 18:26:47.931043   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:47.931568   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:47.931598   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:47.931527   30091 retry.go:31] will retry after 1.407643188s: waiting for machine to come up

	I0621 18:26:49.341126   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:49.341529   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:49.341557   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:49.341489   30091 retry.go:31] will retry after 1.657120945s: waiting for machine to come up

	I0621 18:26:51.001518   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:51.001999   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:51.002022   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:51.001955   30091 retry.go:31] will retry after 1.506025988s: waiting for machine to come up

	I0621 18:26:52.509823   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:52.510314   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:52.510342   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:52.510269   30091 retry.go:31] will retry after 2.859818514s: waiting for machine to come up

	I0621 18:26:55.371181   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:55.371726   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:55.371755   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:55.371678   30091 retry.go:31] will retry after 3.374080501s: waiting for machine to come up

	I0621 18:26:58.747494   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:58.748019   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:58.748039   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:58.747991   30091 retry.go:31] will retry after 4.386740875s: waiting for machine to come up

	I0621 18:27:03.136546   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.137046   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has current primary IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.137063   30068 main.go:141] libmachine: (ha-406291) Found IP for machine: 192.168.39.198

	I0621 18:27:03.137079   30068 main.go:141] libmachine: (ha-406291) Reserving static IP address...

	I0621 18:27:03.137427   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find host DHCP lease matching {name: "ha-406291", mac: "52:54:00:38:dc:46", ip: "192.168.39.198"} in network mk-ha-406291

	I0621 18:27:03.211473   30068 main.go:141] libmachine: (ha-406291) DBG | Getting to WaitForSSH function...

	I0621 18:27:03.211506   30068 main.go:141] libmachine: (ha-406291) Reserved static IP address: 192.168.39.198

	I0621 18:27:03.211519   30068 main.go:141] libmachine: (ha-406291) Waiting for SSH to be available...

	I0621 18:27:03.214029   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.214477   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291

	I0621 18:27:03.214509   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find defined IP address of network mk-ha-406291 interface with MAC address 52:54:00:38:dc:46

	I0621 18:27:03.214661   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH client type: external

	I0621 18:27:03.214702   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa (-rw-------)

	I0621 18:27:03.214745   30068 main.go:141] libmachine: (ha-406291) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:03.214771   30068 main.go:141] libmachine: (ha-406291) DBG | About to run SSH command:

	I0621 18:27:03.214784   30068 main.go:141] libmachine: (ha-406291) DBG | exit 0

	I0621 18:27:03.218578   30068 main.go:141] libmachine: (ha-406291) DBG | SSH cmd err, output: exit status 255: 

	I0621 18:27:03.218603   30068 main.go:141] libmachine: (ha-406291) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0621 18:27:03.218614   30068 main.go:141] libmachine: (ha-406291) DBG | command : exit 0

	I0621 18:27:03.218630   30068 main.go:141] libmachine: (ha-406291) DBG | err     : exit status 255

	I0621 18:27:03.218643   30068 main.go:141] libmachine: (ha-406291) DBG | output  : 

	I0621 18:27:06.220803   30068 main.go:141] libmachine: (ha-406291) DBG | Getting to WaitForSSH function...

	I0621 18:27:06.223287   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.223552   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.223591   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.223725   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH client type: external

	I0621 18:27:06.223751   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa (-rw-------)

	I0621 18:27:06.223775   30068 main.go:141] libmachine: (ha-406291) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.198 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:06.223788   30068 main.go:141] libmachine: (ha-406291) DBG | About to run SSH command:

	I0621 18:27:06.223797   30068 main.go:141] libmachine: (ha-406291) DBG | exit 0

	I0621 18:27:06.345962   30068 main.go:141] libmachine: (ha-406291) DBG | SSH cmd err, output: <nil>: 

	I0621 18:27:06.346198   30068 main.go:141] libmachine: (ha-406291) KVM machine creation complete!

	I0621 18:27:06.346530   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:27:06.347151   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:06.347376   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:06.347539   30068 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0621 18:27:06.347553   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:06.349257   30068 main.go:141] libmachine: Detecting operating system of created instance...

	I0621 18:27:06.349272   30068 main.go:141] libmachine: Waiting for SSH to be available...

	I0621 18:27:06.349278   30068 main.go:141] libmachine: Getting to WaitForSSH function...

	I0621 18:27:06.349284   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.351365   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.351709   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.351738   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.351848   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.352053   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.352215   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.352441   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.352676   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.352926   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.352939   30068 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0621 18:27:06.449038   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:06.449066   30068 main.go:141] libmachine: Detecting the provisioner...

	I0621 18:27:06.449077   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.451811   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.452202   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.452223   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.452405   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.452602   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.452762   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.452898   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.453074   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.453321   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.453334   30068 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0621 18:27:06.550539   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0621 18:27:06.550611   30068 main.go:141] libmachine: found compatible host: buildroot

	I0621 18:27:06.550618   30068 main.go:141] libmachine: Provisioning with buildroot...

	I0621 18:27:06.550625   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.550871   30068 buildroot.go:166] provisioning hostname "ha-406291"

	I0621 18:27:06.550891   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.551068   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.553701   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.554112   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.554138   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.554279   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.554452   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.554601   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.554725   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.554869   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.555029   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.555040   30068 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-406291 && echo "ha-406291" | sudo tee /etc/hostname

	I0621 18:27:06.664012   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-406291

	I0621 18:27:06.664038   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.666600   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.666923   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.666952   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.667091   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.667277   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.667431   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.667559   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.667745   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.667932   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.667949   30068 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-406291' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-406291/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-406291' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0621 18:27:06.778156   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:06.778199   30068 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19112-8111/.minikube CaCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19112-8111/.minikube}

	I0621 18:27:06.778224   30068 buildroot.go:174] setting up certificates

	I0621 18:27:06.778237   30068 provision.go:84] configureAuth start

	I0621 18:27:06.778250   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.778526   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:06.781267   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.781583   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.781610   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.781773   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.784225   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.784546   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.784564   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.784717   30068 provision.go:143] copyHostCerts

	I0621 18:27:06.784747   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:06.784796   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem, removing ...

	I0621 18:27:06.784813   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:06.784893   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem (1675 bytes)

	I0621 18:27:06.784992   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:06.785017   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem, removing ...

	I0621 18:27:06.785023   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:06.785064   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem (1082 bytes)

	I0621 18:27:06.785126   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:06.785153   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem, removing ...

	I0621 18:27:06.785162   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:06.785194   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem (1123 bytes)

	I0621 18:27:06.785257   30068 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem org=jenkins.ha-406291 san=[127.0.0.1 192.168.39.198 ha-406291 localhost minikube]

	I0621 18:27:06.904910   30068 provision.go:177] copyRemoteCerts

	I0621 18:27:06.904976   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0621 18:27:06.905004   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.907600   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.907883   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.907916   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.908115   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.908308   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.908462   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.908599   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:06.987463   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0621 18:27:06.987540   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0621 18:27:07.009572   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0621 18:27:07.009661   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)

	I0621 18:27:07.031219   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0621 18:27:07.031333   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0621 18:27:07.052682   30068 provision.go:87] duration metric: took 274.433059ms to configureAuth

	I0621 18:27:07.052709   30068 buildroot.go:189] setting minikube options for container-runtime

	I0621 18:27:07.052895   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:07.052984   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.055368   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.055720   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.055742   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.055971   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.056161   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.056324   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.056453   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.056615   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:07.056785   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:07.056814   30068 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0621 18:27:07.307055   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0621 18:27:07.307083   30068 main.go:141] libmachine: Checking connection to Docker...

	I0621 18:27:07.307105   30068 main.go:141] libmachine: (ha-406291) Calling .GetURL

	I0621 18:27:07.308373   30068 main.go:141] libmachine: (ha-406291) DBG | Using libvirt version 6000000

	I0621 18:27:07.310322   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.310631   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.310658   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.310756   30068 main.go:141] libmachine: Docker is up and running!

	I0621 18:27:07.310768   30068 main.go:141] libmachine: Reticulating splines...

	I0621 18:27:07.310774   30068 client.go:171] duration metric: took 24.775558818s to LocalClient.Create

	I0621 18:27:07.310795   30068 start.go:167] duration metric: took 24.775614868s to libmachine.API.Create "ha-406291"

	I0621 18:27:07.310807   30068 start.go:293] postStartSetup for "ha-406291" (driver="kvm2")

	I0621 18:27:07.310818   30068 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0621 18:27:07.310835   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.311186   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0621 18:27:07.311208   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.313308   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.313543   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.313581   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.313682   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.313855   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.314042   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.314209   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.391859   30068 ssh_runner.go:195] Run: cat /etc/os-release

	I0621 18:27:07.396062   30068 info.go:137] Remote host: Buildroot 2023.02.9

	I0621 18:27:07.396083   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/addons for local assets ...

	I0621 18:27:07.396132   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/files for local assets ...

	I0621 18:27:07.396193   30068 filesync.go:149] local asset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> 153292.pem in /etc/ssl/certs

	I0621 18:27:07.396202   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /etc/ssl/certs/153292.pem

	I0621 18:27:07.396289   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0621 18:27:07.405435   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:07.427927   30068 start.go:296] duration metric: took 117.075834ms for postStartSetup

	I0621 18:27:07.427984   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:27:07.428562   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:07.431157   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.431479   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.431523   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.431791   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:07.431969   30068 start.go:128] duration metric: took 24.914429669s to createHost

	I0621 18:27:07.431990   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.434121   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.434421   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.434445   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.434510   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.434692   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.434865   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.435009   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.435168   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:07.435372   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:07.435384   30068 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0621 18:27:07.530141   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718994427.508226463

	I0621 18:27:07.530165   30068 fix.go:216] guest clock: 1718994427.508226463

	I0621 18:27:07.530173   30068 fix.go:229] Guest: 2024-06-21 18:27:07.508226463 +0000 UTC Remote: 2024-06-21 18:27:07.431981059 +0000 UTC m=+25.016949864 (delta=76.245404ms)

	I0621 18:27:07.530199   30068 fix.go:200] guest clock delta is within tolerance: 76.245404ms

	I0621 18:27:07.530204   30068 start.go:83] releasing machines lock for "ha-406291", held for 25.012726918s

	I0621 18:27:07.530222   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.530466   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:07.532753   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.533110   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.533151   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.533275   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533702   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533877   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533978   30068 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0621 18:27:07.534028   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.534087   30068 ssh_runner.go:195] Run: cat /version.json

	I0621 18:27:07.534115   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.536489   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536798   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.536828   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536845   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536983   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.537154   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.537312   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.537330   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.537337   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.537509   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.537507   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.537675   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.537830   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.537968   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.610886   30068 ssh_runner.go:195] Run: systemctl --version

	I0621 18:27:07.648150   30068 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0621 18:27:07.798080   30068 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0621 18:27:07.803683   30068 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0621 18:27:07.803731   30068 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0621 18:27:07.820345   30068 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0621 18:27:07.820363   30068 start.go:494] detecting cgroup driver to use...

	I0621 18:27:07.820412   30068 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0621 18:27:07.835960   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0621 18:27:07.849269   30068 docker.go:217] disabling cri-docker service (if available) ...

	I0621 18:27:07.849324   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0621 18:27:07.861858   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0621 18:27:07.874371   30068 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0621 18:27:07.984965   30068 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0621 18:27:08.126897   30068 docker.go:233] disabling docker service ...

	I0621 18:27:08.126973   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0621 18:27:08.140294   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0621 18:27:08.152460   30068 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0621 18:27:08.289101   30068 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0621 18:27:08.414578   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0621 18:27:08.428193   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0621 18:27:08.445335   30068 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0621 18:27:08.445406   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.454715   30068 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0621 18:27:08.454780   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.464286   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.473688   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.483215   30068 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0621 18:27:08.492907   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.502386   30068 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.518138   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.527822   30068 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0621 18:27:08.536491   30068 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0621 18:27:08.536537   30068 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0621 18:27:08.548343   30068 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0621 18:27:08.557395   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:27:08.668782   30068 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0621 18:27:08.793146   30068 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0621 18:27:08.793228   30068 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0621 18:27:08.797886   30068 start.go:562] Will wait 60s for crictl version

	I0621 18:27:08.797933   30068 ssh_runner.go:195] Run: which crictl

	I0621 18:27:08.801183   30068 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0621 18:27:08.838953   30068 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0621 18:27:08.839028   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:27:08.865047   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:27:08.892059   30068 out.go:177] * Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	I0621 18:27:08.893365   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:08.895801   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:08.896174   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:08.896198   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:08.896377   30068 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0621 18:27:08.900124   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:27:08.912152   30068 kubeadm.go:877] updating cluster {Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0621 18:27:08.912252   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:27:08.912299   30068 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 18:27:08.941267   30068 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.2". assuming images are not preloaded.

	I0621 18:27:08.941328   30068 ssh_runner.go:195] Run: which lz4

	I0621 18:27:08.944757   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0621 18:27:08.944843   30068 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0621 18:27:08.948482   30068 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0621 18:27:08.948507   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (395071426 bytes)

	I0621 18:27:10.186487   30068 crio.go:462] duration metric: took 1.241671996s to copy over tarball

	I0621 18:27:10.186568   30068 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0621 18:27:12.219224   30068 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.032622286s)

	I0621 18:27:12.219256   30068 crio.go:469] duration metric: took 2.032747658s to extract the tarball

	I0621 18:27:12.219265   30068 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0621 18:27:12.255526   30068 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 18:27:12.297692   30068 crio.go:514] all images are preloaded for cri-o runtime.

	I0621 18:27:12.297715   30068 cache_images.go:84] Images are preloaded, skipping loading

	I0621 18:27:12.297725   30068 kubeadm.go:928] updating node { 192.168.39.198 8443 v1.30.2 crio true true} ...

	I0621 18:27:12.297863   30068 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-406291 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.198

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0621 18:27:12.297956   30068 ssh_runner.go:195] Run: crio config

	I0621 18:27:12.347243   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:27:12.347276   30068 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0621 18:27:12.347288   30068 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0621 18:27:12.347314   30068 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.198 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-406291 NodeName:ha-406291 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.198"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.198 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0621 18:27:12.347487   30068 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.198

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-406291"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.198

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.198"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0621 18:27:12.347514   30068 kube-vip.go:115] generating kube-vip config ...

	I0621 18:27:12.347563   30068 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0621 18:27:12.362180   30068 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0621 18:27:12.362273   30068 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0621 18:27:12.362316   30068 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0621 18:27:12.371448   30068 binaries.go:44] Found k8s binaries, skipping transfer

	I0621 18:27:12.371499   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0621 18:27:12.380031   30068 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0621 18:27:12.395354   30068 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0621 18:27:12.410533   30068 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0621 18:27:12.425474   30068 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0621 18:27:12.440059   30068 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0621 18:27:12.443523   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:27:12.454828   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:27:12.572486   30068 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0621 18:27:12.589057   30068 certs.go:68] Setting up /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291 for IP: 192.168.39.198

	I0621 18:27:12.589078   30068 certs.go:194] generating shared ca certs ...

	I0621 18:27:12.589095   30068 certs.go:226] acquiring lock for ca certs: {Name:mk96df7d45efa699c355b4c4409471361aa3f418 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.589221   30068 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key

	I0621 18:27:12.589272   30068 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key

	I0621 18:27:12.589282   30068 certs.go:256] generating profile certs ...

	I0621 18:27:12.589333   30068 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key

	I0621 18:27:12.589346   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt with IP's: []

	I0621 18:27:12.759863   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt ...

	I0621 18:27:12.759890   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt: {Name:mk1350197087e6f37ca28e80a43c199beace4f91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.760090   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key ...

	I0621 18:27:12.760104   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key: {Name:mk90994b992a268304b337419707e3332d3f039a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.760206   30068 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92

	I0621 18:27:12.760222   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.198 192.168.39.254]

	I0621 18:27:13.132336   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 ...

	I0621 18:27:13.132362   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92: {Name:mke7daa70ff2d7bf8fa87eea51b1ed6731c0dd6d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.132530   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92 ...

	I0621 18:27:13.132546   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92: {Name:mk310235904dba1c4db66ef73b8dcc06ff030051 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.132647   30068 certs.go:381] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt

	I0621 18:27:13.132737   30068 certs.go:385] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key

	I0621 18:27:13.132790   30068 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key

	I0621 18:27:13.132806   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt with IP's: []

	I0621 18:27:13.317891   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt ...

	I0621 18:27:13.317927   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt: {Name:mk5e450ef3633fa54e81eaeb94f9408c94729912 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.318119   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key ...

	I0621 18:27:13.318132   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key: {Name:mk3a1443924b05c36251566d5313d0eeb467e0fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.318220   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0621 18:27:13.318241   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0621 18:27:13.318251   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0621 18:27:13.318264   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0621 18:27:13.318274   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0621 18:27:13.318290   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0621 18:27:13.318302   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0621 18:27:13.318314   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0621 18:27:13.318363   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem (1338 bytes)

	W0621 18:27:13.318396   30068 certs.go:480] ignoring /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329_empty.pem, impossibly tiny 0 bytes

	I0621 18:27:13.318406   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem (1675 bytes)

	I0621 18:27:13.318428   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem (1082 bytes)

	I0621 18:27:13.318449   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem (1123 bytes)

	I0621 18:27:13.318469   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem (1675 bytes)

	I0621 18:27:13.318506   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:13.318531   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.318544   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.318556   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem -> /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.319121   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0621 18:27:13.345382   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0621 18:27:13.379289   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0621 18:27:13.406853   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0621 18:27:13.430624   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0621 18:27:13.452498   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0621 18:27:13.474381   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0621 18:27:13.497475   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0621 18:27:13.520548   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /usr/share/ca-certificates/153292.pem (1708 bytes)

	I0621 18:27:13.543849   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0621 18:27:13.569722   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem --> /usr/share/ca-certificates/15329.pem (1338 bytes)

	I0621 18:27:13.594191   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0621 18:27:13.611312   30068 ssh_runner.go:195] Run: openssl version

	I0621 18:27:13.616881   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15329.pem && ln -fs /usr/share/ca-certificates/15329.pem /etc/ssl/certs/15329.pem"

	I0621 18:27:13.627054   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.631162   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 21 18:22 /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.631214   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.636845   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15329.pem /etc/ssl/certs/51391683.0"

	I0621 18:27:13.648132   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/153292.pem && ln -fs /usr/share/ca-certificates/153292.pem /etc/ssl/certs/153292.pem"

	I0621 18:27:13.658846   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.663074   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 21 18:22 /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.663140   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.668358   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/153292.pem /etc/ssl/certs/3ec20f2e.0"

	I0621 18:27:13.678369   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0621 18:27:13.688293   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.692517   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 21 17:42 /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.692581   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.697837   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0621 18:27:13.707967   30068 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0621 18:27:13.711761   30068 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0621 18:27:13.711821   30068 kubeadm.go:391] StartCluster: {Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0621 18:27:13.711887   30068 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0621 18:27:13.711960   30068 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0621 18:27:13.752929   30068 cri.go:89] found id: ""

	I0621 18:27:13.753017   30068 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0621 18:27:13.762514   30068 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0621 18:27:13.771612   30068 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0621 18:27:13.781740   30068 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0621 18:27:13.781758   30068 kubeadm.go:156] found existing configuration files:

	I0621 18:27:13.781811   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0621 18:27:13.790876   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0621 18:27:13.790943   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0621 18:27:13.800011   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0621 18:27:13.809117   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0621 18:27:13.809168   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0621 18:27:13.818279   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0621 18:27:13.827522   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0621 18:27:13.827584   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0621 18:27:13.836671   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0621 18:27:13.845242   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0621 18:27:13.845298   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0621 18:27:13.854365   30068 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0621 18:27:13.951888   30068 kubeadm.go:309] [init] Using Kubernetes version: v1.30.2

	I0621 18:27:13.951970   30068 kubeadm.go:309] [preflight] Running pre-flight checks

	I0621 18:27:14.081675   30068 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0621 18:27:14.081845   30068 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0621 18:27:14.081983   30068 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0621 18:27:14.292951   30068 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0621 18:27:14.423174   30068 out.go:204]   - Generating certificates and keys ...

	I0621 18:27:14.423287   30068 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0621 18:27:14.423355   30068 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0621 18:27:14.524306   30068 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0621 18:27:14.693249   30068 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0621 18:27:14.771462   30068 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0621 18:27:14.965492   30068 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0621 18:27:15.095342   30068 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0621 18:27:15.095646   30068 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-406291 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]

	I0621 18:27:15.247328   30068 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0621 18:27:15.247729   30068 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-406291 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]

	I0621 18:27:15.326656   30068 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0621 18:27:15.470979   30068 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0621 18:27:15.620090   30068 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0621 18:27:15.620402   30068 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0621 18:27:15.715693   30068 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0621 18:27:16.259484   30068 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0621 18:27:16.704626   30068 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0621 18:27:16.836633   30068 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0621 18:27:16.996818   30068 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0621 18:27:16.997517   30068 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0621 18:27:16.999949   30068 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0621 18:27:17.001874   30068 out.go:204]   - Booting up control plane ...

	I0621 18:27:17.001982   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0621 18:27:17.002874   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0621 18:27:17.003729   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0621 18:27:17.018894   30068 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0621 18:27:17.019816   30068 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0621 18:27:17.019944   30068 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0621 18:27:17.138099   30068 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0621 18:27:17.138195   30068 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0621 18:27:17.639115   30068 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 501.282189ms

	I0621 18:27:17.639214   30068 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0621 18:27:23.502026   30068 kubeadm.go:309] [api-check] The API server is healthy after 5.864418149s

	I0621 18:27:23.512938   30068 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0621 18:27:23.528670   30068 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0621 18:27:24.059886   30068 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0621 18:27:24.060060   30068 kubeadm.go:309] [mark-control-plane] Marking the node ha-406291 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0621 18:27:24.071607   30068 kubeadm.go:309] [bootstrap-token] Using token: ha2utu.p9k0bq1xsr5791t7

	I0621 18:27:24.073185   30068 out.go:204]   - Configuring RBAC rules ...

	I0621 18:27:24.073336   30068 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0621 18:27:24.084336   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0621 18:27:24.092265   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0621 18:27:24.096415   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0621 18:27:24.101175   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0621 18:27:24.104689   30068 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0621 18:27:24.121568   30068 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0621 18:27:24.349610   30068 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0621 18:27:24.907607   30068 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0621 18:27:24.908452   30068 kubeadm.go:309] 

	I0621 18:27:24.908529   30068 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0621 18:27:24.908541   30068 kubeadm.go:309] 

	I0621 18:27:24.908607   30068 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0621 18:27:24.908645   30068 kubeadm.go:309] 

	I0621 18:27:24.908698   30068 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0621 18:27:24.908780   30068 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0621 18:27:24.908863   30068 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0621 18:27:24.908873   30068 kubeadm.go:309] 

	I0621 18:27:24.908975   30068 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0621 18:27:24.908993   30068 kubeadm.go:309] 

	I0621 18:27:24.909038   30068 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0621 18:27:24.909045   30068 kubeadm.go:309] 

	I0621 18:27:24.909086   30068 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0621 18:27:24.909160   30068 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0621 18:27:24.909256   30068 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0621 18:27:24.909274   30068 kubeadm.go:309] 

	I0621 18:27:24.909401   30068 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0621 18:27:24.909522   30068 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0621 18:27:24.909544   30068 kubeadm.go:309] 

	I0621 18:27:24.909671   30068 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token ha2utu.p9k0bq1xsr5791t7 \

	I0621 18:27:24.909771   30068 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df \

	I0621 18:27:24.909810   30068 kubeadm.go:309] 	--control-plane 

	I0621 18:27:24.909824   30068 kubeadm.go:309] 

	I0621 18:27:24.909898   30068 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0621 18:27:24.909904   30068 kubeadm.go:309] 

	I0621 18:27:24.909977   30068 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ha2utu.p9k0bq1xsr5791t7 \

	I0621 18:27:24.910064   30068 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df 

	I0621 18:27:24.910664   30068 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0621 18:27:24.910700   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:27:24.910708   30068 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0621 18:27:24.912398   30068 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0621 18:27:24.913676   30068 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0621 18:27:24.919660   30068 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.2/kubectl ...

	I0621 18:27:24.919677   30068 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0621 18:27:24.938734   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0621 18:27:25.303975   30068 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0621 18:27:25.304070   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:25.304073   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-406291 minikube.k8s.io/updated_at=2024_06_21T18_27_25_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=1a0d377c34faa85740cf2404ea12566198300600 minikube.k8s.io/name=ha-406291 minikube.k8s.io/primary=true

	I0621 18:27:25.334777   30068 ops.go:34] apiserver oom_adj: -16

	I0621 18:27:25.436873   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:25.937461   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:26.436991   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:26.937206   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:27.437152   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:27.937860   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:28.437177   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:28.937036   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:29.437007   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:29.937140   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:30.437060   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:30.937199   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:31.437695   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:31.937675   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:32.437034   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:32.937808   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:33.437793   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:33.937401   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:34.437307   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:34.937172   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:35.437428   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:35.937146   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:36.436951   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:36.937873   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:37.039583   30068 kubeadm.go:1107] duration metric: took 11.735587948s to wait for elevateKubeSystemPrivileges

	W0621 18:27:37.039626   30068 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0621 18:27:37.039635   30068 kubeadm.go:393] duration metric: took 23.327819322s to StartCluster

	I0621 18:27:37.039654   30068 settings.go:142] acquiring lock: {Name:mkdbb660cad4d8fb446e5c2ca4439ea3326e9592 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:37.039737   30068 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:27:37.040362   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/kubeconfig: {Name:mk87038194ab41f67dd50d90b017d32a83c3da4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:37.040584   30068 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:27:37.040604   30068 start.go:240] waiting for startup goroutines ...

	I0621 18:27:37.040603   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0621 18:27:37.040612   30068 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0621 18:27:37.040669   30068 addons.go:69] Setting storage-provisioner=true in profile "ha-406291"

	I0621 18:27:37.040677   30068 addons.go:69] Setting default-storageclass=true in profile "ha-406291"

	I0621 18:27:37.040699   30068 addons.go:234] Setting addon storage-provisioner=true in "ha-406291"

	I0621 18:27:37.040730   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:27:37.040700   30068 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-406291"

	I0621 18:27:37.040772   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:37.041052   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.041075   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.041146   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.041174   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.055583   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42699

	I0621 18:27:37.056062   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.056549   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.056570   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.056894   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.057371   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.057399   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.061343   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44857

	I0621 18:27:37.061846   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.062393   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.062418   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.062721   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.062885   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.065021   30068 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:27:37.065351   30068 kapi.go:59] client config for ha-406291: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt", KeyFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key", CAFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cf98a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0621 18:27:37.065825   30068 cert_rotation.go:137] Starting client certificate rotation controller

	I0621 18:27:37.066065   30068 addons.go:234] Setting addon default-storageclass=true in "ha-406291"

	I0621 18:27:37.066106   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:27:37.066471   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.066512   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.072759   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39433

	I0621 18:27:37.073274   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.073791   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.073819   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.074169   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.074346   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.076096   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:37.078312   30068 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0621 18:27:37.079815   30068 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 18:27:37.079840   30068 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0621 18:27:37.079864   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:37.081896   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41569

	I0621 18:27:37.082293   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.082859   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.082878   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.083163   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.083202   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.083607   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.083648   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.083733   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:37.083752   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.083817   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:37.083990   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:37.084135   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:37.084288   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:37.103512   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42081

	I0621 18:27:37.103937   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.104456   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.104473   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.104853   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.105052   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.106976   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:37.107211   30068 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0621 18:27:37.107231   30068 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0621 18:27:37.107252   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:37.110295   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.110729   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:37.110755   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.110870   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:37.111030   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:37.111197   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:37.111314   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:37.137868   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0621 18:27:37.228739   30068 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 18:27:37.290397   30068 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0621 18:27:37.684619   30068 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0621 18:27:37.902862   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.902882   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.902957   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.902988   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903179   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903194   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903203   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.903210   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903287   30068 main.go:141] libmachine: (ha-406291) DBG | Closing plugin on server side

	I0621 18:27:37.903300   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903312   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903321   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.903328   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903474   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903485   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903513   30068 main.go:141] libmachine: (ha-406291) DBG | Closing plugin on server side

	I0621 18:27:37.903578   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903595   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903740   30068 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0621 18:27:37.903767   30068 round_trippers.go:469] Request Headers:

	I0621 18:27:37.903778   30068 round_trippers.go:473]     Accept: application/json, */*

	I0621 18:27:37.903784   30068 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0621 18:27:37.922164   30068 round_trippers.go:574] Response Status: 200 OK in 18 milliseconds

	I0621 18:27:37.922691   30068 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0621 18:27:37.922706   30068 round_trippers.go:469] Request Headers:

	I0621 18:27:37.922713   30068 round_trippers.go:473]     Accept: application/json, */*

	I0621 18:27:37.922718   30068 round_trippers.go:473]     Content-Type: application/json

	I0621 18:27:37.922720   30068 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0621 18:27:37.926249   30068 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0621 18:27:37.926491   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.926512   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.926731   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.926748   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.928515   30068 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0621 18:27:37.930095   30068 addons.go:510] duration metric: took 889.47949ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I0621 18:27:37.930127   30068 start.go:245] waiting for cluster config update ...

	I0621 18:27:37.930137   30068 start.go:254] writing updated cluster config ...

	I0621 18:27:37.931687   30068 out.go:177] 

	I0621 18:27:37.933039   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:37.933102   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:37.934716   30068 out.go:177] * Starting "ha-406291-m02" control-plane node in "ha-406291" cluster

	I0621 18:27:37.935953   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:27:37.935970   30068 cache.go:56] Caching tarball of preloaded images

	I0621 18:27:37.936052   30068 preload.go:173] Found /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0621 18:27:37.936063   30068 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio

	I0621 18:27:37.936142   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:37.936325   30068 start.go:360] acquireMachinesLock for ha-406291-m02: {Name:mkdb5ead19d46168ac3b04a7a163113221efea18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0621 18:27:37.936370   30068 start.go:364] duration metric: took 24.972µs to acquireMachinesLock for "ha-406291-m02"

	I0621 18:27:37.936392   30068 start.go:93] Provisioning new machine with config: &{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:27:37.936481   30068 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0621 18:27:37.938349   30068 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0621 18:27:37.938428   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.938450   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.952767   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34515

	I0621 18:27:37.953176   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.953649   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.953669   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.953963   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.954162   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:37.954301   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:37.954431   30068 start.go:159] libmachine.API.Create for "ha-406291" (driver="kvm2")

	I0621 18:27:37.954456   30068 client.go:168] LocalClient.Create starting

	I0621 18:27:37.954488   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem

	I0621 18:27:37.954518   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:27:37.954538   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:27:37.954589   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem

	I0621 18:27:37.954607   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:27:37.954621   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:27:37.954636   30068 main.go:141] libmachine: Running pre-create checks...

	I0621 18:27:37.954644   30068 main.go:141] libmachine: (ha-406291-m02) Calling .PreCreateCheck

	I0621 18:27:37.954836   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:37.955238   30068 main.go:141] libmachine: Creating machine...

	I0621 18:27:37.955253   30068 main.go:141] libmachine: (ha-406291-m02) Calling .Create

	I0621 18:27:37.955404   30068 main.go:141] libmachine: (ha-406291-m02) Creating KVM machine...

	I0621 18:27:37.956748   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found existing default KVM network

	I0621 18:27:37.956951   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found existing private KVM network mk-ha-406291

	I0621 18:27:37.957069   30068 main.go:141] libmachine: (ha-406291-m02) Setting up store path in /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 ...

	I0621 18:27:37.957091   30068 main.go:141] libmachine: (ha-406291-m02) Building disk image from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso

	I0621 18:27:37.957139   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:37.957062   30460 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:27:37.957278   30068 main.go:141] libmachine: (ha-406291-m02) Downloading /home/jenkins/minikube-integration/19112-8111/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso...

	I0621 18:27:38.178433   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.178291   30460 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa...

	I0621 18:27:38.322659   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.322470   30460 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/ha-406291-m02.rawdisk...

	I0621 18:27:38.322709   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 (perms=drwx------)

	I0621 18:27:38.322719   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Writing magic tar header

	I0621 18:27:38.322734   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Writing SSH key tar header

	I0621 18:27:38.322745   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.322583   30460 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 ...

	I0621 18:27:38.322758   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02

	I0621 18:27:38.322822   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines

	I0621 18:27:38.322839   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines (perms=drwxr-xr-x)

	I0621 18:27:38.322855   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube (perms=drwxr-xr-x)

	I0621 18:27:38.322864   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111 (perms=drwxrwxr-x)

	I0621 18:27:38.322874   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0621 18:27:38.322882   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0621 18:27:38.322896   30068 main.go:141] libmachine: (ha-406291-m02) Creating domain...

	I0621 18:27:38.322919   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:27:38.322939   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111

	I0621 18:27:38.322950   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0621 18:27:38.322968   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins

	I0621 18:27:38.322980   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home

	I0621 18:27:38.322988   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Skipping /home - not owner

	I0621 18:27:38.324031   30068 main.go:141] libmachine: (ha-406291-m02) define libvirt domain using xml: 

	I0621 18:27:38.324058   30068 main.go:141] libmachine: (ha-406291-m02) <domain type='kvm'>

	I0621 18:27:38.324071   30068 main.go:141] libmachine: (ha-406291-m02)   <name>ha-406291-m02</name>

	I0621 18:27:38.324078   30068 main.go:141] libmachine: (ha-406291-m02)   <memory unit='MiB'>2200</memory>

	I0621 18:27:38.324087   30068 main.go:141] libmachine: (ha-406291-m02)   <vcpu>2</vcpu>

	I0621 18:27:38.324098   30068 main.go:141] libmachine: (ha-406291-m02)   <features>

	I0621 18:27:38.324107   30068 main.go:141] libmachine: (ha-406291-m02)     <acpi/>

	I0621 18:27:38.324116   30068 main.go:141] libmachine: (ha-406291-m02)     <apic/>

	I0621 18:27:38.324125   30068 main.go:141] libmachine: (ha-406291-m02)     <pae/>

	I0621 18:27:38.324134   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324149   30068 main.go:141] libmachine: (ha-406291-m02)   </features>

	I0621 18:27:38.324164   30068 main.go:141] libmachine: (ha-406291-m02)   <cpu mode='host-passthrough'>

	I0621 18:27:38.324173   30068 main.go:141] libmachine: (ha-406291-m02)   

	I0621 18:27:38.324184   30068 main.go:141] libmachine: (ha-406291-m02)   </cpu>

	I0621 18:27:38.324199   30068 main.go:141] libmachine: (ha-406291-m02)   <os>

	I0621 18:27:38.324209   30068 main.go:141] libmachine: (ha-406291-m02)     <type>hvm</type>

	I0621 18:27:38.324220   30068 main.go:141] libmachine: (ha-406291-m02)     <boot dev='cdrom'/>

	I0621 18:27:38.324231   30068 main.go:141] libmachine: (ha-406291-m02)     <boot dev='hd'/>

	I0621 18:27:38.324258   30068 main.go:141] libmachine: (ha-406291-m02)     <bootmenu enable='no'/>

	I0621 18:27:38.324280   30068 main.go:141] libmachine: (ha-406291-m02)   </os>

	I0621 18:27:38.324293   30068 main.go:141] libmachine: (ha-406291-m02)   <devices>

	I0621 18:27:38.324310   30068 main.go:141] libmachine: (ha-406291-m02)     <disk type='file' device='cdrom'>

	I0621 18:27:38.324333   30068 main.go:141] libmachine: (ha-406291-m02)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/boot2docker.iso'/>

	I0621 18:27:38.324344   30068 main.go:141] libmachine: (ha-406291-m02)       <target dev='hdc' bus='scsi'/>

	I0621 18:27:38.324350   30068 main.go:141] libmachine: (ha-406291-m02)       <readonly/>

	I0621 18:27:38.324357   30068 main.go:141] libmachine: (ha-406291-m02)     </disk>

	I0621 18:27:38.324363   30068 main.go:141] libmachine: (ha-406291-m02)     <disk type='file' device='disk'>

	I0621 18:27:38.324375   30068 main.go:141] libmachine: (ha-406291-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0621 18:27:38.324390   30068 main.go:141] libmachine: (ha-406291-m02)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/ha-406291-m02.rawdisk'/>

	I0621 18:27:38.324401   30068 main.go:141] libmachine: (ha-406291-m02)       <target dev='hda' bus='virtio'/>

	I0621 18:27:38.324412   30068 main.go:141] libmachine: (ha-406291-m02)     </disk>

	I0621 18:27:38.324421   30068 main.go:141] libmachine: (ha-406291-m02)     <interface type='network'>

	I0621 18:27:38.324431   30068 main.go:141] libmachine: (ha-406291-m02)       <source network='mk-ha-406291'/>

	I0621 18:27:38.324442   30068 main.go:141] libmachine: (ha-406291-m02)       <model type='virtio'/>

	I0621 18:27:38.324453   30068 main.go:141] libmachine: (ha-406291-m02)     </interface>

	I0621 18:27:38.324465   30068 main.go:141] libmachine: (ha-406291-m02)     <interface type='network'>

	I0621 18:27:38.324474   30068 main.go:141] libmachine: (ha-406291-m02)       <source network='default'/>

	I0621 18:27:38.324481   30068 main.go:141] libmachine: (ha-406291-m02)       <model type='virtio'/>

	I0621 18:27:38.324493   30068 main.go:141] libmachine: (ha-406291-m02)     </interface>

	I0621 18:27:38.324503   30068 main.go:141] libmachine: (ha-406291-m02)     <serial type='pty'>

	I0621 18:27:38.324516   30068 main.go:141] libmachine: (ha-406291-m02)       <target port='0'/>

	I0621 18:27:38.324527   30068 main.go:141] libmachine: (ha-406291-m02)     </serial>

	I0621 18:27:38.324540   30068 main.go:141] libmachine: (ha-406291-m02)     <console type='pty'>

	I0621 18:27:38.324553   30068 main.go:141] libmachine: (ha-406291-m02)       <target type='serial' port='0'/>

	I0621 18:27:38.324562   30068 main.go:141] libmachine: (ha-406291-m02)     </console>

	I0621 18:27:38.324572   30068 main.go:141] libmachine: (ha-406291-m02)     <rng model='virtio'>

	I0621 18:27:38.324596   30068 main.go:141] libmachine: (ha-406291-m02)       <backend model='random'>/dev/random</backend>

	I0621 18:27:38.324609   30068 main.go:141] libmachine: (ha-406291-m02)     </rng>

	I0621 18:27:38.324630   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324640   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324648   30068 main.go:141] libmachine: (ha-406291-m02)   </devices>

	I0621 18:27:38.324660   30068 main.go:141] libmachine: (ha-406291-m02) </domain>

	I0621 18:27:38.324670   30068 main.go:141] libmachine: (ha-406291-m02) 

	I0621 18:27:38.332042   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:20:08:0e in network default

	I0621 18:27:38.332641   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring networks are active...

	I0621 18:27:38.332676   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:38.333428   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring network default is active

	I0621 18:27:38.333804   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring network mk-ha-406291 is active

	I0621 18:27:38.334296   30068 main.go:141] libmachine: (ha-406291-m02) Getting domain xml...

	I0621 18:27:38.335120   30068 main.go:141] libmachine: (ha-406291-m02) Creating domain...

	I0621 18:27:39.549305   30068 main.go:141] libmachine: (ha-406291-m02) Waiting to get IP...

	I0621 18:27:39.550967   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:39.551951   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:39.551976   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:39.551936   30460 retry.go:31] will retry after 267.635955ms: waiting for machine to come up

	I0621 18:27:39.821522   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:39.821997   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:39.822029   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:39.821946   30460 retry.go:31] will retry after 374.873977ms: waiting for machine to come up

	I0621 18:27:40.198386   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:40.198873   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:40.198904   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:40.198809   30460 retry.go:31] will retry after 315.815993ms: waiting for machine to come up

	I0621 18:27:40.516366   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:40.516862   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:40.516886   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:40.516817   30460 retry.go:31] will retry after 541.866776ms: waiting for machine to come up

	I0621 18:27:41.060525   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:41.061206   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:41.061240   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:41.061128   30460 retry.go:31] will retry after 493.062164ms: waiting for machine to come up

	I0621 18:27:41.555747   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:41.556109   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:41.556139   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:41.556061   30460 retry.go:31] will retry after 805.68132ms: waiting for machine to come up

	I0621 18:27:42.362929   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:42.363432   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:42.363464   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:42.363390   30460 retry.go:31] will retry after 986.445399ms: waiting for machine to come up

	I0621 18:27:43.351818   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:43.352265   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:43.352293   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:43.352201   30460 retry.go:31] will retry after 1.001415085s: waiting for machine to come up

	I0621 18:27:44.355253   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:44.355689   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:44.355710   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:44.355671   30460 retry.go:31] will retry after 1.270979624s: waiting for machine to come up

	I0621 18:27:45.627787   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:45.628323   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:45.628354   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:45.628272   30460 retry.go:31] will retry after 2.328221347s: waiting for machine to come up

	I0621 18:27:47.958352   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:47.958918   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:47.958945   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:47.958858   30460 retry.go:31] will retry after 2.603205559s: waiting for machine to come up

	I0621 18:27:50.565502   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:50.565956   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:50.565982   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:50.565839   30460 retry.go:31] will retry after 3.267607258s: waiting for machine to come up

	I0621 18:27:53.834801   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:53.835311   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:53.835344   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:53.835270   30460 retry.go:31] will retry after 4.450176964s: waiting for machine to come up

	I0621 18:27:58.286744   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.287205   30068 main.go:141] libmachine: (ha-406291-m02) Found IP for machine: 192.168.39.89

	I0621 18:27:58.287228   30068 main.go:141] libmachine: (ha-406291-m02) Reserving static IP address...

	I0621 18:27:58.287241   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has current primary IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.287601   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find host DHCP lease matching {name: "ha-406291-m02", mac: "52:54:00:a6:9a:09", ip: "192.168.39.89"} in network mk-ha-406291

	I0621 18:27:58.359643   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Getting to WaitForSSH function...

	I0621 18:27:58.359672   30068 main.go:141] libmachine: (ha-406291-m02) Reserved static IP address: 192.168.39.89

	I0621 18:27:58.359686   30068 main.go:141] libmachine: (ha-406291-m02) Waiting for SSH to be available...

	I0621 18:27:58.362234   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.362656   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:minikube Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.362687   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.362831   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using SSH client type: external

	I0621 18:27:58.362856   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa (-rw-------)

	I0621 18:27:58.362889   30068 main.go:141] libmachine: (ha-406291-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.89 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:58.362901   30068 main.go:141] libmachine: (ha-406291-m02) DBG | About to run SSH command:

	I0621 18:27:58.362914   30068 main.go:141] libmachine: (ha-406291-m02) DBG | exit 0

	I0621 18:27:58.489760   30068 main.go:141] libmachine: (ha-406291-m02) DBG | SSH cmd err, output: <nil>: 

	I0621 18:27:58.490247   30068 main.go:141] libmachine: (ha-406291-m02) KVM machine creation complete!

	I0621 18:27:58.490512   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:58.491093   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:58.491338   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:58.491506   30068 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0621 18:27:58.491523   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetState

	I0621 18:27:58.492807   30068 main.go:141] libmachine: Detecting operating system of created instance...

	I0621 18:27:58.492820   30068 main.go:141] libmachine: Waiting for SSH to be available...

	I0621 18:27:58.492825   30068 main.go:141] libmachine: Getting to WaitForSSH function...

	I0621 18:27:58.492853   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.495422   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.495802   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.495822   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.496013   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.496199   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.496377   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.496515   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.496690   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.496943   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.496957   30068 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0621 18:27:58.609072   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:58.609094   30068 main.go:141] libmachine: Detecting the provisioner...

	I0621 18:27:58.609101   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.611976   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.612412   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.612450   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.612655   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.612869   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.613083   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.613234   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.613421   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.613617   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.613629   30068 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0621 18:27:58.726636   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0621 18:27:58.726736   30068 main.go:141] libmachine: found compatible host: buildroot

	I0621 18:27:58.726751   30068 main.go:141] libmachine: Provisioning with buildroot...

	I0621 18:27:58.726768   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.727017   30068 buildroot.go:166] provisioning hostname "ha-406291-m02"

	I0621 18:27:58.727040   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.727234   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.729851   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.730255   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.730296   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.730453   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.730628   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.730787   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.730932   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.731090   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.731271   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.731295   30068 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-406291-m02 && echo "ha-406291-m02" | sudo tee /etc/hostname

	I0621 18:27:58.855682   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-406291-m02

	I0621 18:27:58.855710   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.858373   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.858679   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.858702   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.858921   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.859107   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.859289   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.859473   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.859613   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.859768   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.859784   30068 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-406291-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-406291-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-406291-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0621 18:27:58.979692   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:58.979722   30068 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19112-8111/.minikube CaCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19112-8111/.minikube}

	I0621 18:27:58.979735   30068 buildroot.go:174] setting up certificates

	I0621 18:27:58.979743   30068 provision.go:84] configureAuth start

	I0621 18:27:58.979750   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.980076   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:58.982730   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.983078   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.983110   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.983252   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.985344   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.985701   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.985721   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.985890   30068 provision.go:143] copyHostCerts

	I0621 18:27:58.985924   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:58.985962   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem, removing ...

	I0621 18:27:58.985976   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:58.986057   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem (1082 bytes)

	I0621 18:27:58.986156   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:58.986180   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem, removing ...

	I0621 18:27:58.986187   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:58.986229   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem (1123 bytes)

	I0621 18:27:58.986293   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:58.986317   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem, removing ...

	I0621 18:27:58.986326   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:58.986360   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem (1675 bytes)

	I0621 18:27:58.986426   30068 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem org=jenkins.ha-406291-m02 san=[127.0.0.1 192.168.39.89 ha-406291-m02 localhost minikube]

	I0621 18:27:59.066564   30068 provision.go:177] copyRemoteCerts

	I0621 18:27:59.066626   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0621 18:27:59.066653   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.069578   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.069924   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.069947   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.070132   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.070298   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.070432   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.070553   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.157218   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0621 18:27:59.157315   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0621 18:27:59.181198   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0621 18:27:59.181277   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0621 18:27:59.204590   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0621 18:27:59.204671   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0621 18:27:59.228836   30068 provision.go:87] duration metric: took 249.081961ms to configureAuth

	I0621 18:27:59.228857   30068 buildroot.go:189] setting minikube options for container-runtime

	I0621 18:27:59.229023   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:59.229086   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.231759   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.232083   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.232114   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.232338   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.232525   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.232684   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.232859   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.233030   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:59.233222   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:59.233247   30068 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0621 18:27:59.513149   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0621 18:27:59.513176   30068 main.go:141] libmachine: Checking connection to Docker...

	I0621 18:27:59.513184   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetURL

	I0621 18:27:59.514352   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using libvirt version 6000000

	I0621 18:27:59.516825   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.517208   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.517232   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.517421   30068 main.go:141] libmachine: Docker is up and running!

	I0621 18:27:59.517438   30068 main.go:141] libmachine: Reticulating splines...

	I0621 18:27:59.517446   30068 client.go:171] duration metric: took 21.562982419s to LocalClient.Create

	I0621 18:27:59.517469   30068 start.go:167] duration metric: took 21.563040702s to libmachine.API.Create "ha-406291"

	I0621 18:27:59.517482   30068 start.go:293] postStartSetup for "ha-406291-m02" (driver="kvm2")

	I0621 18:27:59.517494   30068 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0621 18:27:59.517516   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.517768   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0621 18:27:59.517792   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.520113   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.520510   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.520540   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.520681   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.520881   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.521084   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.521256   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.607755   30068 ssh_runner.go:195] Run: cat /etc/os-release

	I0621 18:27:59.611555   30068 info.go:137] Remote host: Buildroot 2023.02.9

	I0621 18:27:59.611581   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/addons for local assets ...

	I0621 18:27:59.611696   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/files for local assets ...

	I0621 18:27:59.611804   30068 filesync.go:149] local asset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> 153292.pem in /etc/ssl/certs

	I0621 18:27:59.611817   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /etc/ssl/certs/153292.pem

	I0621 18:27:59.611939   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0621 18:27:59.620359   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:59.643420   30068 start.go:296] duration metric: took 125.923821ms for postStartSetup

	I0621 18:27:59.643465   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:59.644062   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:59.646345   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.646685   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.646713   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.646924   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:59.647158   30068 start.go:128] duration metric: took 21.710666055s to createHost

	I0621 18:27:59.647181   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.649469   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.649766   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.649808   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.649962   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.650164   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.650334   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.650463   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.650585   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:59.650778   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:59.650790   30068 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0621 18:27:59.762223   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718994479.737744516

	I0621 18:27:59.762248   30068 fix.go:216] guest clock: 1718994479.737744516

	I0621 18:27:59.762259   30068 fix.go:229] Guest: 2024-06-21 18:27:59.737744516 +0000 UTC Remote: 2024-06-21 18:27:59.647170431 +0000 UTC m=+77.232139235 (delta=90.574085ms)

	I0621 18:27:59.762274   30068 fix.go:200] guest clock delta is within tolerance: 90.574085ms

	I0621 18:27:59.762279   30068 start.go:83] releasing machines lock for "ha-406291-m02", held for 21.825898335s

	I0621 18:27:59.762294   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.762550   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:59.765379   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.765744   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.765772   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.768017   30068 out.go:177] * Found network options:

	I0621 18:27:59.769201   30068 out.go:177]   - NO_PROXY=192.168.39.198

	W0621 18:27:59.770311   30068 proxy.go:119] fail to check proxy env: Error ip not in block

	I0621 18:27:59.770350   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.770853   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.771049   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.771143   30068 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0621 18:27:59.771180   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	W0621 18:27:59.771247   30068 proxy.go:119] fail to check proxy env: Error ip not in block

	I0621 18:27:59.771305   30068 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0621 18:27:59.771322   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.774073   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774210   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774455   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.774482   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774586   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.774595   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.774615   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774740   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.774796   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.774875   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.774963   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.775030   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.775150   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.775184   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:28:00.009851   30068 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0621 18:28:00.016373   30068 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0621 18:28:00.016450   30068 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0621 18:28:00.032199   30068 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0621 18:28:00.032221   30068 start.go:494] detecting cgroup driver to use...

	I0621 18:28:00.032283   30068 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0621 18:28:00.047343   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0621 18:28:00.061720   30068 docker.go:217] disabling cri-docker service (if available) ...

	I0621 18:28:00.061774   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0621 18:28:00.074668   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0621 18:28:00.087919   30068 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0621 18:28:00.213060   30068 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0621 18:28:00.376339   30068 docker.go:233] disabling docker service ...

	I0621 18:28:00.376406   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0621 18:28:00.391732   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0621 18:28:00.405305   30068 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0621 18:28:00.525867   30068 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0621 18:28:00.642362   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0621 18:28:00.656276   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0621 18:28:00.673811   30068 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0621 18:28:00.673883   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.683794   30068 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0621 18:28:00.683849   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.693601   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.703298   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.712924   30068 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0621 18:28:00.722921   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.733272   30068 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.749781   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.759708   30068 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0621 18:28:00.768749   30068 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0621 18:28:00.768811   30068 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0621 18:28:00.780758   30068 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0621 18:28:00.789993   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:28:00.904855   30068 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0621 18:28:01.039631   30068 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0621 18:28:01.039706   30068 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0621 18:28:01.044480   30068 start.go:562] Will wait 60s for crictl version

	I0621 18:28:01.044536   30068 ssh_runner.go:195] Run: which crictl

	I0621 18:28:01.048220   30068 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0621 18:28:01.089333   30068 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0621 18:28:01.089402   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:28:01.115665   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:28:01.144585   30068 out.go:177] * Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	I0621 18:28:01.145952   30068 out.go:177]   - env NO_PROXY=192.168.39.198

	I0621 18:28:01.147149   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:28:01.149745   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:28:01.150121   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:28:01.150153   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:28:01.150424   30068 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0621 18:28:01.154395   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:28:01.167802   30068 mustload.go:65] Loading cluster: ha-406291

	I0621 18:28:01.168024   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:28:01.168528   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:28:01.168581   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:28:01.183458   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35465

	I0621 18:28:01.183955   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:28:01.184452   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:28:01.184472   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:28:01.184809   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:28:01.185006   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:28:01.186504   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:28:01.186796   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:28:01.186838   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:28:01.201898   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38995

	I0621 18:28:01.202307   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:28:01.202715   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:28:01.202735   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:28:01.203060   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:28:01.203242   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:28:01.203402   30068 certs.go:68] Setting up /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291 for IP: 192.168.39.89

	I0621 18:28:01.203414   30068 certs.go:194] generating shared ca certs ...

	I0621 18:28:01.203427   30068 certs.go:226] acquiring lock for ca certs: {Name:mk96df7d45efa699c355b4c4409471361aa3f418 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.203536   30068 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key

	I0621 18:28:01.203569   30068 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key

	I0621 18:28:01.203578   30068 certs.go:256] generating profile certs ...

	I0621 18:28:01.203637   30068 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key

	I0621 18:28:01.203663   30068 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63

	I0621 18:28:01.203682   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.198 192.168.39.89 192.168.39.254]

	I0621 18:28:01.277240   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 ...

	I0621 18:28:01.277269   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63: {Name:mk0eb1e86875fe5e87f845f9e621f66001c859bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.277433   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63 ...

	I0621 18:28:01.277446   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63: {Name:mk95e28e76a927e44fae3dabafa76ecc474c70ef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.277517   30068 certs.go:381] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt

	I0621 18:28:01.277686   30068 certs.go:385] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key

	I0621 18:28:01.277852   30068 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key

	I0621 18:28:01.277870   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0621 18:28:01.277883   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0621 18:28:01.277894   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0621 18:28:01.277906   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0621 18:28:01.277922   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0621 18:28:01.277934   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0621 18:28:01.277946   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0621 18:28:01.277957   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0621 18:28:01.278003   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem (1338 bytes)

	W0621 18:28:01.278030   30068 certs.go:480] ignoring /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329_empty.pem, impossibly tiny 0 bytes

	I0621 18:28:01.278039   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem (1675 bytes)

	I0621 18:28:01.278059   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem (1082 bytes)

	I0621 18:28:01.278080   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem (1123 bytes)

	I0621 18:28:01.278100   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem (1675 bytes)

	I0621 18:28:01.278136   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:28:01.278162   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.278179   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem -> /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.278191   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.278220   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:28:01.281289   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:28:01.281749   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:28:01.281771   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:28:01.281960   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:28:01.282180   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:28:01.282351   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:28:01.282534   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:28:01.350153   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0621 18:28:01.355146   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0621 18:28:01.366317   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0621 18:28:01.370418   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0621 18:28:01.381527   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0621 18:28:01.385371   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0621 18:28:01.395583   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0621 18:28:01.399523   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0621 18:28:01.409427   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0621 18:28:01.413340   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0621 18:28:01.424281   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0621 18:28:01.428574   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0621 18:28:01.443501   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0621 18:28:01.467141   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0621 18:28:01.489464   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0621 18:28:01.512839   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0621 18:28:01.536345   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0621 18:28:01.560903   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0621 18:28:01.585228   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0621 18:28:01.609236   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0621 18:28:01.632797   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0621 18:28:01.657717   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem --> /usr/share/ca-certificates/15329.pem (1338 bytes)

	I0621 18:28:01.680728   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /usr/share/ca-certificates/153292.pem (1708 bytes)

	I0621 18:28:01.704813   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0621 18:28:01.722206   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0621 18:28:01.739548   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0621 18:28:01.757066   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0621 18:28:01.773769   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0621 18:28:01.790648   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0621 18:28:01.807019   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0621 18:28:01.824606   30068 ssh_runner.go:195] Run: openssl version

	I0621 18:28:01.830760   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0621 18:28:01.841994   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.846701   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 21 17:42 /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.846753   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.852556   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0621 18:28:01.863407   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15329.pem && ln -fs /usr/share/ca-certificates/15329.pem /etc/ssl/certs/15329.pem"

	I0621 18:28:01.874586   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.879134   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 21 18:22 /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.879185   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.884636   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15329.pem /etc/ssl/certs/51391683.0"

	I0621 18:28:01.895639   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/153292.pem && ln -fs /usr/share/ca-certificates/153292.pem /etc/ssl/certs/153292.pem"

	I0621 18:28:01.907107   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.911747   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 21 18:22 /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.911813   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.917537   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/153292.pem /etc/ssl/certs/3ec20f2e.0"

	I0621 18:28:01.928452   30068 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0621 18:28:01.932569   30068 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0621 18:28:01.932640   30068 kubeadm.go:928] updating node {m02 192.168.39.89 8443 v1.30.2 crio true true} ...

	I0621 18:28:01.932831   30068 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-406291-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.89

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0621 18:28:01.932869   30068 kube-vip.go:115] generating kube-vip config ...

	I0621 18:28:01.932919   30068 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0621 18:28:01.949970   30068 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0621 18:28:01.950046   30068 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0621 18:28:01.950102   30068 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0621 18:28:01.960116   30068 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.2': No such file or directory

	Initiating transfer...

	I0621 18:28:01.960197   30068 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.2

	I0621 18:28:01.969893   30068 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubectl.sha256

	I0621 18:28:01.969926   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubectl -> /var/lib/minikube/binaries/v1.30.2/kubectl

	I0621 18:28:01.969997   30068 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubectl

	I0621 18:28:01.970033   30068 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm

	I0621 18:28:01.970001   30068 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubelet

	I0621 18:28:01.974344   30068 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubectl': No such file or directory

	I0621 18:28:01.974375   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubectl --> /var/lib/minikube/binaries/v1.30.2/kubectl (51454104 bytes)

	I0621 18:28:02.755689   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm -> /var/lib/minikube/binaries/v1.30.2/kubeadm

	I0621 18:28:02.755764   30068 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubeadm

	I0621 18:28:02.760415   30068 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubeadm': No such file or directory

	I0621 18:28:02.760448   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm --> /var/lib/minikube/binaries/v1.30.2/kubeadm (50249880 bytes)

	I0621 18:28:55.051081   30068 out.go:177] 

	W0621 18:28:55.052955   30068 out.go:239] X Exiting due to GUEST_START: failed to start node: adding node: update node: downloading binaries: downloading kubelet: download failed: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256 Dst:/home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0] Decompressors:map[bz2:0xc000769610 gz:0xc000769618 tar:0xc0007695c0 tar.bz2:0xc0007695d0 tar.gz:0xc0007695e0 tar.xz:0xc0007695f0 tar.zst:0xc000769600 tbz2:0xc0007695d0 tgz:0xc0007695e0 txz:0xc0007695f0 tzst:0xc000769600 xz:0xc000769620 zip:0xc000769630 zst:0xc000769628] Getters:map[file:0xc0009371c0 http:0xc

0008bcf50 https:0xc0008bcfa0] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: read tcp 10.154.0.3:46716->151.101.193.55:443: read: connection reset by peer

	W0621 18:28:55.052979   30068 out.go:239] * 

	W0621 18:28:55.053829   30068 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0621 18:28:55.055312   30068 out.go:177] 

	==> CRI-O <==

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.822540960Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=d4e45a41-ec4f-40c7-8779-0432ec70b729 name=/runtime.v1.RuntimeService/Version

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.823569338Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=8270b6ac-090c-48b1-81cc-fe2d46f0328b name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.823987700Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718994535823964068,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:136079,},InodesUsed:&UInt64Value{Value:62,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=8270b6ac-090c-48b1-81cc-fe2d46f0328b name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.824514756Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=1f5d9d00-0a59-4e6b-b100-04f7445422b5 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.824567597Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=1f5d9d00-0a59-4e6b-b100-04f7445422b5 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.824770463Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\

"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io

.kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5

af0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718994

458069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]stri

ng{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string

{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: ku

be-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-

ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernet

es.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=1f5d9d00-0a59-4e6b-b100-04f7445422b5 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.829122752Z" level=debug msg="Request: &ListPodSandboxRequest{Filter:nil,}" file="otel-collector/interceptors.go:62" id=bd91b3c2-2aa2-4bc3-be38-2bf665719483 name=/runtime.v1.RuntimeService/ListPodSandbox

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.829883079Z" level=debug msg="Response: &ListPodSandboxResponse{Items:[]*PodSandbox{&PodSandbox{Id:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&PodSandboxMetadata{Name:storage-provisioner,Uid:f6a39ae0-87ac-492a-a711-290e61bb895e,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994459650788102,Labels:map[string]string{addonmanager.kubernetes.io/mode: Reconcile,integration-test: storage-provisioner,io.kubernetes.container.name: POD,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{kubectl.kubernetes.io/last-applied-configuration: {\"apiVersion\":\"v1\",\"kind\":\"Pod\",\"metadata\":{\"annotations\":{},\"labels\":{\"addonmanager.kubernetes.io/mode\":\"Reconcile\",\"integration-test\":\"storage-provisioner\"},\"name\":\"storage-provisioner\",\"namespace\":\"kube-system\"

},\"spec\":{\"containers\":[{\"command\":[\"/storage-provisioner\"],\"image\":\"gcr.io/k8s-minikube/storage-provisioner:v5\",\"imagePullPolicy\":\"IfNotPresent\",\"name\":\"storage-provisioner\",\"volumeMounts\":[{\"mountPath\":\"/tmp\",\"name\":\"tmp\"}]}],\"hostNetwork\":true,\"serviceAccountName\":\"storage-provisioner\",\"volumes\":[{\"hostPath\":{\"path\":\"/tmp\",\"type\":\"Directory\"},\"name\":\"tmp\"}]}}\n,kubernetes.io/config.seen: 2024-06-21T18:27:39.331926430Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&PodSandboxMetadata{Name:coredns-7db6d8ff4d-7ng4v,Uid:4724701c-6f0e-45ed-8fc7-70245d4fa569,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994459636285025,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,k8s-app: kube-dns,pod

-template-hash: 7db6d8ff4d,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-06-21T18:27:39.324840171Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&PodSandboxMetadata{Name:coredns-7db6d8ff4d-nx5xs,Uid:375157ef-5af0-41b9-8ed9-162e5a88c679,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994459635123081,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5af0-41b9-8ed9-162e5a88c679,k8s-app: kube-dns,pod-template-hash: 7db6d8ff4d,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-06-21T18:27:39.328881687Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&PodSandboxMetadata{Name:kube-proxy-xnbqj,Uid:11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,Namespace:kube-sys

tem,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994457732197222,Labels:map[string]string{controller-revision-hash: 669fc44fbc,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,k8s-app: kube-proxy,pod-template-generation: 1,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-06-21T18:27:37.424597593Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&PodSandboxMetadata{Name:kindnet-vnds7,Uid:e921d86f-0ac3-413e-9e85-e809139ca210,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994457715084104,Labels:map[string]string{app: kindnet,controller-revision-hash: 84c66bd94d,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,k8s-app: kindnet,pod-template

-generation: 1,tier: node,},Annotations:map[string]string{kubernetes.io/config.seen: 2024-06-21T18:27:37.400904877Z,kubernetes.io/config.source: api,},RuntimeHandler:,},&PodSandbox{Id:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&PodSandboxMetadata{Name:kube-scheduler-ha-406291,Uid:81efe8b097b0aaeaaac87f9a6e2dfe3b,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994437888590878,Labels:map[string]string{component: kube-scheduler,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 81efe8b097b0aaeaaac87f9a6e2dfe3b,kubernetes.io/config.seen: 2024-06-21T18:27:17.383181217Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&PodSandboxMetadata{Name:kube-vip-ha-406291,Uid:29b

f44d365a415a68be28c9aad205c23,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994437887303918,Labels:map[string]string{io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{kubernetes.io/config.hash: 29bf44d365a415a68be28c9aad205c23,kubernetes.io/config.seen: 2024-06-21T18:27:17.383182123Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&PodSandboxMetadata{Name:etcd-ha-406291,Uid:28eb1f9a7974972f95837a71475ffe97,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994437864857022,Labels:map[string]string{component: etcd,io.kubernetes.container.name: POD,io.kubernetes.pod.name: etcd-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,tier: control-plane,},Annotations:map[string]s

tring{kubeadm.kubernetes.io/etcd.advertise-client-urls: https://192.168.39.198:2379,kubernetes.io/config.hash: 28eb1f9a7974972f95837a71475ffe97,kubernetes.io/config.seen: 2024-06-21T18:27:17.383174241Z,kubernetes.io/config.source: file,},RuntimeHandler:,},&PodSandbox{Id:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&PodSandboxMetadata{Name:kube-apiserver-ha-406291,Uid:ac2d2e5dadb6d48084ee46b3119245c5,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994437841913023,Labels:map[string]string{component: kube-apiserver,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,tier: control-plane,},Annotations:map[string]string{kubeadm.kubernetes.io/kube-apiserver.advertise-address.endpoint: 192.168.39.198:8443,kubernetes.io/config.hash: ac2d2e5dadb6d48084ee46b3119245c5,kubernetes.io/config.seen: 2024-06-21T18:27:17.383178563Z,kubernetes.io/config.s

ource: file,},RuntimeHandler:,},&PodSandbox{Id:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&PodSandboxMetadata{Name:kube-controller-manager-ha-406291,Uid:8bd582f38b9812a77200f468c3cf9c0d,Namespace:kube-system,Attempt:0,},State:SANDBOX_READY,CreatedAt:1718994437841113621,Labels:map[string]string{component: kube-controller-manager,io.kubernetes.container.name: POD,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,tier: control-plane,},Annotations:map[string]string{kubernetes.io/config.hash: 8bd582f38b9812a77200f468c3cf9c0d,kubernetes.io/config.seen: 2024-06-21T18:27:17.383179836Z,kubernetes.io/config.source: file,},RuntimeHandler:,},},}" file="otel-collector/interceptors.go:74" id=bd91b3c2-2aa2-4bc3-be38-2bf665719483 name=/runtime.v1.RuntimeService/ListPodSandbox

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.830505800Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=8b2f14e2-2ee6-4e76-942a-7823b78bb2f1 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.830554084Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=8b2f14e2-2ee6-4e76-942a-7823b78bb2f1 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.830748784Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\

"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io

.kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5

af0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718994

458069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]stri

ng{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string

{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: ku

be-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-

ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernet

es.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=8b2f14e2-2ee6-4e76-942a-7823b78bb2f1 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.860959537Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=1cea5a18-1e58-4b68-8f8b-62a411140d7f name=/runtime.v1.RuntimeService/Version

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.861045861Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=1cea5a18-1e58-4b68-8f8b-62a411140d7f name=/runtime.v1.RuntimeService/Version

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.862219381Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=7e5a5dff-434c-4680-83af-4f6f24c87666 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.862602659Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718994535862579359,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:136079,},InodesUsed:&UInt64Value{Value:62,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=7e5a5dff-434c-4680-83af-4f6f24c87666 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.863228019Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=a48ad0f1-2025-4c80-914f-39fcd533cea0 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.863282163Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=a48ad0f1-2025-4c80-914f-39fcd533cea0 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.863481461Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\

"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io

.kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5

af0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718994

458069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]stri

ng{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string

{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: ku

be-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-

ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernet

es.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=a48ad0f1-2025-4c80-914f-39fcd533cea0 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.899830542Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=c8155c29-9fb1-4814-a565-7424ffa9769c name=/runtime.v1.RuntimeService/Version

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.899921021Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=c8155c29-9fb1-4814-a565-7424ffa9769c name=/runtime.v1.RuntimeService/Version

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.900895175Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=dd8738ac-fb40-4078-a1a1-af70d5ddd84b name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.901479971Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718994535901448581,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:136079,},InodesUsed:&UInt64Value{Value:62,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=dd8738ac-fb40-4078-a1a1-af70d5ddd84b name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.901982840Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=097c3a5f-f9c0-4a33-95af-edd3dd9ead1d name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.902035060Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=097c3a5f-f9c0-4a33-95af-edd3dd9ead1d name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:28:55 ha-406291 crio[679]: time="2024-06-21 18:28:55.902285318Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\

"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io

.kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5

af0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:1718994

458069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]stri

ng{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string

{io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: ku

be-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-

ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernet

es.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=097c3a5f-f9c0-4a33-95af-edd3dd9ead1d name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                               CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	6d732e2622f11       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                    About a minute ago   Running             coredns                   0                   59eb38b2794b0       coredns-7db6d8ff4d-7ng4v

	6088ccc5ec4be       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                    About a minute ago   Running             coredns                   0                   a68caa8578d30       coredns-7db6d8ff4d-nx5xs

	9d0ad73531279       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                    About a minute ago   Running             storage-provisioner       0                   ab6a16146209c       storage-provisioner

	468b13f5a8054       ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f                                    About a minute ago   Running             kindnet-cni               0                   956df8749e8db       kindnet-vnds7

	e41f8891c5177       53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772                                    About a minute ago   Running             kube-proxy                0                   ab9fd8c2e0094       kube-proxy-xnbqj

	96a229fabb5aa       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f   About a minute ago   Running             kube-vip                  0                   79ad95611cf22       kube-vip-ha-406291

	a143e6000662a       7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940                                    About a minute ago   Running             kube-scheduler            0                   7cae0fc993f3a       kube-scheduler-ha-406291

	89b399d67fa40       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                    About a minute ago   Running             etcd                      0                   afce4542ea7ca       etcd-ha-406291

	2d71c6ae5cee5       56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe                                    About a minute ago   Running             kube-apiserver            0                   9552de7a0cb73       kube-apiserver-ha-406291

	3fbe446b39e8d       e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974                                    About a minute ago   Running             kube-controller-manager   0                   2b8837f8e36da       kube-controller-manager-ha-406291

	==> coredns [6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c

	CoreDNS-1.11.1

	linux/amd64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:57758 - 16030 "HINFO IN 938012208132191314.8379741084222464033. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.014128651s

	==> coredns [6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c

	CoreDNS-1.11.1

	linux/amd64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:45911 - 30730 "HINFO IN 2397840142540691982.2649863782968500509. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014966559s

	==> describe nodes <==

	Name:               ha-406291

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-406291

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=1a0d377c34faa85740cf2404ea12566198300600

	                    minikube.k8s.io/name=ha-406291

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_06_21T18_27_25_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 21 Jun 2024 18:27:23 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-406291

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 21 Jun 2024 18:28:46 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 21 Jun 2024 18:27:39 +0000   Fri, 21 Jun 2024 18:27:23 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 21 Jun 2024 18:27:39 +0000   Fri, 21 Jun 2024 18:27:23 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 21 Jun 2024 18:27:39 +0000   Fri, 21 Jun 2024 18:27:23 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 21 Jun 2024 18:27:39 +0000   Fri, 21 Jun 2024 18:27:39 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.198

	  Hostname:    ha-406291

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 10b5f2f4e64d426eb3a71e7a23c0cea5

	  System UUID:                10b5f2f4-e64d-426e-b3a7-1e7a23c0cea5

	  Boot ID:                    10778ad9-ed13-4749-a084-25b2b2bfde76

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.2

	  Kube-Proxy Version:         v1.30.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (10 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  kube-system                 coredns-7db6d8ff4d-7ng4v             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     79s

	  kube-system                 coredns-7db6d8ff4d-nx5xs             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     79s

	  kube-system                 etcd-ha-406291                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         92s

	  kube-system                 kindnet-vnds7                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      79s

	  kube-system                 kube-apiserver-ha-406291             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s

	  kube-system                 kube-controller-manager-ha-406291    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s

	  kube-system                 kube-proxy-xnbqj                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s

	  kube-system                 kube-scheduler-ha-406291             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s

	  kube-system                 kube-vip-ha-406291                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         92s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         79s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 77s   kube-proxy       

	  Normal  Starting                 92s   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  92s   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  92s   kubelet          Node ha-406291 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    92s   kubelet          Node ha-406291 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     92s   kubelet          Node ha-406291 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           80s   node-controller  Node ha-406291 event: Registered Node ha-406291 in Controller

	  Normal  NodeReady                77s   kubelet          Node ha-406291 status is now: NodeReady

	==> dmesg <==

	[Jun21 18:26] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.051748] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.037330] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.458081] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.725935] systemd-fstab-generator[115]: Ignoring "noauto" option for root device

	[  +4.855560] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[Jun21 18:27] systemd-fstab-generator[596]: Ignoring "noauto" option for root device

	[  +0.057394] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.056681] systemd-fstab-generator[608]: Ignoring "noauto" option for root device

	[  +0.167604] systemd-fstab-generator[622]: Ignoring "noauto" option for root device

	[  +0.147792] systemd-fstab-generator[634]: Ignoring "noauto" option for root device

	[  +0.253886] systemd-fstab-generator[664]: Ignoring "noauto" option for root device

	[  +3.905184] systemd-fstab-generator[763]: Ignoring "noauto" option for root device

	[  +4.549385] systemd-fstab-generator[943]: Ignoring "noauto" option for root device

	[  +0.060073] kauditd_printk_skb: 158 callbacks suppressed

	[  +7.066237] systemd-fstab-generator[1360]: Ignoring "noauto" option for root device

	[  +0.078680] kauditd_printk_skb: 79 callbacks suppressed

	[ +13.552032] kauditd_printk_skb: 21 callbacks suppressed

	==> etcd [89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8] <==

	{"level":"info","ts":"2024-06-21T18:27:18.510332Z","caller":"membership/cluster.go:421","msg":"added member","cluster-id":"9fb372ad12afeb1b","local-member-id":"f1d2ab5330a2a0e3","added-peer-id":"f1d2ab5330a2a0e3","added-peer-peer-urls":["https://192.168.39.198:2380"]}

	{"level":"info","ts":"2024-06-21T18:27:18.510599Z","caller":"embed/etcd.go:857","msg":"serving metrics","address":"http://127.0.0.1:2381"}

	{"level":"info","ts":"2024-06-21T18:27:18.510131Z","caller":"embed/etcd.go:597","msg":"serving peer traffic","address":"192.168.39.198:2380"}

	{"level":"info","ts":"2024-06-21T18:27:18.512305Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.39.198:2380"}

	{"level":"info","ts":"2024-06-21T18:27:18.939239Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 is starting a new election at term 1"}

	{"level":"info","ts":"2024-06-21T18:27:18.93929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 became pre-candidate at term 1"}

	{"level":"info","ts":"2024-06-21T18:27:18.93932Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 received MsgPreVoteResp from f1d2ab5330a2a0e3 at term 1"}

	{"level":"info","ts":"2024-06-21T18:27:18.939332Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 became candidate at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.939339Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 received MsgVoteResp from f1d2ab5330a2a0e3 at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.939349Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 became leader at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.93936Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: f1d2ab5330a2a0e3 elected leader f1d2ab5330a2a0e3 at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.949394Z","caller":"etcdserver/server.go:2578","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.951989Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"f1d2ab5330a2a0e3","local-member-attributes":"{Name:ha-406291 ClientURLs:[https://192.168.39.198:2379]}","request-path":"/0/members/f1d2ab5330a2a0e3/attributes","cluster-id":"9fb372ad12afeb1b","publish-timeout":"7s"}

	{"level":"info","ts":"2024-06-21T18:27:18.952029Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-06-21T18:27:18.952218Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-06-21T18:27:18.966375Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"9fb372ad12afeb1b","local-member-id":"f1d2ab5330a2a0e3","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.966532Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.966591Z","caller":"etcdserver/server.go:2602","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.968078Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.198:2379"}

	{"level":"info","ts":"2024-06-21T18:27:18.969834Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-06-21T18:27:18.973596Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-06-21T18:27:18.986355Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-06-21T18:27:37.357719Z","caller":"traceutil/trace.go:171","msg":"trace[571743030] transaction","detail":"{read_only:false; response_revision:348; number_of_response:1; }","duration":"105.067279ms","start":"2024-06-21T18:27:37.252598Z","end":"2024-06-21T18:27:37.357665Z","steps":["trace[571743030] 'process raft request'  (duration: 48.775466ms)","trace[571743030] 'compare'  (duration: 56.093787ms)"],"step_count":2}

	{"level":"warn","ts":"2024-06-21T18:28:12.689426Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"125.176174ms","expected-duration":"100ms","prefix":"","request":"header:<ID:11593268453381319053 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/leases/kube-system/plndr-cp-lock\" mod_revision:496 > success:<request_put:<key:\"/registry/leases/kube-system/plndr-cp-lock\" value_size:369 >> failure:<request_range:<key:\"/registry/leases/kube-system/plndr-cp-lock\" > >>","response":"size:16"}

	{"level":"info","ts":"2024-06-21T18:28:12.689586Z","caller":"traceutil/trace.go:171","msg":"trace[939483523] transaction","detail":"{read_only:false; response_revision:499; number_of_response:1; }","duration":"172.541349ms","start":"2024-06-21T18:28:12.517021Z","end":"2024-06-21T18:28:12.689563Z","steps":["trace[939483523] 'process raft request'  (duration: 46.605278ms)","trace[939483523] 'compare'  (duration: 124.988397ms)"],"step_count":2}

	==> kernel <==

	 18:28:56 up 2 min,  0 users,  load average: 0.39, 0.25, 0.10

	Linux ha-406291 5.10.207 #1 SMP Fri Jun 21 03:52:19 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d] <==

	I0621 18:27:38.526466       1 main.go:102] connected to apiserver: https://10.96.0.1:443

	I0621 18:27:38.526639       1 main.go:107] hostIP = 192.168.39.198

	podIP = 192.168.39.198

	I0621 18:27:38.526767       1 main.go:116] setting mtu 1500 for CNI 

	I0621 18:27:38.526806       1 main.go:146] kindnetd IP family: "ipv4"

	I0621 18:27:38.526839       1 main.go:150] noMask IPv4 subnets: [10.244.0.0/16]

	I0621 18:27:38.925421       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:27:38.925483       1 main.go:227] handling current node

	I0621 18:27:48.946917       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:27:48.947039       1 main.go:227] handling current node

	I0621 18:27:58.955943       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:27:58.955999       1 main.go:227] handling current node

	I0621 18:28:08.959980       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:28:08.960127       1 main.go:227] handling current node

	I0621 18:28:18.967622       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:28:18.967699       1 main.go:227] handling current node

	I0621 18:28:28.971777       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:28:28.972007       1 main.go:227] handling current node

	I0621 18:28:38.976413       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:28:38.976517       1 main.go:227] handling current node

	I0621 18:28:48.989811       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:28:48.989884       1 main.go:227] handling current node

	==> kube-apiserver [2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3] <==

	I0621 18:27:21.223644       1 aggregator.go:165] initial CRD sync complete...

	I0621 18:27:21.223665       1 autoregister_controller.go:141] Starting autoregister controller

	I0621 18:27:21.223672       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0621 18:27:21.223679       1 cache.go:39] Caches are synced for autoregister controller

	I0621 18:27:21.228827       1 shared_informer.go:320] Caches are synced for node_authorizer

	I0621 18:27:21.231033       1 shared_informer.go:320] Caches are synced for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0621 18:27:21.231057       1 policy_source.go:224] refreshing policies

	E0621 18:27:21.244004       1 controller.go:145] while syncing ConfigMap "kube-system/kube-apiserver-legacy-service-account-token-tracking", err: namespaces "kube-system" not found

	I0621 18:27:21.291900       1 controller.go:615] quota admission added evaluator for: namespaces

	I0621 18:27:21.301249       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0621 18:27:22.093764       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000

	I0621 18:27:22.100226       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000

	I0621 18:27:22.100345       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0621 18:27:22.679124       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0621 18:27:22.717908       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0621 18:27:22.803597       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W0621 18:27:22.812663       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.198]

	I0621 18:27:22.813674       1 controller.go:615] quota admission added evaluator for: endpoints

	I0621 18:27:22.817676       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0621 18:27:23.142771       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0621 18:27:24.323202       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0621 18:27:24.338622       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0621 18:27:24.532806       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0621 18:27:36.921775       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0621 18:27:37.247444       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	==> kube-controller-manager [3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31] <==

	I0621 18:27:36.884308       1 node_lifecycle_controller.go:1031] "Controller detected that all Nodes are not-Ready. Entering master disruption mode" logger="node-lifecycle-controller"

	I0621 18:27:36.943285       1 shared_informer.go:320] Caches are synced for endpoint_slice

	I0621 18:27:36.943901       1 shared_informer.go:320] Caches are synced for endpoint

	I0621 18:27:36.950305       1 shared_informer.go:320] Caches are synced for endpoint_slice_mirroring

	I0621 18:27:36.991249       1 shared_informer.go:320] Caches are synced for disruption

	I0621 18:27:36.996032       1 shared_informer.go:320] Caches are synced for cronjob

	I0621 18:27:36.997228       1 shared_informer.go:320] Caches are synced for stateful set

	I0621 18:27:37.047455       1 shared_informer.go:320] Caches are synced for resource quota

	I0621 18:27:37.059247       1 shared_informer.go:320] Caches are synced for resource quota

	I0621 18:27:37.506333       1 shared_informer.go:320] Caches are synced for garbage collector

	I0621 18:27:37.559310       1 shared_informer.go:320] Caches are synced for garbage collector

	I0621 18:27:37.559392       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0621 18:27:37.600276       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="666.508123ms"

	I0621 18:27:37.660728       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="60.34673ms"

	I0621 18:27:37.660938       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="161.085µs"

	I0621 18:27:39.328050       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="55.475µs"

	I0621 18:27:39.330983       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="71.725µs"

	I0621 18:27:39.352409       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="52.246µs"

	I0621 18:27:39.366116       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="60.163µs"

	I0621 18:27:40.575618       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="65.679µs"

	I0621 18:27:40.612176       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="13.937752ms"

	I0621 18:27:40.612598       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="77.232µs"

	I0621 18:27:40.634931       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="14.444693ms"

	I0621 18:27:40.635035       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="51.847µs"

	I0621 18:27:41.885215       1 node_lifecycle_controller.go:1050] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"

	==> kube-proxy [e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547] <==

	I0621 18:27:38.126736       1 server_linux.go:69] "Using iptables proxy"

	I0621 18:27:38.143236       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.198"]

	I0621 18:27:38.177576       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0621 18:27:38.177626       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0621 18:27:38.177644       1 server_linux.go:165] "Using iptables Proxier"

	I0621 18:27:38.180797       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0621 18:27:38.181002       1 server.go:872] "Version info" version="v1.30.2"

	I0621 18:27:38.181026       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0621 18:27:38.182882       1 config.go:192] "Starting service config controller"

	I0621 18:27:38.183195       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0621 18:27:38.183262       1 config.go:101] "Starting endpoint slice config controller"

	I0621 18:27:38.183278       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0621 18:27:38.184787       1 config.go:319] "Starting node config controller"

	I0621 18:27:38.184819       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0621 18:27:38.283818       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0621 18:27:38.283839       1 shared_informer.go:320] Caches are synced for service config

	I0621 18:27:38.285303       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d] <==

	W0621 18:27:21.175406       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0621 18:27:21.176948       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0621 18:27:21.176960       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0621 18:27:21.176992       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0621 18:27:21.177025       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:21.177056       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0621 18:27:21.177088       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0621 18:27:21.177120       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0621 18:27:21.177197       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0621 18:27:21.177204       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:21.177229       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:21.177266       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0621 18:27:22.041765       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:22.041824       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0621 18:27:22.144830       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0621 18:27:22.144881       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0621 18:27:22.217224       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:22.217266       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0621 18:27:22.256407       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0621 18:27:22.256450       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0621 18:27:22.361486       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0621 18:27:22.361536       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0621 18:27:22.366073       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0621 18:27:22.366190       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	I0621 18:27:25.267361       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Jun 21 18:27:37 ha-406291 kubelet[1367]: I0621 18:27:37.499622    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz5cz\" (UniqueName: \"kubernetes.io/projected/11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073-kube-api-access-jz5cz\") pod \"kube-proxy-xnbqj\" (UID: \"11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073\") " pod="kube-system/kube-proxy-xnbqj"

	Jun 21 18:27:37 ha-406291 kubelet[1367]: I0621 18:27:37.499661    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e921d86f-0ac3-413e-9e85-e809139ca210-lib-modules\") pod \"kindnet-vnds7\" (UID: \"e921d86f-0ac3-413e-9e85-e809139ca210\") " pod="kube-system/kindnet-vnds7"

	Jun 21 18:27:37 ha-406291 kubelet[1367]: I0621 18:27:37.499676    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xggt5\" (UniqueName: \"kubernetes.io/projected/e921d86f-0ac3-413e-9e85-e809139ca210-kube-api-access-xggt5\") pod \"kindnet-vnds7\" (UID: \"e921d86f-0ac3-413e-9e85-e809139ca210\") " pod="kube-system/kindnet-vnds7"

	Jun 21 18:27:37 ha-406291 kubelet[1367]: I0621 18:27:37.499691    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-proxy\" (UniqueName: \"kubernetes.io/configmap/11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073-kube-proxy\") pod \"kube-proxy-xnbqj\" (UID: \"11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073\") " pod="kube-system/kube-proxy-xnbqj"

	Jun 21 18:27:37 ha-406291 kubelet[1367]: I0621 18:27:37.499713    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"xtables-lock\" (UniqueName: \"kubernetes.io/host-path/e921d86f-0ac3-413e-9e85-e809139ca210-xtables-lock\") pod \"kindnet-vnds7\" (UID: \"e921d86f-0ac3-413e-9e85-e809139ca210\") " pod="kube-system/kindnet-vnds7"

	Jun 21 18:27:38 ha-406291 kubelet[1367]: I0621 18:27:38.569981    1367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kindnet-vnds7" podStartSLOduration=1.569956367 podStartE2EDuration="1.569956367s" podCreationTimestamp="2024-06-21 18:27:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-06-21 18:27:38.569450356 +0000 UTC m=+14.270448607" watchObservedRunningTime="2024-06-21 18:27:38.569956367 +0000 UTC m=+14.270954615"

	Jun 21 18:27:38 ha-406291 kubelet[1367]: I0621 18:27:38.570080    1367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-proxy-xnbqj" podStartSLOduration=1.570074463 podStartE2EDuration="1.570074463s" podCreationTimestamp="2024-06-21 18:27:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-06-21 18:27:38.553429936 +0000 UTC m=+14.254428186" watchObservedRunningTime="2024-06-21 18:27:38.570074463 +0000 UTC m=+14.271072713"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.286317    1367 kubelet_node_status.go:497] "Fast updating node status as it just became ready"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.324991    1367 topology_manager.go:215] "Topology Admit Handler" podUID="4724701c-6f0e-45ed-8fc7-70245d4fa569" podNamespace="kube-system" podName="coredns-7db6d8ff4d-7ng4v"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.329106    1367 topology_manager.go:215] "Topology Admit Handler" podUID="375157ef-5af0-41b9-8ed9-162e5a88c679" podNamespace="kube-system" podName="coredns-7db6d8ff4d-nx5xs"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.331971    1367 topology_manager.go:215] "Topology Admit Handler" podUID="f6a39ae0-87ac-492a-a711-290e61bb895e" podNamespace="kube-system" podName="storage-provisioner"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.417475    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z767\" (UniqueName: \"kubernetes.io/projected/f6a39ae0-87ac-492a-a711-290e61bb895e-kube-api-access-2z767\") pod \"storage-provisioner\" (UID: \"f6a39ae0-87ac-492a-a711-290e61bb895e\") " pod="kube-system/storage-provisioner"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.417527    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/host-path/f6a39ae0-87ac-492a-a711-290e61bb895e-tmp\") pod \"storage-provisioner\" (UID: \"f6a39ae0-87ac-492a-a711-290e61bb895e\") " pod="kube-system/storage-provisioner"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.417551    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4724701c-6f0e-45ed-8fc7-70245d4fa569-config-volume\") pod \"coredns-7db6d8ff4d-7ng4v\" (UID: \"4724701c-6f0e-45ed-8fc7-70245d4fa569\") " pod="kube-system/coredns-7db6d8ff4d-7ng4v"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.417593    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2j2m\" (UniqueName: \"kubernetes.io/projected/4724701c-6f0e-45ed-8fc7-70245d4fa569-kube-api-access-k2j2m\") pod \"coredns-7db6d8ff4d-7ng4v\" (UID: \"4724701c-6f0e-45ed-8fc7-70245d4fa569\") " pod="kube-system/coredns-7db6d8ff4d-7ng4v"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.417618    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/375157ef-5af0-41b9-8ed9-162e5a88c679-config-volume\") pod \"coredns-7db6d8ff4d-nx5xs\" (UID: \"375157ef-5af0-41b9-8ed9-162e5a88c679\") " pod="kube-system/coredns-7db6d8ff4d-nx5xs"

	Jun 21 18:27:39 ha-406291 kubelet[1367]: I0621 18:27:39.417651    1367 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp48q\" (UniqueName: \"kubernetes.io/projected/375157ef-5af0-41b9-8ed9-162e5a88c679-kube-api-access-mp48q\") pod \"coredns-7db6d8ff4d-nx5xs\" (UID: \"375157ef-5af0-41b9-8ed9-162e5a88c679\") " pod="kube-system/coredns-7db6d8ff4d-nx5xs"

	Jun 21 18:27:40 ha-406291 kubelet[1367]: I0621 18:27:40.573990    1367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-7db6d8ff4d-7ng4v" podStartSLOduration=3.5739735489999997 podStartE2EDuration="3.573973549s" podCreationTimestamp="2024-06-21 18:27:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-06-21 18:27:40.57266985 +0000 UTC m=+16.273668099" watchObservedRunningTime="2024-06-21 18:27:40.573973549 +0000 UTC m=+16.274971799"

	Jun 21 18:27:40 ha-406291 kubelet[1367]: I0621 18:27:40.641300    1367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/coredns-7db6d8ff4d-nx5xs" podStartSLOduration=3.641266757 podStartE2EDuration="3.641266757s" podCreationTimestamp="2024-06-21 18:27:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-06-21 18:27:40.619760797 +0000 UTC m=+16.320759047" watchObservedRunningTime="2024-06-21 18:27:40.641266757 +0000 UTC m=+16.342265008"

	Jun 21 18:27:40 ha-406291 kubelet[1367]: I0621 18:27:40.642281    1367 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/storage-provisioner" podStartSLOduration=3.642263669 podStartE2EDuration="3.642263669s" podCreationTimestamp="2024-06-21 18:27:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2024-06-21 18:27:40.640882488 +0000 UTC m=+16.341880738" watchObservedRunningTime="2024-06-21 18:27:40.642263669 +0000 UTC m=+16.343261933"

	Jun 21 18:28:24 ha-406291 kubelet[1367]: E0621 18:28:24.484327    1367 iptables.go:577] "Could not set up iptables canary" err=<

	Jun 21 18:28:24 ha-406291 kubelet[1367]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jun 21 18:28:24 ha-406291 kubelet[1367]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jun 21 18:28:24 ha-406291 kubelet[1367]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jun 21 18:28:24 ha-406291 kubelet[1367]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	==> storage-provisioner [9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b] <==

	I0621 18:27:40.053572       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0621 18:27:40.071388       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0621 18:27:40.071477       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0621 18:27:40.092555       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0621 18:27:40.093079       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ha-406291_9408dd1b-5b4e-4652-aac5-9de4270d5daf!

	I0621 18:27:40.092824       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"3a538f5e-15b2-4fb1-aabe-7ae7b744ce8d", APIVersion:"v1", ResourceVersion:"421", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ha-406291_9408dd1b-5b4e-4652-aac5-9de4270d5daf became leader

	I0621 18:27:40.194107       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ha-406291_9408dd1b-5b4e-4652-aac5-9de4270d5daf!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-406291 -n ha-406291

helpers_test.go:261: (dbg) Run:  kubectl --context ha-406291 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StartCluster FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StartCluster (134.54s)

=== RUN   TestMultiControlPlane/serial/DeployApp

ha_test.go:128: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml

ha_test.go:133: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- rollout status deployment/busybox

E0621 18:30:54.861777   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:54.867541   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:54.877873   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:54.898123   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:54.938445   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:55.018767   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:55.179196   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:55.499829   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:56.140856   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:57.421502   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:30:59.982566   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:31:05.103011   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:31:15.343196   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:31:35.823688   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:32:16.784575   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:33:38.706547   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:35:54.862246   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

E0621 18:36:22.549445   15329 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/functional-620822/client.crt: no such file or directory

ha_test.go:133: (dbg) Non-zero exit: out/minikube-linux-amd64 kubectl -p ha-406291 -- rollout status deployment/busybox: exit status 1 (10m3.964202783s)

-- stdout --

	Waiting for deployment "busybox" rollout to finish: 0 of 3 updated replicas are available...

	Waiting for deployment "busybox" rollout to finish: 1 of 3 updated replicas are available...

-- /stdout --

** stderr ** 

	error: deployment "busybox" exceeded its progress deadline

** /stderr **

ha_test.go:135: failed to deploy busybox to ha (multi-control plane) cluster

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:140: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].status.podIP}'

ha_test.go:149: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:159: failed to resolve pod IPs: expected 3 Pod IPs but got 1 (may be temporary), output: "\n-- stdout --\n\t'10.244.0.4'\n\n-- /stdout --"

ha_test.go:163: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- get pods -o jsonpath='{.items[*].metadata.name}'

ha_test.go:171: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-drm4v -- nslookup kubernetes.io

ha_test.go:171: (dbg) Non-zero exit: out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-drm4v -- nslookup kubernetes.io: exit status 1 (109.65675ms)

** stderr ** 

	Error from server (BadRequest): pod busybox-fc5497c4f-drm4v does not have a host assigned

** /stderr **

ha_test.go:173: Pod busybox-fc5497c4f-drm4v could not resolve 'kubernetes.io': exit status 1

ha_test.go:171: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-p2c87 -- nslookup kubernetes.io

ha_test.go:171: (dbg) Non-zero exit: out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-p2c87 -- nslookup kubernetes.io: exit status 1 (113.358488ms)

** stderr ** 

	Error from server (BadRequest): pod busybox-fc5497c4f-p2c87 does not have a host assigned

** /stderr **

ha_test.go:173: Pod busybox-fc5497c4f-p2c87 could not resolve 'kubernetes.io': exit status 1

ha_test.go:171: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-qvl48 -- nslookup kubernetes.io

ha_test.go:181: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-drm4v -- nslookup kubernetes.default

ha_test.go:181: (dbg) Non-zero exit: out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-drm4v -- nslookup kubernetes.default: exit status 1 (111.132675ms)

** stderr ** 

	Error from server (BadRequest): pod busybox-fc5497c4f-drm4v does not have a host assigned

** /stderr **

ha_test.go:183: Pod busybox-fc5497c4f-drm4v could not resolve 'kubernetes.default': exit status 1

ha_test.go:181: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-p2c87 -- nslookup kubernetes.default

ha_test.go:181: (dbg) Non-zero exit: out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-p2c87 -- nslookup kubernetes.default: exit status 1 (115.920394ms)

** stderr ** 

	Error from server (BadRequest): pod busybox-fc5497c4f-p2c87 does not have a host assigned

** /stderr **

ha_test.go:183: Pod busybox-fc5497c4f-p2c87 could not resolve 'kubernetes.default': exit status 1

ha_test.go:181: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-qvl48 -- nslookup kubernetes.default

ha_test.go:189: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-drm4v -- nslookup kubernetes.default.svc.cluster.local

ha_test.go:189: (dbg) Non-zero exit: out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-drm4v -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (108.35033ms)

** stderr ** 

	Error from server (BadRequest): pod busybox-fc5497c4f-drm4v does not have a host assigned

** /stderr **

ha_test.go:191: Pod busybox-fc5497c4f-drm4v could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

ha_test.go:189: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-p2c87 -- nslookup kubernetes.default.svc.cluster.local

ha_test.go:189: (dbg) Non-zero exit: out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-p2c87 -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (110.372588ms)

** stderr ** 

	Error from server (BadRequest): pod busybox-fc5497c4f-p2c87 does not have a host assigned

** /stderr **

ha_test.go:191: Pod busybox-fc5497c4f-p2c87 could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1

ha_test.go:189: (dbg) Run:  out/minikube-linux-amd64 kubectl -p ha-406291 -- exec busybox-fc5497c4f-qvl48 -- nslookup kubernetes.default.svc.cluster.local

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-406291 -n ha-406291

helpers_test.go:244: <<< TestMultiControlPlane/serial/DeployApp FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/DeployApp]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-406291 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-406291 logs -n 25: (1.213939312s)

helpers_test.go:252: TestMultiControlPlane/serial/DeployApp logs: 

-- stdout --

	==> Audit <==

	|---------|--------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| Command |                 Args                 |      Profile      |  User   | Version |     Start Time      |      End Time       |

	|---------|--------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	| image   | functional-620822 image ls           | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| delete  | -p functional-620822                 | functional-620822 | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC | 21 Jun 24 18:26 UTC |

	| start   | -p ha-406291 --wait=true             | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:26 UTC |                     |

	|         | --memory=2200 --ha                   |                   |         |         |                     |                     |

	|         | -v=7 --alsologtostderr               |                   |         |         |                     |                     |

	|         | --driver=kvm2                        |                   |         |         |                     |                     |

	|         | --container-runtime=crio             |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- apply -f             | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:28 UTC | 21 Jun 24 18:28 UTC |

	|         | ./testdata/ha/ha-pod-dns-test.yaml   |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- rollout status       | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:28 UTC |                     |

	|         | deployment/busybox                   |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:39 UTC | 21 Jun 24 18:39 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC | 21 Jun 24 18:40 UTC |

	|         | jsonpath='{.items[*].status.podIP}'  |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- get pods -o          | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC | 21 Jun 24 18:40 UTC |

	|         | jsonpath='{.items[*].metadata.name}' |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC |                     |

	|         | busybox-fc5497c4f-drm4v --           |                   |         |         |                     |                     |

	|         | nslookup kubernetes.io               |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC |                     |

	|         | busybox-fc5497c4f-p2c87 --           |                   |         |         |                     |                     |

	|         | nslookup kubernetes.io               |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC | 21 Jun 24 18:40 UTC |

	|         | busybox-fc5497c4f-qvl48 --           |                   |         |         |                     |                     |

	|         | nslookup kubernetes.io               |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC |                     |

	|         | busybox-fc5497c4f-drm4v --           |                   |         |         |                     |                     |

	|         | nslookup kubernetes.default          |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC |                     |

	|         | busybox-fc5497c4f-p2c87 --           |                   |         |         |                     |                     |

	|         | nslookup kubernetes.default          |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC | 21 Jun 24 18:40 UTC |

	|         | busybox-fc5497c4f-qvl48 --           |                   |         |         |                     |                     |

	|         | nslookup kubernetes.default          |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC |                     |

	|         | busybox-fc5497c4f-drm4v -- nslookup  |                   |         |         |                     |                     |

	|         | kubernetes.default.svc.cluster.local |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC |                     |

	|         | busybox-fc5497c4f-p2c87 -- nslookup  |                   |         |         |                     |                     |

	|         | kubernetes.default.svc.cluster.local |                   |         |         |                     |                     |

	| kubectl | -p ha-406291 -- exec                 | ha-406291         | jenkins | v1.33.1 | 21 Jun 24 18:40 UTC | 21 Jun 24 18:40 UTC |

	|         | busybox-fc5497c4f-qvl48 -- nslookup  |                   |         |         |                     |                     |

	|         | kubernetes.default.svc.cluster.local |                   |         |         |                     |                     |

	|---------|--------------------------------------|-------------------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/06/21 18:26:42

	Running on machine: ubuntu-20-agent-8

	Binary: Built with gc go1.22.4 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0621 18:26:42.447747   30068 out.go:291] Setting OutFile to fd 1 ...

	I0621 18:26:42.447858   30068 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 18:26:42.447867   30068 out.go:304] Setting ErrFile to fd 2...

	I0621 18:26:42.447871   30068 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0621 18:26:42.448064   30068 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19112-8111/.minikube/bin

	I0621 18:26:42.448611   30068 out.go:298] Setting JSON to false

	I0621 18:26:42.449397   30068 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-8","uptime":4100,"bootTime":1718990302,"procs":182,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0621 18:26:42.449454   30068 start.go:139] virtualization: kvm guest

	I0621 18:26:42.451750   30068 out.go:177] * [ha-406291] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0621 18:26:42.453097   30068 out.go:177]   - MINIKUBE_LOCATION=19112

	I0621 18:26:42.453116   30068 notify.go:220] Checking for updates...

	I0621 18:26:42.456195   30068 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0621 18:26:42.457398   30068 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:26:42.458579   30068 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.459798   30068 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0621 18:26:42.461088   30068 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0621 18:26:42.462525   30068 driver.go:392] Setting default libvirt URI to qemu:///system

	I0621 18:26:42.497263   30068 out.go:177] * Using the kvm2 driver based on user configuration

	I0621 18:26:42.498734   30068 start.go:297] selected driver: kvm2

	I0621 18:26:42.498753   30068 start.go:901] validating driver "kvm2" against <nil>

	I0621 18:26:42.498763   30068 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0621 18:26:42.499421   30068 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 18:26:42.499483   30068 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19112-8111/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0621 18:26:42.513772   30068 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0621 18:26:42.513840   30068 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0621 18:26:42.514036   30068 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0621 18:26:42.514063   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:26:42.514070   30068 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0621 18:26:42.514080   30068 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0621 18:26:42.514119   30068 start.go:340] cluster config:

	{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRIS

ocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0

GPUs: AutoPauseInterval:1m0s}

	I0621 18:26:42.514203   30068 iso.go:125] acquiring lock: {Name:mk9bcacef563c74661da696f2e2fb4463daf80f2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0621 18:26:42.515839   30068 out.go:177] * Starting "ha-406291" primary control-plane node in "ha-406291" cluster

	I0621 18:26:42.516925   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:26:42.516952   30068 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4

	I0621 18:26:42.516960   30068 cache.go:56] Caching tarball of preloaded images

	I0621 18:26:42.517025   30068 preload.go:173] Found /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0621 18:26:42.517035   30068 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio

	I0621 18:26:42.517302   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:26:42.517325   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json: {Name:mkd43eceea282503c79b6e4b90bbf7258fcf8b4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:26:42.517445   30068 start.go:360] acquireMachinesLock for ha-406291: {Name:mkdb5ead19d46168ac3b04a7a163113221efea18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0621 18:26:42.517470   30068 start.go:364] duration metric: took 13.314µs to acquireMachinesLock for "ha-406291"

	I0621 18:26:42.517485   30068 start.go:93] Provisioning new machine with config: &{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:

9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:26:42.517531   30068 start.go:125] createHost starting for "" (driver="kvm2")

	I0621 18:26:42.518937   30068 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0621 18:26:42.519071   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:26:42.519109   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:26:42.533235   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36669

	I0621 18:26:42.533669   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:26:42.534312   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:26:42.534360   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:26:42.534665   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:26:42.534880   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:26:42.535018   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:26:42.535180   30068 start.go:159] libmachine.API.Create for "ha-406291" (driver="kvm2")

	I0621 18:26:42.535209   30068 client.go:168] LocalClient.Create starting

	I0621 18:26:42.535233   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem

	I0621 18:26:42.535267   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:26:42.535282   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:26:42.535339   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem

	I0621 18:26:42.535357   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:26:42.535367   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:26:42.535383   30068 main.go:141] libmachine: Running pre-create checks...

	I0621 18:26:42.535396   30068 main.go:141] libmachine: (ha-406291) Calling .PreCreateCheck

	I0621 18:26:42.535734   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:26:42.536101   30068 main.go:141] libmachine: Creating machine...

	I0621 18:26:42.536113   30068 main.go:141] libmachine: (ha-406291) Calling .Create

	I0621 18:26:42.536232   30068 main.go:141] libmachine: (ha-406291) Creating KVM machine...

	I0621 18:26:42.537484   30068 main.go:141] libmachine: (ha-406291) DBG | found existing default KVM network

	I0621 18:26:42.538310   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.538153   30091 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc00010f1e0}

	I0621 18:26:42.538339   30068 main.go:141] libmachine: (ha-406291) DBG | created network xml: 

	I0621 18:26:42.538346   30068 main.go:141] libmachine: (ha-406291) DBG | <network>

	I0621 18:26:42.538355   30068 main.go:141] libmachine: (ha-406291) DBG |   <name>mk-ha-406291</name>

	I0621 18:26:42.538371   30068 main.go:141] libmachine: (ha-406291) DBG |   <dns enable='no'/>

	I0621 18:26:42.538385   30068 main.go:141] libmachine: (ha-406291) DBG |   

	I0621 18:26:42.538392   30068 main.go:141] libmachine: (ha-406291) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0621 18:26:42.538400   30068 main.go:141] libmachine: (ha-406291) DBG |     <dhcp>

	I0621 18:26:42.538412   30068 main.go:141] libmachine: (ha-406291) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0621 18:26:42.538421   30068 main.go:141] libmachine: (ha-406291) DBG |     </dhcp>

	I0621 18:26:42.538439   30068 main.go:141] libmachine: (ha-406291) DBG |   </ip>

	I0621 18:26:42.538451   30068 main.go:141] libmachine: (ha-406291) DBG |   

	I0621 18:26:42.538458   30068 main.go:141] libmachine: (ha-406291) DBG | </network>

	I0621 18:26:42.538470   30068 main.go:141] libmachine: (ha-406291) DBG | 

	I0621 18:26:42.543401   30068 main.go:141] libmachine: (ha-406291) DBG | trying to create private KVM network mk-ha-406291 192.168.39.0/24...

	I0621 18:26:42.606041   30068 main.go:141] libmachine: (ha-406291) DBG | private KVM network mk-ha-406291 192.168.39.0/24 created

	I0621 18:26:42.606072   30068 main.go:141] libmachine: (ha-406291) Setting up store path in /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 ...

	I0621 18:26:42.606091   30068 main.go:141] libmachine: (ha-406291) Building disk image from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso

	I0621 18:26:42.606165   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.606075   30091 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.606280   30068 main.go:141] libmachine: (ha-406291) Downloading /home/jenkins/minikube-integration/19112-8111/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso...

	I0621 18:26:42.829374   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.829262   30091 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa...

	I0621 18:26:42.941790   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.941666   30091 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/ha-406291.rawdisk...

	I0621 18:26:42.941834   30068 main.go:141] libmachine: (ha-406291) DBG | Writing magic tar header

	I0621 18:26:42.941844   30068 main.go:141] libmachine: (ha-406291) DBG | Writing SSH key tar header

	I0621 18:26:42.941852   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:42.941778   30091 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 ...

	I0621 18:26:42.941909   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291

	I0621 18:26:42.941989   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291 (perms=drwx------)

	I0621 18:26:42.942007   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines

	I0621 18:26:42.942019   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines (perms=drwxr-xr-x)

	I0621 18:26:42.942033   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube (perms=drwxr-xr-x)

	I0621 18:26:42.942053   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111 (perms=drwxrwxr-x)

	I0621 18:26:42.942060   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:26:42.942069   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111

	I0621 18:26:42.942075   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0621 18:26:42.942080   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0621 18:26:42.942088   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home/jenkins

	I0621 18:26:42.942104   30068 main.go:141] libmachine: (ha-406291) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0621 18:26:42.942117   30068 main.go:141] libmachine: (ha-406291) DBG | Checking permissions on dir: /home

	I0621 18:26:42.942128   30068 main.go:141] libmachine: (ha-406291) DBG | Skipping /home - not owner

	I0621 18:26:42.942142   30068 main.go:141] libmachine: (ha-406291) Creating domain...

	I0621 18:26:42.943154   30068 main.go:141] libmachine: (ha-406291) define libvirt domain using xml: 

	I0621 18:26:42.943176   30068 main.go:141] libmachine: (ha-406291) <domain type='kvm'>

	I0621 18:26:42.943183   30068 main.go:141] libmachine: (ha-406291)   <name>ha-406291</name>

	I0621 18:26:42.943188   30068 main.go:141] libmachine: (ha-406291)   <memory unit='MiB'>2200</memory>

	I0621 18:26:42.943199   30068 main.go:141] libmachine: (ha-406291)   <vcpu>2</vcpu>

	I0621 18:26:42.943203   30068 main.go:141] libmachine: (ha-406291)   <features>

	I0621 18:26:42.943208   30068 main.go:141] libmachine: (ha-406291)     <acpi/>

	I0621 18:26:42.943212   30068 main.go:141] libmachine: (ha-406291)     <apic/>

	I0621 18:26:42.943217   30068 main.go:141] libmachine: (ha-406291)     <pae/>

	I0621 18:26:42.943223   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943229   30068 main.go:141] libmachine: (ha-406291)   </features>

	I0621 18:26:42.943234   30068 main.go:141] libmachine: (ha-406291)   <cpu mode='host-passthrough'>

	I0621 18:26:42.943255   30068 main.go:141] libmachine: (ha-406291)   

	I0621 18:26:42.943266   30068 main.go:141] libmachine: (ha-406291)   </cpu>

	I0621 18:26:42.943284   30068 main.go:141] libmachine: (ha-406291)   <os>

	I0621 18:26:42.943318   30068 main.go:141] libmachine: (ha-406291)     <type>hvm</type>

	I0621 18:26:42.943328   30068 main.go:141] libmachine: (ha-406291)     <boot dev='cdrom'/>

	I0621 18:26:42.943333   30068 main.go:141] libmachine: (ha-406291)     <boot dev='hd'/>

	I0621 18:26:42.943341   30068 main.go:141] libmachine: (ha-406291)     <bootmenu enable='no'/>

	I0621 18:26:42.943345   30068 main.go:141] libmachine: (ha-406291)   </os>

	I0621 18:26:42.943355   30068 main.go:141] libmachine: (ha-406291)   <devices>

	I0621 18:26:42.943360   30068 main.go:141] libmachine: (ha-406291)     <disk type='file' device='cdrom'>

	I0621 18:26:42.943371   30068 main.go:141] libmachine: (ha-406291)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/boot2docker.iso'/>

	I0621 18:26:42.943384   30068 main.go:141] libmachine: (ha-406291)       <target dev='hdc' bus='scsi'/>

	I0621 18:26:42.943397   30068 main.go:141] libmachine: (ha-406291)       <readonly/>

	I0621 18:26:42.943404   30068 main.go:141] libmachine: (ha-406291)     </disk>

	I0621 18:26:42.943417   30068 main.go:141] libmachine: (ha-406291)     <disk type='file' device='disk'>

	I0621 18:26:42.943429   30068 main.go:141] libmachine: (ha-406291)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0621 18:26:42.943445   30068 main.go:141] libmachine: (ha-406291)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/ha-406291.rawdisk'/>

	I0621 18:26:42.943456   30068 main.go:141] libmachine: (ha-406291)       <target dev='hda' bus='virtio'/>

	I0621 18:26:42.943478   30068 main.go:141] libmachine: (ha-406291)     </disk>

	I0621 18:26:42.943499   30068 main.go:141] libmachine: (ha-406291)     <interface type='network'>

	I0621 18:26:42.943509   30068 main.go:141] libmachine: (ha-406291)       <source network='mk-ha-406291'/>

	I0621 18:26:42.943513   30068 main.go:141] libmachine: (ha-406291)       <model type='virtio'/>

	I0621 18:26:42.943519   30068 main.go:141] libmachine: (ha-406291)     </interface>

	I0621 18:26:42.943526   30068 main.go:141] libmachine: (ha-406291)     <interface type='network'>

	I0621 18:26:42.943532   30068 main.go:141] libmachine: (ha-406291)       <source network='default'/>

	I0621 18:26:42.943539   30068 main.go:141] libmachine: (ha-406291)       <model type='virtio'/>

	I0621 18:26:42.943544   30068 main.go:141] libmachine: (ha-406291)     </interface>

	I0621 18:26:42.943549   30068 main.go:141] libmachine: (ha-406291)     <serial type='pty'>

	I0621 18:26:42.943554   30068 main.go:141] libmachine: (ha-406291)       <target port='0'/>

	I0621 18:26:42.943560   30068 main.go:141] libmachine: (ha-406291)     </serial>

	I0621 18:26:42.943565   30068 main.go:141] libmachine: (ha-406291)     <console type='pty'>

	I0621 18:26:42.943571   30068 main.go:141] libmachine: (ha-406291)       <target type='serial' port='0'/>

	I0621 18:26:42.943583   30068 main.go:141] libmachine: (ha-406291)     </console>

	I0621 18:26:42.943593   30068 main.go:141] libmachine: (ha-406291)     <rng model='virtio'>

	I0621 18:26:42.943602   30068 main.go:141] libmachine: (ha-406291)       <backend model='random'>/dev/random</backend>

	I0621 18:26:42.943609   30068 main.go:141] libmachine: (ha-406291)     </rng>

	I0621 18:26:42.943617   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943621   30068 main.go:141] libmachine: (ha-406291)     

	I0621 18:26:42.943627   30068 main.go:141] libmachine: (ha-406291)   </devices>

	I0621 18:26:42.943631   30068 main.go:141] libmachine: (ha-406291) </domain>

	I0621 18:26:42.943638   30068 main.go:141] libmachine: (ha-406291) 

	I0621 18:26:42.948298   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:44:10:c4 in network default

	I0621 18:26:42.948968   30068 main.go:141] libmachine: (ha-406291) Ensuring networks are active...

	I0621 18:26:42.948988   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:42.949710   30068 main.go:141] libmachine: (ha-406291) Ensuring network default is active

	I0621 18:26:42.950033   30068 main.go:141] libmachine: (ha-406291) Ensuring network mk-ha-406291 is active

	I0621 18:26:42.950493   30068 main.go:141] libmachine: (ha-406291) Getting domain xml...

	I0621 18:26:42.951151   30068 main.go:141] libmachine: (ha-406291) Creating domain...

	I0621 18:26:44.128421   30068 main.go:141] libmachine: (ha-406291) Waiting to get IP...

	I0621 18:26:44.129183   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.129530   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.129550   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.129513   30091 retry.go:31] will retry after 273.280189ms: waiting for machine to come up

	I0621 18:26:44.404590   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.405440   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.405467   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.405386   30091 retry.go:31] will retry after 363.287979ms: waiting for machine to come up

	I0621 18:26:44.769749   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:44.770188   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:44.770217   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:44.770146   30091 retry.go:31] will retry after 445.9009ms: waiting for machine to come up

	I0621 18:26:45.217708   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:45.218113   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:45.218132   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:45.218075   30091 retry.go:31] will retry after 497.769852ms: waiting for machine to come up

	I0621 18:26:45.717913   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:45.718380   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:45.718402   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:45.718333   30091 retry.go:31] will retry after 609.412902ms: waiting for machine to come up

	I0621 18:26:46.329589   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:46.330043   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:46.330077   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:46.330033   30091 retry.go:31] will retry after 668.226784ms: waiting for machine to come up

	I0621 18:26:46.999851   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:47.000352   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:47.000399   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:47.000310   30091 retry.go:31] will retry after 928.90777ms: waiting for machine to come up

	I0621 18:26:47.931043   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:47.931568   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:47.931598   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:47.931527   30091 retry.go:31] will retry after 1.407643188s: waiting for machine to come up

	I0621 18:26:49.341126   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:49.341529   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:49.341557   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:49.341489   30091 retry.go:31] will retry after 1.657120945s: waiting for machine to come up

	I0621 18:26:51.001518   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:51.001999   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:51.002022   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:51.001955   30091 retry.go:31] will retry after 1.506025988s: waiting for machine to come up

	I0621 18:26:52.509823   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:52.510314   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:52.510342   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:52.510269   30091 retry.go:31] will retry after 2.859818514s: waiting for machine to come up

	I0621 18:26:55.371181   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:55.371726   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:55.371755   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:55.371678   30091 retry.go:31] will retry after 3.374080501s: waiting for machine to come up

	I0621 18:26:58.747494   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:26:58.748019   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find current IP address of domain ha-406291 in network mk-ha-406291

	I0621 18:26:58.748039   30068 main.go:141] libmachine: (ha-406291) DBG | I0621 18:26:58.747991   30091 retry.go:31] will retry after 4.386740875s: waiting for machine to come up

	I0621 18:27:03.136546   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.137046   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has current primary IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.137063   30068 main.go:141] libmachine: (ha-406291) Found IP for machine: 192.168.39.198

	I0621 18:27:03.137079   30068 main.go:141] libmachine: (ha-406291) Reserving static IP address...

	I0621 18:27:03.137427   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find host DHCP lease matching {name: "ha-406291", mac: "52:54:00:38:dc:46", ip: "192.168.39.198"} in network mk-ha-406291

	I0621 18:27:03.211473   30068 main.go:141] libmachine: (ha-406291) DBG | Getting to WaitForSSH function...

	I0621 18:27:03.211506   30068 main.go:141] libmachine: (ha-406291) Reserved static IP address: 192.168.39.198

	I0621 18:27:03.211519   30068 main.go:141] libmachine: (ha-406291) Waiting for SSH to be available...

	I0621 18:27:03.214029   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:03.214477   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291

	I0621 18:27:03.214509   30068 main.go:141] libmachine: (ha-406291) DBG | unable to find defined IP address of network mk-ha-406291 interface with MAC address 52:54:00:38:dc:46

	I0621 18:27:03.214661   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH client type: external

	I0621 18:27:03.214702   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa (-rw-------)

	I0621 18:27:03.214745   30068 main.go:141] libmachine: (ha-406291) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@ -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:03.214771   30068 main.go:141] libmachine: (ha-406291) DBG | About to run SSH command:

	I0621 18:27:03.214784   30068 main.go:141] libmachine: (ha-406291) DBG | exit 0

	I0621 18:27:03.218578   30068 main.go:141] libmachine: (ha-406291) DBG | SSH cmd err, output: exit status 255: 

	I0621 18:27:03.218603   30068 main.go:141] libmachine: (ha-406291) DBG | Error getting ssh command 'exit 0' : ssh command error:

	I0621 18:27:03.218614   30068 main.go:141] libmachine: (ha-406291) DBG | command : exit 0

	I0621 18:27:03.218630   30068 main.go:141] libmachine: (ha-406291) DBG | err     : exit status 255

	I0621 18:27:03.218643   30068 main.go:141] libmachine: (ha-406291) DBG | output  : 

	I0621 18:27:06.220803   30068 main.go:141] libmachine: (ha-406291) DBG | Getting to WaitForSSH function...

	I0621 18:27:06.223287   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.223552   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.223591   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.223725   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH client type: external

	I0621 18:27:06.223751   30068 main.go:141] libmachine: (ha-406291) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa (-rw-------)

	I0621 18:27:06.223775   30068 main.go:141] libmachine: (ha-406291) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.198 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:06.223788   30068 main.go:141] libmachine: (ha-406291) DBG | About to run SSH command:

	I0621 18:27:06.223797   30068 main.go:141] libmachine: (ha-406291) DBG | exit 0

	I0621 18:27:06.345962   30068 main.go:141] libmachine: (ha-406291) DBG | SSH cmd err, output: <nil>: 

	I0621 18:27:06.346198   30068 main.go:141] libmachine: (ha-406291) KVM machine creation complete!

	I0621 18:27:06.346530   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:27:06.347151   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:06.347376   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:06.347539   30068 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0621 18:27:06.347553   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:06.349257   30068 main.go:141] libmachine: Detecting operating system of created instance...

	I0621 18:27:06.349272   30068 main.go:141] libmachine: Waiting for SSH to be available...

	I0621 18:27:06.349278   30068 main.go:141] libmachine: Getting to WaitForSSH function...

	I0621 18:27:06.349284   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.351365   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.351709   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.351738   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.351848   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.352053   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.352215   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.352441   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.352676   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.352926   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.352939   30068 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0621 18:27:06.449038   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:06.449066   30068 main.go:141] libmachine: Detecting the provisioner...

	I0621 18:27:06.449077   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.451811   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.452202   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.452223   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.452405   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.452602   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.452762   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.452898   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.453074   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.453321   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.453334   30068 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0621 18:27:06.550539   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0621 18:27:06.550611   30068 main.go:141] libmachine: found compatible host: buildroot

	I0621 18:27:06.550618   30068 main.go:141] libmachine: Provisioning with buildroot...

	I0621 18:27:06.550625   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.550871   30068 buildroot.go:166] provisioning hostname "ha-406291"

	I0621 18:27:06.550891   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.551068   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.553701   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.554112   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.554138   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.554279   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.554452   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.554601   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.554725   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.554869   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.555029   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.555040   30068 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-406291 && echo "ha-406291" | sudo tee /etc/hostname

	I0621 18:27:06.664012   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-406291

	I0621 18:27:06.664038   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.666600   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.666923   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.666952   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.667091   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.667277   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.667431   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.667559   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.667745   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:06.667932   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:06.667949   30068 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-406291' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-406291/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-406291' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0621 18:27:06.778156   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:06.778199   30068 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19112-8111/.minikube CaCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19112-8111/.minikube}

	I0621 18:27:06.778224   30068 buildroot.go:174] setting up certificates

	I0621 18:27:06.778237   30068 provision.go:84] configureAuth start

	I0621 18:27:06.778250   30068 main.go:141] libmachine: (ha-406291) Calling .GetMachineName

	I0621 18:27:06.778526   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:06.781267   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.781583   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.781610   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.781773   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.784225   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.784546   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.784564   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.784717   30068 provision.go:143] copyHostCerts

	I0621 18:27:06.784747   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:06.784796   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem, removing ...

	I0621 18:27:06.784813   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:06.784893   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem (1675 bytes)

	I0621 18:27:06.784992   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:06.785017   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem, removing ...

	I0621 18:27:06.785023   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:06.785064   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem (1082 bytes)

	I0621 18:27:06.785126   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:06.785153   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem, removing ...

	I0621 18:27:06.785162   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:06.785194   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem (1123 bytes)

	I0621 18:27:06.785257   30068 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem org=jenkins.ha-406291 san=[127.0.0.1 192.168.39.198 ha-406291 localhost minikube]

	I0621 18:27:06.904910   30068 provision.go:177] copyRemoteCerts

	I0621 18:27:06.904976   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0621 18:27:06.905004   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:06.907600   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.907883   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:06.907916   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:06.908115   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:06.908308   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:06.908462   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:06.908599   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:06.987463   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0621 18:27:06.987540   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0621 18:27:07.009572   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0621 18:27:07.009661   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem --> /etc/docker/server.pem (1196 bytes)

	I0621 18:27:07.031219   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0621 18:27:07.031333   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0621 18:27:07.052682   30068 provision.go:87] duration metric: took 274.433059ms to configureAuth

	I0621 18:27:07.052709   30068 buildroot.go:189] setting minikube options for container-runtime

	I0621 18:27:07.052895   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:07.052984   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.055368   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.055720   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.055742   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.055971   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.056161   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.056324   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.056453   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.056615   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:07.056785   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:07.056814   30068 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0621 18:27:07.307055   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0621 18:27:07.307083   30068 main.go:141] libmachine: Checking connection to Docker...

	I0621 18:27:07.307105   30068 main.go:141] libmachine: (ha-406291) Calling .GetURL

	I0621 18:27:07.308373   30068 main.go:141] libmachine: (ha-406291) DBG | Using libvirt version 6000000

	I0621 18:27:07.310322   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.310631   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.310658   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.310756   30068 main.go:141] libmachine: Docker is up and running!

	I0621 18:27:07.310768   30068 main.go:141] libmachine: Reticulating splines...

	I0621 18:27:07.310774   30068 client.go:171] duration metric: took 24.775558818s to LocalClient.Create

	I0621 18:27:07.310795   30068 start.go:167] duration metric: took 24.775614868s to libmachine.API.Create "ha-406291"

	I0621 18:27:07.310807   30068 start.go:293] postStartSetup for "ha-406291" (driver="kvm2")

	I0621 18:27:07.310818   30068 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0621 18:27:07.310835   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.311186   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0621 18:27:07.311208   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.313308   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.313543   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.313581   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.313682   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.313855   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.314042   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.314209   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.391859   30068 ssh_runner.go:195] Run: cat /etc/os-release

	I0621 18:27:07.396062   30068 info.go:137] Remote host: Buildroot 2023.02.9

	I0621 18:27:07.396083   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/addons for local assets ...

	I0621 18:27:07.396132   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/files for local assets ...

	I0621 18:27:07.396193   30068 filesync.go:149] local asset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> 153292.pem in /etc/ssl/certs

	I0621 18:27:07.396202   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /etc/ssl/certs/153292.pem

	I0621 18:27:07.396289   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0621 18:27:07.405435   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:07.427927   30068 start.go:296] duration metric: took 117.075834ms for postStartSetup

	I0621 18:27:07.427984   30068 main.go:141] libmachine: (ha-406291) Calling .GetConfigRaw

	I0621 18:27:07.428562   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:07.431157   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.431479   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.431523   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.431791   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:07.431969   30068 start.go:128] duration metric: took 24.914429669s to createHost

	I0621 18:27:07.431990   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.434121   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.434421   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.434445   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.434510   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.434692   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.434865   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.435009   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.435168   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:07.435372   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.198 22 <nil> <nil>}

	I0621 18:27:07.435384   30068 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0621 18:27:07.530141   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718994427.508226463

	I0621 18:27:07.530165   30068 fix.go:216] guest clock: 1718994427.508226463

	I0621 18:27:07.530173   30068 fix.go:229] Guest: 2024-06-21 18:27:07.508226463 +0000 UTC Remote: 2024-06-21 18:27:07.431981059 +0000 UTC m=+25.016949864 (delta=76.245404ms)

	I0621 18:27:07.530199   30068 fix.go:200] guest clock delta is within tolerance: 76.245404ms

	I0621 18:27:07.530204   30068 start.go:83] releasing machines lock for "ha-406291", held for 25.012726918s

	I0621 18:27:07.530222   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.530466   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:07.532753   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.533110   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.533151   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.533275   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533702   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533877   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:07.533978   30068 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0621 18:27:07.534028   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.534087   30068 ssh_runner.go:195] Run: cat /version.json

	I0621 18:27:07.534115   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:07.536489   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536798   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.536828   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536845   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.536983   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.537154   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.537312   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:07.537330   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:07.537337   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.537509   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:07.537507   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.537675   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:07.537830   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:07.537968   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:07.610886   30068 ssh_runner.go:195] Run: systemctl --version

	I0621 18:27:07.648150   30068 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0621 18:27:07.798080   30068 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0621 18:27:07.803683   30068 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0621 18:27:07.803731   30068 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0621 18:27:07.820345   30068 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0621 18:27:07.820363   30068 start.go:494] detecting cgroup driver to use...

	I0621 18:27:07.820412   30068 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0621 18:27:07.835960   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0621 18:27:07.849269   30068 docker.go:217] disabling cri-docker service (if available) ...

	I0621 18:27:07.849324   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0621 18:27:07.861858   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0621 18:27:07.874371   30068 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0621 18:27:07.984965   30068 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0621 18:27:08.126897   30068 docker.go:233] disabling docker service ...

	I0621 18:27:08.126973   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0621 18:27:08.140294   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0621 18:27:08.152460   30068 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0621 18:27:08.289101   30068 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0621 18:27:08.414578   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0621 18:27:08.428193   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0621 18:27:08.445335   30068 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0621 18:27:08.445406   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.454715   30068 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0621 18:27:08.454780   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.464286   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.473688   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.483215   30068 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0621 18:27:08.492907   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.502386   30068 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.518138   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:27:08.527822   30068 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0621 18:27:08.536491   30068 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0621 18:27:08.536537   30068 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0621 18:27:08.548343   30068 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0621 18:27:08.557395   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:27:08.668782   30068 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0621 18:27:08.793146   30068 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0621 18:27:08.793228   30068 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0621 18:27:08.797886   30068 start.go:562] Will wait 60s for crictl version

	I0621 18:27:08.797933   30068 ssh_runner.go:195] Run: which crictl

	I0621 18:27:08.801183   30068 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0621 18:27:08.838953   30068 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0621 18:27:08.839028   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:27:08.865047   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:27:08.892059   30068 out.go:177] * Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	I0621 18:27:08.893365   30068 main.go:141] libmachine: (ha-406291) Calling .GetIP

	I0621 18:27:08.895801   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:08.896174   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:08.896198   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:08.896377   30068 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0621 18:27:08.900124   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:27:08.912152   30068 kubeadm.go:877] updating cluster {Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 M

ountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0621 18:27:08.912252   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:27:08.912299   30068 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 18:27:08.941267   30068 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.2". assuming images are not preloaded.

	I0621 18:27:08.941328   30068 ssh_runner.go:195] Run: which lz4

	I0621 18:27:08.944757   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0621 18:27:08.944843   30068 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0621 18:27:08.948482   30068 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0621 18:27:08.948507   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (395071426 bytes)

	I0621 18:27:10.186487   30068 crio.go:462] duration metric: took 1.241671996s to copy over tarball

	I0621 18:27:10.186568   30068 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0621 18:27:12.219224   30068 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.032622286s)

	I0621 18:27:12.219256   30068 crio.go:469] duration metric: took 2.032747658s to extract the tarball

	I0621 18:27:12.219265   30068 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0621 18:27:12.255526   30068 ssh_runner.go:195] Run: sudo crictl images --output json

	I0621 18:27:12.297692   30068 crio.go:514] all images are preloaded for cri-o runtime.

	I0621 18:27:12.297715   30068 cache_images.go:84] Images are preloaded, skipping loading

	I0621 18:27:12.297725   30068 kubeadm.go:928] updating node { 192.168.39.198 8443 v1.30.2 crio true true} ...

	I0621 18:27:12.297863   30068 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-406291 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.198

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0621 18:27:12.297956   30068 ssh_runner.go:195] Run: crio config

	I0621 18:27:12.347243   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:27:12.347276   30068 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0621 18:27:12.347288   30068 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0621 18:27:12.347314   30068 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.198 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-406291 NodeName:ha-406291 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.198"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.198 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernete

s/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0621 18:27:12.347487   30068 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.198

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-406291"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.198

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.198"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0621 18:27:12.347514   30068 kube-vip.go:115] generating kube-vip config ...

	I0621 18:27:12.347563   30068 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0621 18:27:12.362180   30068 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0621 18:27:12.362273   30068 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0621 18:27:12.362316   30068 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0621 18:27:12.371448   30068 binaries.go:44] Found k8s binaries, skipping transfer

	I0621 18:27:12.371499   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0621 18:27:12.380031   30068 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0621 18:27:12.395354   30068 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0621 18:27:12.410533   30068 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2153 bytes)

	I0621 18:27:12.425474   30068 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1447 bytes)

	I0621 18:27:12.440059   30068 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0621 18:27:12.443523   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:27:12.454828   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:27:12.572486   30068 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0621 18:27:12.589057   30068 certs.go:68] Setting up /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291 for IP: 192.168.39.198

	I0621 18:27:12.589078   30068 certs.go:194] generating shared ca certs ...

	I0621 18:27:12.589095   30068 certs.go:226] acquiring lock for ca certs: {Name:mk96df7d45efa699c355b4c4409471361aa3f418 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.589221   30068 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key

	I0621 18:27:12.589272   30068 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key

	I0621 18:27:12.589282   30068 certs.go:256] generating profile certs ...

	I0621 18:27:12.589333   30068 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key

	I0621 18:27:12.589346   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt with IP's: []

	I0621 18:27:12.759863   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt ...

	I0621 18:27:12.759890   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt: {Name:mk1350197087e6f37ca28e80a43c199beace4f91 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.760090   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key ...

	I0621 18:27:12.760104   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key: {Name:mk90994b992a268304b337419707e3332d3f039a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:12.760206   30068 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92

	I0621 18:27:12.760222   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.198 192.168.39.254]

	I0621 18:27:13.132336   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 ...

	I0621 18:27:13.132362   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92: {Name:mke7daa70ff2d7bf8fa87eea51b1ed6731c0dd6d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.132530   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92 ...

	I0621 18:27:13.132546   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92: {Name:mk310235904dba1c4db66ef73b8dcc06ff030051 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.132647   30068 certs.go:381] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.54585d92 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt

	I0621 18:27:13.132737   30068 certs.go:385] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.54585d92 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key

	I0621 18:27:13.132790   30068 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key

	I0621 18:27:13.132806   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt with IP's: []

	I0621 18:27:13.317891   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt ...

	I0621 18:27:13.317927   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt: {Name:mk5e450ef3633fa54e81eaeb94f9408c94729912 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.318119   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key ...

	I0621 18:27:13.318132   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key: {Name:mk3a1443924b05c36251566d5313d0eeb467e0fd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:13.318220   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0621 18:27:13.318241   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0621 18:27:13.318251   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0621 18:27:13.318264   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0621 18:27:13.318274   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0621 18:27:13.318290   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0621 18:27:13.318302   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0621 18:27:13.318314   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0621 18:27:13.318363   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem (1338 bytes)

	W0621 18:27:13.318396   30068 certs.go:480] ignoring /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329_empty.pem, impossibly tiny 0 bytes

	I0621 18:27:13.318406   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem (1675 bytes)

	I0621 18:27:13.318428   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem (1082 bytes)

	I0621 18:27:13.318449   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem (1123 bytes)

	I0621 18:27:13.318469   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem (1675 bytes)

	I0621 18:27:13.318506   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:13.318531   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.318544   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.318556   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem -> /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.319121   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0621 18:27:13.345382   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0621 18:27:13.379289   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0621 18:27:13.406853   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0621 18:27:13.430624   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0621 18:27:13.452498   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0621 18:27:13.474381   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0621 18:27:13.497475   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0621 18:27:13.520548   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /usr/share/ca-certificates/153292.pem (1708 bytes)

	I0621 18:27:13.543849   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0621 18:27:13.569722   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem --> /usr/share/ca-certificates/15329.pem (1338 bytes)

	I0621 18:27:13.594191   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0621 18:27:13.611312   30068 ssh_runner.go:195] Run: openssl version

	I0621 18:27:13.616881   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15329.pem && ln -fs /usr/share/ca-certificates/15329.pem /etc/ssl/certs/15329.pem"

	I0621 18:27:13.627054   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.631162   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 21 18:22 /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.631214   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15329.pem

	I0621 18:27:13.636845   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15329.pem /etc/ssl/certs/51391683.0"

	I0621 18:27:13.648132   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/153292.pem && ln -fs /usr/share/ca-certificates/153292.pem /etc/ssl/certs/153292.pem"

	I0621 18:27:13.658846   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.663074   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 21 18:22 /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.663140   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/153292.pem

	I0621 18:27:13.668358   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/153292.pem /etc/ssl/certs/3ec20f2e.0"

	I0621 18:27:13.678369   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0621 18:27:13.688293   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.692517   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 21 17:42 /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.692581   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:27:13.697837   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0621 18:27:13.707967   30068 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0621 18:27:13.711761   30068 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0621 18:27:13.711821   30068 kubeadm.go:391] StartCluster: {Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Moun

tType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0621 18:27:13.711887   30068 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0621 18:27:13.711960   30068 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0621 18:27:13.752929   30068 cri.go:89] found id: ""

	I0621 18:27:13.753017   30068 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0621 18:27:13.762514   30068 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0621 18:27:13.771612   30068 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0621 18:27:13.781740   30068 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0621 18:27:13.781758   30068 kubeadm.go:156] found existing configuration files:

	I0621 18:27:13.781811   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0621 18:27:13.790876   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0621 18:27:13.790943   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0621 18:27:13.800011   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0621 18:27:13.809117   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0621 18:27:13.809168   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0621 18:27:13.818279   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0621 18:27:13.827522   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0621 18:27:13.827584   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0621 18:27:13.836671   30068 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0621 18:27:13.845242   30068 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0621 18:27:13.845298   30068 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0621 18:27:13.854365   30068 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0621 18:27:13.951888   30068 kubeadm.go:309] [init] Using Kubernetes version: v1.30.2

	I0621 18:27:13.951970   30068 kubeadm.go:309] [preflight] Running pre-flight checks

	I0621 18:27:14.081675   30068 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0621 18:27:14.081845   30068 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0621 18:27:14.081983   30068 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0621 18:27:14.292951   30068 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0621 18:27:14.423174   30068 out.go:204]   - Generating certificates and keys ...

	I0621 18:27:14.423287   30068 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0621 18:27:14.423355   30068 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0621 18:27:14.524306   30068 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0621 18:27:14.693249   30068 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0621 18:27:14.771462   30068 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0621 18:27:14.965492   30068 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0621 18:27:15.095342   30068 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0621 18:27:15.095646   30068 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-406291 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]

	I0621 18:27:15.247328   30068 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0621 18:27:15.247729   30068 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-406291 localhost] and IPs [192.168.39.198 127.0.0.1 ::1]

	I0621 18:27:15.326656   30068 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0621 18:27:15.470979   30068 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0621 18:27:15.620090   30068 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0621 18:27:15.620402   30068 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0621 18:27:15.715693   30068 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0621 18:27:16.259484   30068 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0621 18:27:16.704626   30068 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0621 18:27:16.836633   30068 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0621 18:27:16.996818   30068 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0621 18:27:16.997517   30068 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0621 18:27:16.999949   30068 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0621 18:27:17.001874   30068 out.go:204]   - Booting up control plane ...

	I0621 18:27:17.001982   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0621 18:27:17.002874   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0621 18:27:17.003729   30068 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0621 18:27:17.018894   30068 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0621 18:27:17.019816   30068 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0621 18:27:17.019944   30068 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0621 18:27:17.138099   30068 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0621 18:27:17.138195   30068 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0621 18:27:17.639115   30068 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 501.282189ms

	I0621 18:27:17.639214   30068 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0621 18:27:23.502026   30068 kubeadm.go:309] [api-check] The API server is healthy after 5.864418149s

	I0621 18:27:23.512938   30068 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0621 18:27:23.528670   30068 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0621 18:27:24.059886   30068 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0621 18:27:24.060060   30068 kubeadm.go:309] [mark-control-plane] Marking the node ha-406291 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0621 18:27:24.071607   30068 kubeadm.go:309] [bootstrap-token] Using token: ha2utu.p9k0bq1xsr5791t7

	I0621 18:27:24.073185   30068 out.go:204]   - Configuring RBAC rules ...

	I0621 18:27:24.073336   30068 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0621 18:27:24.084336   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0621 18:27:24.092265   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0621 18:27:24.096415   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0621 18:27:24.101175   30068 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0621 18:27:24.104689   30068 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0621 18:27:24.121568   30068 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0621 18:27:24.349610   30068 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0621 18:27:24.907607   30068 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0621 18:27:24.908452   30068 kubeadm.go:309] 

	I0621 18:27:24.908529   30068 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0621 18:27:24.908541   30068 kubeadm.go:309] 

	I0621 18:27:24.908607   30068 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0621 18:27:24.908645   30068 kubeadm.go:309] 

	I0621 18:27:24.908698   30068 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0621 18:27:24.908780   30068 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0621 18:27:24.908863   30068 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0621 18:27:24.908873   30068 kubeadm.go:309] 

	I0621 18:27:24.908975   30068 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0621 18:27:24.908993   30068 kubeadm.go:309] 

	I0621 18:27:24.909038   30068 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0621 18:27:24.909045   30068 kubeadm.go:309] 

	I0621 18:27:24.909086   30068 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0621 18:27:24.909160   30068 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0621 18:27:24.909256   30068 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0621 18:27:24.909274   30068 kubeadm.go:309] 

	I0621 18:27:24.909401   30068 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0621 18:27:24.909522   30068 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0621 18:27:24.909544   30068 kubeadm.go:309] 

	I0621 18:27:24.909671   30068 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token ha2utu.p9k0bq1xsr5791t7 \

	I0621 18:27:24.909771   30068 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df \

	I0621 18:27:24.909810   30068 kubeadm.go:309] 	--control-plane 

	I0621 18:27:24.909824   30068 kubeadm.go:309] 

	I0621 18:27:24.909898   30068 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0621 18:27:24.909904   30068 kubeadm.go:309] 

	I0621 18:27:24.909977   30068 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token ha2utu.p9k0bq1xsr5791t7 \

	I0621 18:27:24.910064   30068 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:25b189dd8842da29004c6e91dd5dbce76990a035c20bc2914c46f3371e3a47df 

	I0621 18:27:24.910664   30068 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0621 18:27:24.910700   30068 cni.go:84] Creating CNI manager for ""

	I0621 18:27:24.910708   30068 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0621 18:27:24.912398   30068 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0621 18:27:24.913676   30068 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0621 18:27:24.919660   30068 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.2/kubectl ...

	I0621 18:27:24.919677   30068 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0621 18:27:24.938734   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0621 18:27:25.303975   30068 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0621 18:27:25.304070   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:25.304073   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-406291 minikube.k8s.io/updated_at=2024_06_21T18_27_25_0700 minikube.k8s.io/version=v1.33.1 minikube.k8s.io/commit=1a0d377c34faa85740cf2404ea12566198300600 minikube.k8s.io/name=ha-406291 minikube.k8s.io/primary=true

	I0621 18:27:25.334777   30068 ops.go:34] apiserver oom_adj: -16

	I0621 18:27:25.436873   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:25.937461   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:26.436991   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:26.937206   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:27.437152   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:27.937860   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:28.437177   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:28.937036   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:29.437007   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:29.937140   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:30.437060   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:30.937199   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:31.437695   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:31.937675   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:32.437034   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:32.937808   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:33.437793   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:33.937401   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:34.437307   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:34.937172   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:35.437428   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:35.937146   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:36.436951   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:36.937873   30068 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0621 18:27:37.039583   30068 kubeadm.go:1107] duration metric: took 11.735587948s to wait for elevateKubeSystemPrivileges

	W0621 18:27:37.039626   30068 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0621 18:27:37.039635   30068 kubeadm.go:393] duration metric: took 23.327819322s to StartCluster

	I0621 18:27:37.039654   30068 settings.go:142] acquiring lock: {Name:mkdbb660cad4d8fb446e5c2ca4439ea3326e9592 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:37.039737   30068 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:27:37.040362   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/kubeconfig: {Name:mk87038194ab41f67dd50d90b017d32a83c3da4f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:27:37.040584   30068 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:27:37.040604   30068 start.go:240] waiting for startup goroutines ...

	I0621 18:27:37.040603   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0621 18:27:37.040612   30068 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0621 18:27:37.040669   30068 addons.go:69] Setting storage-provisioner=true in profile "ha-406291"

	I0621 18:27:37.040677   30068 addons.go:69] Setting default-storageclass=true in profile "ha-406291"

	I0621 18:27:37.040699   30068 addons.go:234] Setting addon storage-provisioner=true in "ha-406291"

	I0621 18:27:37.040730   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:27:37.040700   30068 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-406291"

	I0621 18:27:37.040772   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:37.041052   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.041075   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.041146   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.041174   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.055583   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42699

	I0621 18:27:37.056062   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.056549   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.056570   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.056894   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.057371   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.057399   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.061343   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44857

	I0621 18:27:37.061846   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.062393   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.062418   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.062721   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.062885   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.065021   30068 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19112-8111/kubeconfig

	I0621 18:27:37.065351   30068 kapi.go:59] client config for ha-406291: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.crt", KeyFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key", CAFile:"/home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)},

UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cf98a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0621 18:27:37.065825   30068 cert_rotation.go:137] Starting client certificate rotation controller

	I0621 18:27:37.066065   30068 addons.go:234] Setting addon default-storageclass=true in "ha-406291"

	I0621 18:27:37.066106   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:27:37.066471   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.066512   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.072759   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39433

	I0621 18:27:37.073274   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.073791   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.073819   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.074169   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.074346   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.076096   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:37.078312   30068 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0621 18:27:37.079815   30068 addons.go:431] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 18:27:37.079840   30068 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0621 18:27:37.079864   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:37.081896   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41569

	I0621 18:27:37.082293   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.082859   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.082878   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.083163   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.083202   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.083607   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.083648   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.083733   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:37.083752   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.083817   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:37.083990   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:37.084135   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:37.084288   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:37.103512   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42081

	I0621 18:27:37.103937   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.104456   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.104473   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.104853   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.105052   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:27:37.106976   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:27:37.107211   30068 addons.go:431] installing /etc/kubernetes/addons/storageclass.yaml

	I0621 18:27:37.107231   30068 ssh_runner.go:362] scp storageclass/storageclass.yaml --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0621 18:27:37.107252   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:27:37.110295   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.110729   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:27:37.110755   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:27:37.110870   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:27:37.111030   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:27:37.111197   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:27:37.111314   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:27:37.137868   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0621 18:27:37.228739   30068 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0621 18:27:37.290397   30068 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0621 18:27:37.684619   30068 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0621 18:27:37.902862   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.902882   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.902957   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.902988   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903179   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903194   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903203   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.903210   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903287   30068 main.go:141] libmachine: (ha-406291) DBG | Closing plugin on server side

	I0621 18:27:37.903300   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903312   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903321   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.903328   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.903474   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903485   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903513   30068 main.go:141] libmachine: (ha-406291) DBG | Closing plugin on server side

	I0621 18:27:37.903578   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.903595   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.903740   30068 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0621 18:27:37.903767   30068 round_trippers.go:469] Request Headers:

	I0621 18:27:37.903778   30068 round_trippers.go:473]     Accept: application/json, */*

	I0621 18:27:37.903784   30068 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0621 18:27:37.922164   30068 round_trippers.go:574] Response Status: 200 OK in 18 milliseconds

	I0621 18:27:37.922691   30068 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0621 18:27:37.922706   30068 round_trippers.go:469] Request Headers:

	I0621 18:27:37.922713   30068 round_trippers.go:473]     Accept: application/json, */*

	I0621 18:27:37.922718   30068 round_trippers.go:473]     Content-Type: application/json

	I0621 18:27:37.922720   30068 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0621 18:27:37.926249   30068 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0621 18:27:37.926491   30068 main.go:141] libmachine: Making call to close driver server

	I0621 18:27:37.926512   30068 main.go:141] libmachine: (ha-406291) Calling .Close

	I0621 18:27:37.926731   30068 main.go:141] libmachine: Successfully made call to close driver server

	I0621 18:27:37.926748   30068 main.go:141] libmachine: Making call to close connection to plugin binary

	I0621 18:27:37.928515   30068 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0621 18:27:37.930095   30068 addons.go:510] duration metric: took 889.47949ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I0621 18:27:37.930127   30068 start.go:245] waiting for cluster config update ...

	I0621 18:27:37.930137   30068 start.go:254] writing updated cluster config ...

	I0621 18:27:37.931687   30068 out.go:177] 

	I0621 18:27:37.933039   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:37.933102   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:37.934716   30068 out.go:177] * Starting "ha-406291-m02" control-plane node in "ha-406291" cluster

	I0621 18:27:37.935953   30068 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime crio

	I0621 18:27:37.935970   30068 cache.go:56] Caching tarball of preloaded images

	I0621 18:27:37.936052   30068 preload.go:173] Found /home/jenkins/minikube-integration/19112-8111/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0621 18:27:37.936063   30068 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on crio

	I0621 18:27:37.936142   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:37.936325   30068 start.go:360] acquireMachinesLock for ha-406291-m02: {Name:mkdb5ead19d46168ac3b04a7a163113221efea18 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0621 18:27:37.936370   30068 start.go:364] duration metric: took 24.972µs to acquireMachinesLock for "ha-406291-m02"

	I0621 18:27:37.936392   30068 start.go:93] Provisioning new machine with config: &{Name:ha-406291 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19112/minikube-v1.33.1-1718923868-19112-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1718923403-19112@sha256:cc061048d931d84aa4a945fb4686882929674aeba8a6ed833c4fb3a3c2b6805e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.198 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 Cer

tExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0621 18:27:37.936481   30068 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0621 18:27:37.938349   30068 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0621 18:27:37.938428   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:27:37.938450   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:27:37.952767   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34515

	I0621 18:27:37.953176   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:27:37.953649   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:27:37.953669   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:27:37.953963   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:27:37.954162   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:37.954301   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:37.954431   30068 start.go:159] libmachine.API.Create for "ha-406291" (driver="kvm2")

	I0621 18:27:37.954456   30068 client.go:168] LocalClient.Create starting

	I0621 18:27:37.954488   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem

	I0621 18:27:37.954518   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:27:37.954538   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:27:37.954589   30068 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem

	I0621 18:27:37.954607   30068 main.go:141] libmachine: Decoding PEM data...

	I0621 18:27:37.954621   30068 main.go:141] libmachine: Parsing certificate...

	I0621 18:27:37.954636   30068 main.go:141] libmachine: Running pre-create checks...

	I0621 18:27:37.954644   30068 main.go:141] libmachine: (ha-406291-m02) Calling .PreCreateCheck

	I0621 18:27:37.954836   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:37.955238   30068 main.go:141] libmachine: Creating machine...

	I0621 18:27:37.955253   30068 main.go:141] libmachine: (ha-406291-m02) Calling .Create

	I0621 18:27:37.955404   30068 main.go:141] libmachine: (ha-406291-m02) Creating KVM machine...

	I0621 18:27:37.956748   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found existing default KVM network

	I0621 18:27:37.956951   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found existing private KVM network mk-ha-406291

	I0621 18:27:37.957069   30068 main.go:141] libmachine: (ha-406291-m02) Setting up store path in /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 ...

	I0621 18:27:37.957091   30068 main.go:141] libmachine: (ha-406291-m02) Building disk image from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso

	I0621 18:27:37.957139   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:37.957062   30460 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:27:37.957278   30068 main.go:141] libmachine: (ha-406291-m02) Downloading /home/jenkins/minikube-integration/19112-8111/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/19112-8111/.minikube/cache/iso/amd64/minikube-v1.33.1-1718923868-19112-amd64.iso...

	I0621 18:27:38.178433   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.178291   30460 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa...

	I0621 18:27:38.322659   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.322470   30460 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/ha-406291-m02.rawdisk...

	I0621 18:27:38.322709   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 (perms=drwx------)

	I0621 18:27:38.322719   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Writing magic tar header

	I0621 18:27:38.322734   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Writing SSH key tar header

	I0621 18:27:38.322745   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:38.322583   30460 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02 ...

	I0621 18:27:38.322758   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02

	I0621 18:27:38.322822   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube/machines

	I0621 18:27:38.322839   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube/machines (perms=drwxr-xr-x)

	I0621 18:27:38.322855   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111/.minikube (perms=drwxr-xr-x)

	I0621 18:27:38.322864   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration/19112-8111 (perms=drwxrwxr-x)

	I0621 18:27:38.322874   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0621 18:27:38.322882   30068 main.go:141] libmachine: (ha-406291-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0621 18:27:38.322896   30068 main.go:141] libmachine: (ha-406291-m02) Creating domain...

	I0621 18:27:38.322919   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111/.minikube

	I0621 18:27:38.322939   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/19112-8111

	I0621 18:27:38.322950   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0621 18:27:38.322968   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home/jenkins

	I0621 18:27:38.322980   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Checking permissions on dir: /home

	I0621 18:27:38.322988   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Skipping /home - not owner

	I0621 18:27:38.324031   30068 main.go:141] libmachine: (ha-406291-m02) define libvirt domain using xml: 

	I0621 18:27:38.324058   30068 main.go:141] libmachine: (ha-406291-m02) <domain type='kvm'>

	I0621 18:27:38.324071   30068 main.go:141] libmachine: (ha-406291-m02)   <name>ha-406291-m02</name>

	I0621 18:27:38.324078   30068 main.go:141] libmachine: (ha-406291-m02)   <memory unit='MiB'>2200</memory>

	I0621 18:27:38.324087   30068 main.go:141] libmachine: (ha-406291-m02)   <vcpu>2</vcpu>

	I0621 18:27:38.324098   30068 main.go:141] libmachine: (ha-406291-m02)   <features>

	I0621 18:27:38.324107   30068 main.go:141] libmachine: (ha-406291-m02)     <acpi/>

	I0621 18:27:38.324116   30068 main.go:141] libmachine: (ha-406291-m02)     <apic/>

	I0621 18:27:38.324125   30068 main.go:141] libmachine: (ha-406291-m02)     <pae/>

	I0621 18:27:38.324134   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324149   30068 main.go:141] libmachine: (ha-406291-m02)   </features>

	I0621 18:27:38.324164   30068 main.go:141] libmachine: (ha-406291-m02)   <cpu mode='host-passthrough'>

	I0621 18:27:38.324173   30068 main.go:141] libmachine: (ha-406291-m02)   

	I0621 18:27:38.324184   30068 main.go:141] libmachine: (ha-406291-m02)   </cpu>

	I0621 18:27:38.324199   30068 main.go:141] libmachine: (ha-406291-m02)   <os>

	I0621 18:27:38.324209   30068 main.go:141] libmachine: (ha-406291-m02)     <type>hvm</type>

	I0621 18:27:38.324220   30068 main.go:141] libmachine: (ha-406291-m02)     <boot dev='cdrom'/>

	I0621 18:27:38.324231   30068 main.go:141] libmachine: (ha-406291-m02)     <boot dev='hd'/>

	I0621 18:27:38.324258   30068 main.go:141] libmachine: (ha-406291-m02)     <bootmenu enable='no'/>

	I0621 18:27:38.324280   30068 main.go:141] libmachine: (ha-406291-m02)   </os>

	I0621 18:27:38.324293   30068 main.go:141] libmachine: (ha-406291-m02)   <devices>

	I0621 18:27:38.324310   30068 main.go:141] libmachine: (ha-406291-m02)     <disk type='file' device='cdrom'>

	I0621 18:27:38.324333   30068 main.go:141] libmachine: (ha-406291-m02)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/boot2docker.iso'/>

	I0621 18:27:38.324344   30068 main.go:141] libmachine: (ha-406291-m02)       <target dev='hdc' bus='scsi'/>

	I0621 18:27:38.324350   30068 main.go:141] libmachine: (ha-406291-m02)       <readonly/>

	I0621 18:27:38.324357   30068 main.go:141] libmachine: (ha-406291-m02)     </disk>

	I0621 18:27:38.324363   30068 main.go:141] libmachine: (ha-406291-m02)     <disk type='file' device='disk'>

	I0621 18:27:38.324375   30068 main.go:141] libmachine: (ha-406291-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0621 18:27:38.324390   30068 main.go:141] libmachine: (ha-406291-m02)       <source file='/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/ha-406291-m02.rawdisk'/>

	I0621 18:27:38.324401   30068 main.go:141] libmachine: (ha-406291-m02)       <target dev='hda' bus='virtio'/>

	I0621 18:27:38.324412   30068 main.go:141] libmachine: (ha-406291-m02)     </disk>

	I0621 18:27:38.324421   30068 main.go:141] libmachine: (ha-406291-m02)     <interface type='network'>

	I0621 18:27:38.324431   30068 main.go:141] libmachine: (ha-406291-m02)       <source network='mk-ha-406291'/>

	I0621 18:27:38.324442   30068 main.go:141] libmachine: (ha-406291-m02)       <model type='virtio'/>

	I0621 18:27:38.324453   30068 main.go:141] libmachine: (ha-406291-m02)     </interface>

	I0621 18:27:38.324465   30068 main.go:141] libmachine: (ha-406291-m02)     <interface type='network'>

	I0621 18:27:38.324474   30068 main.go:141] libmachine: (ha-406291-m02)       <source network='default'/>

	I0621 18:27:38.324481   30068 main.go:141] libmachine: (ha-406291-m02)       <model type='virtio'/>

	I0621 18:27:38.324493   30068 main.go:141] libmachine: (ha-406291-m02)     </interface>

	I0621 18:27:38.324503   30068 main.go:141] libmachine: (ha-406291-m02)     <serial type='pty'>

	I0621 18:27:38.324516   30068 main.go:141] libmachine: (ha-406291-m02)       <target port='0'/>

	I0621 18:27:38.324527   30068 main.go:141] libmachine: (ha-406291-m02)     </serial>

	I0621 18:27:38.324540   30068 main.go:141] libmachine: (ha-406291-m02)     <console type='pty'>

	I0621 18:27:38.324553   30068 main.go:141] libmachine: (ha-406291-m02)       <target type='serial' port='0'/>

	I0621 18:27:38.324562   30068 main.go:141] libmachine: (ha-406291-m02)     </console>

	I0621 18:27:38.324572   30068 main.go:141] libmachine: (ha-406291-m02)     <rng model='virtio'>

	I0621 18:27:38.324596   30068 main.go:141] libmachine: (ha-406291-m02)       <backend model='random'>/dev/random</backend>

	I0621 18:27:38.324609   30068 main.go:141] libmachine: (ha-406291-m02)     </rng>

	I0621 18:27:38.324630   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324640   30068 main.go:141] libmachine: (ha-406291-m02)     

	I0621 18:27:38.324648   30068 main.go:141] libmachine: (ha-406291-m02)   </devices>

	I0621 18:27:38.324660   30068 main.go:141] libmachine: (ha-406291-m02) </domain>

	I0621 18:27:38.324670   30068 main.go:141] libmachine: (ha-406291-m02) 

	I0621 18:27:38.332042   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:20:08:0e in network default

	I0621 18:27:38.332641   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring networks are active...

	I0621 18:27:38.332676   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:38.333428   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring network default is active

	I0621 18:27:38.333804   30068 main.go:141] libmachine: (ha-406291-m02) Ensuring network mk-ha-406291 is active

	I0621 18:27:38.334296   30068 main.go:141] libmachine: (ha-406291-m02) Getting domain xml...

	I0621 18:27:38.335120   30068 main.go:141] libmachine: (ha-406291-m02) Creating domain...

	I0621 18:27:39.549305   30068 main.go:141] libmachine: (ha-406291-m02) Waiting to get IP...

	I0621 18:27:39.550967   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:39.551951   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:39.551976   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:39.551936   30460 retry.go:31] will retry after 267.635955ms: waiting for machine to come up

	I0621 18:27:39.821522   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:39.821997   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:39.822029   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:39.821946   30460 retry.go:31] will retry after 374.873977ms: waiting for machine to come up

	I0621 18:27:40.198386   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:40.198873   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:40.198904   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:40.198809   30460 retry.go:31] will retry after 315.815993ms: waiting for machine to come up

	I0621 18:27:40.516366   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:40.516862   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:40.516886   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:40.516817   30460 retry.go:31] will retry after 541.866776ms: waiting for machine to come up

	I0621 18:27:41.060525   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:41.061206   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:41.061240   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:41.061128   30460 retry.go:31] will retry after 493.062164ms: waiting for machine to come up

	I0621 18:27:41.555747   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:41.556109   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:41.556139   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:41.556061   30460 retry.go:31] will retry after 805.68132ms: waiting for machine to come up

	I0621 18:27:42.362929   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:42.363432   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:42.363464   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:42.363390   30460 retry.go:31] will retry after 986.445399ms: waiting for machine to come up

	I0621 18:27:43.351818   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:43.352265   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:43.352293   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:43.352201   30460 retry.go:31] will retry after 1.001415085s: waiting for machine to come up

	I0621 18:27:44.355253   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:44.355689   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:44.355710   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:44.355671   30460 retry.go:31] will retry after 1.270979624s: waiting for machine to come up

	I0621 18:27:45.627787   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:45.628323   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:45.628354   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:45.628272   30460 retry.go:31] will retry after 2.328221347s: waiting for machine to come up

	I0621 18:27:47.958352   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:47.958918   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:47.958945   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:47.958858   30460 retry.go:31] will retry after 2.603205559s: waiting for machine to come up

	I0621 18:27:50.565502   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:50.565956   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:50.565982   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:50.565839   30460 retry.go:31] will retry after 3.267607258s: waiting for machine to come up

	I0621 18:27:53.834801   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:53.835311   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find current IP address of domain ha-406291-m02 in network mk-ha-406291

	I0621 18:27:53.835344   30068 main.go:141] libmachine: (ha-406291-m02) DBG | I0621 18:27:53.835270   30460 retry.go:31] will retry after 4.450176964s: waiting for machine to come up

	I0621 18:27:58.286744   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.287205   30068 main.go:141] libmachine: (ha-406291-m02) Found IP for machine: 192.168.39.89

	I0621 18:27:58.287228   30068 main.go:141] libmachine: (ha-406291-m02) Reserving static IP address...

	I0621 18:27:58.287241   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has current primary IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.287601   30068 main.go:141] libmachine: (ha-406291-m02) DBG | unable to find host DHCP lease matching {name: "ha-406291-m02", mac: "52:54:00:a6:9a:09", ip: "192.168.39.89"} in network mk-ha-406291

	I0621 18:27:58.359643   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Getting to WaitForSSH function...

	I0621 18:27:58.359672   30068 main.go:141] libmachine: (ha-406291-m02) Reserved static IP address: 192.168.39.89

	I0621 18:27:58.359686   30068 main.go:141] libmachine: (ha-406291-m02) Waiting for SSH to be available...

	I0621 18:27:58.362234   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.362656   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:minikube Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.362687   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.362831   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using SSH client type: external

	I0621 18:27:58.362856   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa (-rw-------)

	I0621 18:27:58.362889   30068 main.go:141] libmachine: (ha-406291-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.89 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0621 18:27:58.362901   30068 main.go:141] libmachine: (ha-406291-m02) DBG | About to run SSH command:

	I0621 18:27:58.362914   30068 main.go:141] libmachine: (ha-406291-m02) DBG | exit 0

	I0621 18:27:58.489760   30068 main.go:141] libmachine: (ha-406291-m02) DBG | SSH cmd err, output: <nil>: 

	I0621 18:27:58.490247   30068 main.go:141] libmachine: (ha-406291-m02) KVM machine creation complete!

	I0621 18:27:58.490512   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:58.491093   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:58.491338   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:58.491506   30068 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0621 18:27:58.491523   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetState

	I0621 18:27:58.492807   30068 main.go:141] libmachine: Detecting operating system of created instance...

	I0621 18:27:58.492820   30068 main.go:141] libmachine: Waiting for SSH to be available...

	I0621 18:27:58.492825   30068 main.go:141] libmachine: Getting to WaitForSSH function...

	I0621 18:27:58.492853   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.495422   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.495802   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.495822   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.496013   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.496199   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.496377   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.496515   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.496690   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.496943   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.496957   30068 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0621 18:27:58.609072   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:58.609094   30068 main.go:141] libmachine: Detecting the provisioner...

	I0621 18:27:58.609101   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.611976   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.612412   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.612450   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.612655   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.612869   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.613083   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.613234   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.613421   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.613617   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.613629   30068 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0621 18:27:58.726636   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0621 18:27:58.726736   30068 main.go:141] libmachine: found compatible host: buildroot

	I0621 18:27:58.726751   30068 main.go:141] libmachine: Provisioning with buildroot...

	I0621 18:27:58.726768   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.727017   30068 buildroot.go:166] provisioning hostname "ha-406291-m02"

	I0621 18:27:58.727040   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.727234   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.729851   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.730255   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.730296   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.730453   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.730628   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.730787   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.730932   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.731090   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.731271   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.731295   30068 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-406291-m02 && echo "ha-406291-m02" | sudo tee /etc/hostname

	I0621 18:27:58.855682   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-406291-m02

	I0621 18:27:58.855710   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.858373   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.858679   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.858702   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.858921   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:58.859107   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.859289   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:58.859473   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:58.859613   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:58.859768   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:58.859784   30068 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-406291-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-406291-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-406291-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0621 18:27:58.979692   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0621 18:27:58.979722   30068 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19112-8111/.minikube CaCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19112-8111/.minikube}

	I0621 18:27:58.979735   30068 buildroot.go:174] setting up certificates

	I0621 18:27:58.979743   30068 provision.go:84] configureAuth start

	I0621 18:27:58.979750   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetMachineName

	I0621 18:27:58.980076   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:58.982730   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.983078   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.983110   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.983252   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:58.985344   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.985701   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:58.985721   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:58.985890   30068 provision.go:143] copyHostCerts

	I0621 18:27:58.985924   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:58.985962   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem, removing ...

	I0621 18:27:58.985976   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem

	I0621 18:27:58.986057   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/ca.pem (1082 bytes)

	I0621 18:27:58.986156   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:58.986180   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem, removing ...

	I0621 18:27:58.986187   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem

	I0621 18:27:58.986229   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/cert.pem (1123 bytes)

	I0621 18:27:58.986293   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:58.986317   30068 exec_runner.go:144] found /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem, removing ...

	I0621 18:27:58.986326   30068 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem

	I0621 18:27:58.986360   30068 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19112-8111/.minikube/key.pem (1675 bytes)

	I0621 18:27:58.986426   30068 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem org=jenkins.ha-406291-m02 san=[127.0.0.1 192.168.39.89 ha-406291-m02 localhost minikube]

	I0621 18:27:59.066564   30068 provision.go:177] copyRemoteCerts

	I0621 18:27:59.066626   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0621 18:27:59.066653   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.069578   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.069924   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.069947   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.070132   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.070298   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.070432   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.070553   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.157218   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0621 18:27:59.157315   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0621 18:27:59.181198   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0621 18:27:59.181277   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1082 bytes)

	I0621 18:27:59.204590   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0621 18:27:59.204671   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0621 18:27:59.228836   30068 provision.go:87] duration metric: took 249.081961ms to configureAuth

	I0621 18:27:59.228857   30068 buildroot.go:189] setting minikube options for container-runtime

	I0621 18:27:59.229023   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:27:59.229086   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.231759   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.232083   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.232114   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.232338   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.232525   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.232684   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.232859   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.233030   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:59.233222   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:59.233247   30068 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0621 18:27:59.513149   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0621 18:27:59.513176   30068 main.go:141] libmachine: Checking connection to Docker...

	I0621 18:27:59.513184   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetURL

	I0621 18:27:59.514352   30068 main.go:141] libmachine: (ha-406291-m02) DBG | Using libvirt version 6000000

	I0621 18:27:59.516825   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.517208   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.517232   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.517421   30068 main.go:141] libmachine: Docker is up and running!

	I0621 18:27:59.517438   30068 main.go:141] libmachine: Reticulating splines...

	I0621 18:27:59.517446   30068 client.go:171] duration metric: took 21.562982419s to LocalClient.Create

	I0621 18:27:59.517469   30068 start.go:167] duration metric: took 21.563040702s to libmachine.API.Create "ha-406291"

	I0621 18:27:59.517482   30068 start.go:293] postStartSetup for "ha-406291-m02" (driver="kvm2")

	I0621 18:27:59.517494   30068 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0621 18:27:59.517516   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.517768   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0621 18:27:59.517792   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.520113   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.520510   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.520540   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.520681   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.520881   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.521084   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.521256   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.607755   30068 ssh_runner.go:195] Run: cat /etc/os-release

	I0621 18:27:59.611555   30068 info.go:137] Remote host: Buildroot 2023.02.9

	I0621 18:27:59.611581   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/addons for local assets ...

	I0621 18:27:59.611696   30068 filesync.go:126] Scanning /home/jenkins/minikube-integration/19112-8111/.minikube/files for local assets ...

	I0621 18:27:59.611804   30068 filesync.go:149] local asset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> 153292.pem in /etc/ssl/certs

	I0621 18:27:59.611817   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /etc/ssl/certs/153292.pem

	I0621 18:27:59.611939   30068 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0621 18:27:59.620359   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:27:59.643420   30068 start.go:296] duration metric: took 125.923821ms for postStartSetup

	I0621 18:27:59.643465   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetConfigRaw

	I0621 18:27:59.644062   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:59.646345   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.646685   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.646713   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.646924   30068 profile.go:143] Saving config to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/config.json ...

	I0621 18:27:59.647158   30068 start.go:128] duration metric: took 21.710666055s to createHost

	I0621 18:27:59.647181   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.649469   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.649766   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.649808   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.649962   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.650164   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.650334   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.650463   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.650585   30068 main.go:141] libmachine: Using SSH client type: native

	I0621 18:27:59.650778   30068 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.89 22 <nil> <nil>}

	I0621 18:27:59.650790   30068 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0621 18:27:59.762223   30068 main.go:141] libmachine: SSH cmd err, output: <nil>: 1718994479.737744516

	I0621 18:27:59.762248   30068 fix.go:216] guest clock: 1718994479.737744516

	I0621 18:27:59.762259   30068 fix.go:229] Guest: 2024-06-21 18:27:59.737744516 +0000 UTC Remote: 2024-06-21 18:27:59.647170431 +0000 UTC m=+77.232139235 (delta=90.574085ms)

	I0621 18:27:59.762274   30068 fix.go:200] guest clock delta is within tolerance: 90.574085ms

	I0621 18:27:59.762279   30068 start.go:83] releasing machines lock for "ha-406291-m02", held for 21.825898335s

	I0621 18:27:59.762294   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.762550   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:27:59.765379   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.765744   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.765772   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.768017   30068 out.go:177] * Found network options:

	I0621 18:27:59.769201   30068 out.go:177]   - NO_PROXY=192.168.39.198

	W0621 18:27:59.770311   30068 proxy.go:119] fail to check proxy env: Error ip not in block

	I0621 18:27:59.770350   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.770853   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.771049   30068 main.go:141] libmachine: (ha-406291-m02) Calling .DriverName

	I0621 18:27:59.771143   30068 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0621 18:27:59.771180   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	W0621 18:27:59.771247   30068 proxy.go:119] fail to check proxy env: Error ip not in block

	I0621 18:27:59.771305   30068 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0621 18:27:59.771322   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHHostname

	I0621 18:27:59.774073   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774210   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774455   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.774482   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774586   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.774595   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:27:59.774615   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:27:59.774740   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHPort

	I0621 18:27:59.774796   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.774875   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHKeyPath

	I0621 18:27:59.774963   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.775030   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetSSHUsername

	I0621 18:27:59.775150   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:27:59.775184   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.89 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291-m02/id_rsa Username:docker}

	I0621 18:28:00.009851   30068 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0621 18:28:00.016373   30068 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0621 18:28:00.016450   30068 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0621 18:28:00.032199   30068 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0621 18:28:00.032221   30068 start.go:494] detecting cgroup driver to use...

	I0621 18:28:00.032283   30068 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0621 18:28:00.047343   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0621 18:28:00.061720   30068 docker.go:217] disabling cri-docker service (if available) ...

	I0621 18:28:00.061774   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0621 18:28:00.074668   30068 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0621 18:28:00.087919   30068 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0621 18:28:00.213060   30068 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0621 18:28:00.376339   30068 docker.go:233] disabling docker service ...

	I0621 18:28:00.376406   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0621 18:28:00.391732   30068 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0621 18:28:00.405305   30068 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0621 18:28:00.525867   30068 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0621 18:28:00.642362   30068 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0621 18:28:00.656276   30068 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0621 18:28:00.673811   30068 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0621 18:28:00.673883   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.683794   30068 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0621 18:28:00.683849   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.693601   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.703298   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.712924   30068 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0621 18:28:00.722921   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.733272   30068 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.749781   30068 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0621 18:28:00.759708   30068 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0621 18:28:00.768749   30068 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0621 18:28:00.768811   30068 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0621 18:28:00.780758   30068 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0621 18:28:00.789993   30068 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0621 18:28:00.904855   30068 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0621 18:28:01.039631   30068 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0621 18:28:01.039706   30068 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0621 18:28:01.044480   30068 start.go:562] Will wait 60s for crictl version

	I0621 18:28:01.044536   30068 ssh_runner.go:195] Run: which crictl

	I0621 18:28:01.048220   30068 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0621 18:28:01.089333   30068 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0621 18:28:01.089402   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:28:01.115665   30068 ssh_runner.go:195] Run: crio --version

	I0621 18:28:01.144585   30068 out.go:177] * Preparing Kubernetes v1.30.2 on CRI-O 1.29.1 ...

	I0621 18:28:01.145952   30068 out.go:177]   - env NO_PROXY=192.168.39.198

	I0621 18:28:01.147149   30068 main.go:141] libmachine: (ha-406291-m02) Calling .GetIP

	I0621 18:28:01.149745   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:28:01.150121   30068 main.go:141] libmachine: (ha-406291-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:a6:9a:09", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:27:51 +0000 UTC Type:0 Mac:52:54:00:a6:9a:09 Iaid: IPaddr:192.168.39.89 Prefix:24 Hostname:ha-406291-m02 Clientid:01:52:54:00:a6:9a:09}

	I0621 18:28:01.150153   30068 main.go:141] libmachine: (ha-406291-m02) DBG | domain ha-406291-m02 has defined IP address 192.168.39.89 and MAC address 52:54:00:a6:9a:09 in network mk-ha-406291

	I0621 18:28:01.150424   30068 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0621 18:28:01.154395   30068 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0621 18:28:01.167802   30068 mustload.go:65] Loading cluster: ha-406291

	I0621 18:28:01.168024   30068 config.go:182] Loaded profile config "ha-406291": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.2

	I0621 18:28:01.168528   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:28:01.168581   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:28:01.183458   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35465

	I0621 18:28:01.183955   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:28:01.184452   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:28:01.184472   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:28:01.184809   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:28:01.185006   30068 main.go:141] libmachine: (ha-406291) Calling .GetState

	I0621 18:28:01.186504   30068 host.go:66] Checking if "ha-406291" exists ...

	I0621 18:28:01.186796   30068 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0621 18:28:01.186838   30068 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0621 18:28:01.201898   30068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38995

	I0621 18:28:01.202307   30068 main.go:141] libmachine: () Calling .GetVersion

	I0621 18:28:01.202715   30068 main.go:141] libmachine: Using API Version  1

	I0621 18:28:01.202735   30068 main.go:141] libmachine: () Calling .SetConfigRaw

	I0621 18:28:01.203060   30068 main.go:141] libmachine: () Calling .GetMachineName

	I0621 18:28:01.203242   30068 main.go:141] libmachine: (ha-406291) Calling .DriverName

	I0621 18:28:01.203402   30068 certs.go:68] Setting up /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291 for IP: 192.168.39.89

	I0621 18:28:01.203414   30068 certs.go:194] generating shared ca certs ...

	I0621 18:28:01.203427   30068 certs.go:226] acquiring lock for ca certs: {Name:mk96df7d45efa699c355b4c4409471361aa3f418 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.203536   30068 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key

	I0621 18:28:01.203569   30068 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key

	I0621 18:28:01.203578   30068 certs.go:256] generating profile certs ...

	I0621 18:28:01.203637   30068 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/client.key

	I0621 18:28:01.203663   30068 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63

	I0621 18:28:01.203682   30068 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.198 192.168.39.89 192.168.39.254]

	I0621 18:28:01.277240   30068 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 ...

	I0621 18:28:01.277269   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63: {Name:mk0eb1e86875fe5e87f845f9e621f66001c859bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.277433   30068 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63 ...

	I0621 18:28:01.277446   30068 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63: {Name:mk95e28e76a927e44fae3dabafa76ecc474c70ef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0621 18:28:01.277517   30068 certs.go:381] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt.abe9db63 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt

	I0621 18:28:01.277686   30068 certs.go:385] copying /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key.abe9db63 -> /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key

	I0621 18:28:01.277852   30068 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key

	I0621 18:28:01.277870   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0621 18:28:01.277883   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0621 18:28:01.277894   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0621 18:28:01.277906   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0621 18:28:01.277922   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0621 18:28:01.277934   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0621 18:28:01.277946   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0621 18:28:01.277957   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0621 18:28:01.278003   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem (1338 bytes)

	W0621 18:28:01.278030   30068 certs.go:480] ignoring /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329_empty.pem, impossibly tiny 0 bytes

	I0621 18:28:01.278039   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca-key.pem (1675 bytes)

	I0621 18:28:01.278059   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/ca.pem (1082 bytes)

	I0621 18:28:01.278080   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/cert.pem (1123 bytes)

	I0621 18:28:01.278100   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/key.pem (1675 bytes)

	I0621 18:28:01.278136   30068 certs.go:484] found cert: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem (1708 bytes)

	I0621 18:28:01.278162   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.278179   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem -> /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.278191   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem -> /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.278220   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHHostname

	I0621 18:28:01.281289   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:28:01.281749   30068 main.go:141] libmachine: (ha-406291) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:38:dc:46", ip: ""} in network mk-ha-406291: {Iface:virbr1 ExpiryTime:2024-06-21 19:26:56 +0000 UTC Type:0 Mac:52:54:00:38:dc:46 Iaid: IPaddr:192.168.39.198 Prefix:24 Hostname:ha-406291 Clientid:01:52:54:00:38:dc:46}

	I0621 18:28:01.281771   30068 main.go:141] libmachine: (ha-406291) DBG | domain ha-406291 has defined IP address 192.168.39.198 and MAC address 52:54:00:38:dc:46 in network mk-ha-406291

	I0621 18:28:01.281960   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHPort

	I0621 18:28:01.282180   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHKeyPath

	I0621 18:28:01.282351   30068 main.go:141] libmachine: (ha-406291) Calling .GetSSHUsername

	I0621 18:28:01.282534   30068 sshutil.go:53] new ssh client: &{IP:192.168.39.198 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19112-8111/.minikube/machines/ha-406291/id_rsa Username:docker}

	I0621 18:28:01.350153   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0621 18:28:01.355146   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0621 18:28:01.366317   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0621 18:28:01.370418   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0621 18:28:01.381527   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0621 18:28:01.385371   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0621 18:28:01.395583   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0621 18:28:01.399523   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0621 18:28:01.409427   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0621 18:28:01.413340   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0621 18:28:01.424281   30068 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0621 18:28:01.428574   30068 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0621 18:28:01.443501   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0621 18:28:01.467141   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0621 18:28:01.489464   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0621 18:28:01.512839   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0621 18:28:01.536345   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0621 18:28:01.560903   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0621 18:28:01.585228   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0621 18:28:01.609236   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/profiles/ha-406291/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0621 18:28:01.632797   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0621 18:28:01.657717   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/certs/15329.pem --> /usr/share/ca-certificates/15329.pem (1338 bytes)

	I0621 18:28:01.680728   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/files/etc/ssl/certs/153292.pem --> /usr/share/ca-certificates/153292.pem (1708 bytes)

	I0621 18:28:01.704813   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0621 18:28:01.722206   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0621 18:28:01.739548   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0621 18:28:01.757066   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0621 18:28:01.773769   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0621 18:28:01.790648   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0621 18:28:01.807019   30068 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0621 18:28:01.824606   30068 ssh_runner.go:195] Run: openssl version

	I0621 18:28:01.830760   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0621 18:28:01.841994   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.846701   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jun 21 17:42 /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.846753   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0621 18:28:01.852556   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0621 18:28:01.863407   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/15329.pem && ln -fs /usr/share/ca-certificates/15329.pem /etc/ssl/certs/15329.pem"

	I0621 18:28:01.874586   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.879134   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jun 21 18:22 /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.879185   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/15329.pem

	I0621 18:28:01.884636   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/15329.pem /etc/ssl/certs/51391683.0"

	I0621 18:28:01.895639   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/153292.pem && ln -fs /usr/share/ca-certificates/153292.pem /etc/ssl/certs/153292.pem"

	I0621 18:28:01.907107   30068 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.911747   30068 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jun 21 18:22 /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.911813   30068 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/153292.pem

	I0621 18:28:01.917537   30068 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/153292.pem /etc/ssl/certs/3ec20f2e.0"

	I0621 18:28:01.928452   30068 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0621 18:28:01.932569   30068 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0621 18:28:01.932640   30068 kubeadm.go:928] updating node {m02 192.168.39.89 8443 v1.30.2 crio true true} ...

	I0621 18:28:01.932831   30068 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-406291-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.89

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-406291 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0621 18:28:01.932869   30068 kube-vip.go:115] generating kube-vip config ...

	I0621 18:28:01.932919   30068 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0621 18:28:01.949970   30068 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0621 18:28:01.950046   30068 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0621 18:28:01.950102   30068 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0621 18:28:01.960116   30068 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.2': No such file or directory

	Initiating transfer...

	I0621 18:28:01.960197   30068 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.2

	I0621 18:28:01.969893   30068 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubectl.sha256

	I0621 18:28:01.969926   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubectl -> /var/lib/minikube/binaries/v1.30.2/kubectl

	I0621 18:28:01.969997   30068 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubectl

	I0621 18:28:01.970033   30068 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm

	I0621 18:28:01.970001   30068 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubelet

	I0621 18:28:01.974344   30068 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubectl': No such file or directory

	I0621 18:28:01.974375   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubectl --> /var/lib/minikube/binaries/v1.30.2/kubectl (51454104 bytes)

	I0621 18:28:02.755689   30068 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm -> /var/lib/minikube/binaries/v1.30.2/kubeadm

	I0621 18:28:02.755764   30068 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubeadm

	I0621 18:28:02.760415   30068 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.2/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.2/kubeadm': No such file or directory

	I0621 18:28:02.760448   30068 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubeadm --> /var/lib/minikube/binaries/v1.30.2/kubeadm (50249880 bytes)

	I0621 18:28:55.051081   30068 out.go:177] 

	W0621 18:28:55.052955   30068 out.go:239] X Exiting due to GUEST_START: failed to start node: adding node: update node: downloading binaries: downloading kubelet: download failed: https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256: getter: &{Ctx:context.Background Src:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.2/bin/linux/amd64/kubelet.sha256 Dst:/home/jenkins/minikube-integration/19112-8111/.minikube/cache/linux/amd64/v1.30.2/kubelet.download Pwd: Mode:2 Umask:---------- Detectors:[0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0 0x49e27e0] Decompressors:map[bz2:0xc000769610 gz:0xc000769618 tar:0xc0007695c0 tar.bz2:0xc0007695d0 tar.gz:0xc0007695e0 tar.xz:0xc0007695f0 tar.zst:0xc000769600 tbz2:0xc0007695d0 tgz:0xc0007695e0 txz:0xc0007695f0 tzst:0xc000769600 xz:0xc000769620 zip:0xc000769630 zst:0xc000769628] Getters:map[file:0xc0009371c0 http:0xc

0008bcf50 https:0xc0008bcfa0] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: read tcp 10.154.0.3:46716->151.101.193.55:443: read: connection reset by peer

	W0621 18:28:55.052979   30068 out.go:239] * 

	W0621 18:28:55.053829   30068 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0621 18:28:55.055312   30068 out.go:177] 

	==> CRI-O <==

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.743860579Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718995227743748936,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144981,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=8af28fe0-b229-48dd-b79c-48a0f0d9ebdc name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.744432360Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=4f04a5ea-0598-4577-8b97-c31948fd9f13 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.744495749Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=4f04a5ea-0598-4577-8b97-c31948fd9f13 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.744765521Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:252cb2f279857b80cfc6c701089f41991129c04b70abeb846b30882e2c665408,PodSandboxId:cd0fd4f6a3d6cd084d2f45842c8b800d5e90493d4ee1c849abc768254d7c6531,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718994540131727223,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-qvl48,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 59f123aa-60d0-4d29-b58e-cb9a43c26895,},Annotations:map[string]string{io.kubernetes.container.hash: a73416c9,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5a

f0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:17189944

58069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-h

a-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernete

s.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.kub

ernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=4f04a5ea-0598-4577-8b97-c31948fd9f13 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.785994365Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=c5330818-1905-409f-b9bb-a7f733555432 name=/runtime.v1.RuntimeService/Version

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.786082068Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=c5330818-1905-409f-b9bb-a7f733555432 name=/runtime.v1.RuntimeService/Version

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.787301681Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=e8603ca5-1e45-4742-b5e8-d4d0ef834c11 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.787721604Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718995227787698595,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144981,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=e8603ca5-1e45-4742-b5e8-d4d0ef834c11 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.788304567Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=82f6e793-7f70-4e16-88a0-db3bd744c216 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.788352828Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=82f6e793-7f70-4e16-88a0-db3bd744c216 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.788625939Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:252cb2f279857b80cfc6c701089f41991129c04b70abeb846b30882e2c665408,PodSandboxId:cd0fd4f6a3d6cd084d2f45842c8b800d5e90493d4ee1c849abc768254d7c6531,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718994540131727223,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-qvl48,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 59f123aa-60d0-4d29-b58e-cb9a43c26895,},Annotations:map[string]string{io.kubernetes.container.hash: a73416c9,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5a

f0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:17189944

58069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-h

a-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernete

s.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.kub

ernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=82f6e793-7f70-4e16-88a0-db3bd744c216 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.830551566Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=45cffa11-5784-4bb4-a701-fc424781d72e name=/runtime.v1.RuntimeService/Version

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.830635165Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=45cffa11-5784-4bb4-a701-fc424781d72e name=/runtime.v1.RuntimeService/Version

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.832552963Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=6037926d-240a-42fe-a5a4-b59cc5c2d8e0 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.833019320Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718995227832978068,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144981,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=6037926d-240a-42fe-a5a4-b59cc5c2d8e0 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.833602851Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=8b190fff-b2cb-4c6b-9a91-17c05bcaa300 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.833688896Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=8b190fff-b2cb-4c6b-9a91-17c05bcaa300 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.833937698Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:252cb2f279857b80cfc6c701089f41991129c04b70abeb846b30882e2c665408,PodSandboxId:cd0fd4f6a3d6cd084d2f45842c8b800d5e90493d4ee1c849abc768254d7c6531,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718994540131727223,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-qvl48,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 59f123aa-60d0-4d29-b58e-cb9a43c26895,},Annotations:map[string]string{io.kubernetes.container.hash: a73416c9,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5a

f0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:17189944

58069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-h

a-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernete

s.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.kub

ernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=8b190fff-b2cb-4c6b-9a91-17c05bcaa300 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.869592473Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=b0744e98-da48-4141-8d6a-f2c5a13cb128 name=/runtime.v1.RuntimeService/Version

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.869688460Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=b0744e98-da48-4141-8d6a-f2c5a13cb128 name=/runtime.v1.RuntimeService/Version

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.870779860Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=03e95be0-7bc6-43c8-8577-f3f2fbd78014 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.871278264Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1718995227871255317,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144981,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=03e95be0-7bc6-43c8-8577-f3f2fbd78014 name=/runtime.v1.ImageService/ImageFsInfo

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.871837058Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=3bbfc2ed-123f-4023-a4e4-47e279b584e0 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.871904854Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=3bbfc2ed-123f-4023-a4e4-47e279b584e0 name=/runtime.v1.RuntimeService/ListContainers

	Jun 21 18:40:27 ha-406291 crio[679]: time="2024-06-21 18:40:27.872196336Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:252cb2f279857b80cfc6c701089f41991129c04b70abeb846b30882e2c665408,PodSandboxId:cd0fd4f6a3d6cd084d2f45842c8b800d5e90493d4ee1c849abc768254d7c6531,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1718994540131727223,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-qvl48,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: 59f123aa-60d0-4d29-b58e-cb9a43c26895,},Annotations:map[string]string{io.kubernetes.container.hash: a73416c9,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25,PodSandboxId:59eb38b2794b02c40a970ef9379dae06b25af94b5b9c194af2f39044b8a80656,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459904595458,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-7ng4v,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 4724701c-6f0e-45ed-8fc7-70245d4fa569,},Annotations:map[string]string{io.kubernetes.container.hash: e9dc2233,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"

UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b,PodSandboxId:ab6a16146209c5cb5382869ac23a5b1456a089779d4f9301d3e0fade484313e5,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1718994459852756179,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.

kubernetes.pod.uid: f6a39ae0-87ac-492a-a711-290e61bb895e,},Annotations:map[string]string{io.kubernetes.container.hash: a13b39bf,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c,PodSandboxId:a68caa8578d30bee67d56155e9bfeab46712a74a991014cd43e82838bc7efe53,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1718994459870343273,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-nx5xs,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 375157ef-5a

f0-41b9-8ed9-162e5a88c679,},Annotations:map[string]string{io.kubernetes.container.hash: 611f455d,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d,PodSandboxId:956df8749e8db350cdcc534087f3bb7a212c6c1f51d1bebed27aa09a6dd443dc,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f,State:CONTAINER_RUNNING,CreatedAt:17189944

58069897639,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-vnds7,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: e921d86f-0ac3-413e-9e85-e809139ca210,},Annotations:map[string]string{io.kubernetes.container.hash: af35f4f0,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547,PodSandboxId:ab9fd8c2e0094b5d6ce1c56611c8348bf3599083d6753208e1cd8d061915718f,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772,State:CONTAINER_RUNNING,CreatedAt:1718994457887540977,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-xnbqj,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 11acb4f0-c5e7-4ec5-9d5e-3f470b9d5073,},Annotations:map[string]string{io.kubernetes.container.hash: 3fa78979,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:96a229fabb5aa95dea40a5ecf086bd5fb8e221098bc541613e955733ebb84631,PodSandboxId:79ad95611cf2281c2deb0a5f369eb5271fac76b4211a8efb382176679a1375b7,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:38af8ddebf499adc4631fe68b0ee224ffd6d7dd6b4aeeb393aff3d33cb94eb12,State:CONTAINER_RUNNING,CreatedAt:1718994441017516435,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 29bf44d365a415a68be28c9aad205c23,},Annotations:map[string]string{io.kubernetes.container.hash: 3d55e6dc,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d,PodSandboxId:7cae0fc993f3aa93f18dad7bcd353300f3d92cfd00fe954be039f37ab9945d4f,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940,State:CONTAINER_RUNNING,CreatedAt:1718994438148424764,Labels:map[string]string{io.kubernetes.container.name: kub

e-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 81efe8b097b0aaeaaac87f9a6e2dfe3b,},Annotations:map[string]string{io.kubernetes.container.hash: 838e9a2,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8,PodSandboxId:afce4542ea7ca97dbc94a8c737e508240bc331708d52d0f5801605c58d16744e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1718994438095663243,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kubernetes.pod.name: etcd-h

a-406291,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 28eb1f9a7974972f95837a71475ffe97,},Annotations:map[string]string{io.kubernetes.container.hash: 215bce33,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3,PodSandboxId:9552de7a0cb739fa78a45784d863f051a1c1cfcec5c2987dd50bdc33fee99320,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe,State:CONTAINER_RUNNING,CreatedAt:1718994438069298161,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-ha-406291,io.kubernete

s.pod.namespace: kube-system,io.kubernetes.pod.uid: ac2d2e5dadb6d48084ee46b3119245c5,},Annotations:map[string]string{io.kubernetes.container.hash: a9ba7dea,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31,PodSandboxId:2b8837f8e36da673b833225d75047e1a783e42de659e1ca0f1595eba13f2a075,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974,State:CONTAINER_RUNNING,CreatedAt:1718994438003779700,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-manager-ha-406291,io.kub

ernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 8bd582f38b9812a77200f468c3cf9c0d,},Annotations:map[string]string{io.kubernetes.container.hash: 7bcc7ce4,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=3bbfc2ed-123f-4023-a4e4-47e279b584e0 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	252cb2f279857       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   11 minutes ago      Running             busybox                   0                   cd0fd4f6a3d6c       busybox-fc5497c4f-qvl48

	6d732e2622f11       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      12 minutes ago      Running             coredns                   0                   59eb38b2794b0       coredns-7db6d8ff4d-7ng4v

	6088ccc5ec4be       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      12 minutes ago      Running             coredns                   0                   a68caa8578d30       coredns-7db6d8ff4d-nx5xs

	9d0ad73531279       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      12 minutes ago      Running             storage-provisioner       0                   ab6a16146209c       storage-provisioner

	468b13f5a8054       ac1c61439df4625ba53a9ceaccb5eb07a830bdf942cc1c60535a4dd7e763d55f                                      12 minutes ago      Running             kindnet-cni               0                   956df8749e8db       kindnet-vnds7

	e41f8891c5177       53c535741fb446f6b34d720fdc5748db368ef96771111f3892682e6eab8f3772                                      12 minutes ago      Running             kube-proxy                0                   ab9fd8c2e0094       kube-proxy-xnbqj

	96a229fabb5aa       ghcr.io/kube-vip/kube-vip@sha256:360f0c5d02322075cc80edb9e4e0d2171e941e55072184f1f902203fafc81d0f     13 minutes ago      Running             kube-vip                  0                   79ad95611cf22       kube-vip-ha-406291

	a143e6000662a       7820c83aa139453522e9028341d0d4f23ca2721ec80c7a47425446d11157b940                                      13 minutes ago      Running             kube-scheduler            0                   7cae0fc993f3a       kube-scheduler-ha-406291

	89b399d67fa40       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      13 minutes ago      Running             etcd                      0                   afce4542ea7ca       etcd-ha-406291

	2d71c6ae5cee5       56ce0fd9fb532bcb552ddbdbe3064189ce823a71693d97ff7a0a7a4ff6bffbbe                                      13 minutes ago      Running             kube-apiserver            0                   9552de7a0cb73       kube-apiserver-ha-406291

	3fbe446b39e8d       e874818b3caac34f68704eb96bf248d0c8116b1262ab549d45d39dd3dd775974                                      13 minutes ago      Running             kube-controller-manager   0                   2b8837f8e36da       kube-controller-manager-ha-406291

	==> coredns [6088ccc5ec4be753f7a30542686c05bbcc3444300a99daa40b0bb5bd7ea37c3c] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c

	CoreDNS-1.11.1

	linux/amd64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:57758 - 16030 "HINFO IN 938012208132191314.8379741084222464033. udp 56 false 512" NXDOMAIN qr,rd,ra 56 0.014128651s

	[INFO] 10.244.0.4:60864 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000870211s

	[INFO] 10.244.0.4:49527 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.00014553s

	[INFO] 10.244.0.4:59987 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000181145s

	[INFO] 10.244.0.4:59378 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.009664502s

	[INFO] 10.244.0.4:59188 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000181625s

	[INFO] 10.244.0.4:33100 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000137671s

	[INFO] 10.244.0.4:43551 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000129631s

	[INFO] 10.244.0.4:59759 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000152418s

	[INFO] 10.244.0.4:60292 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090372s

	==> coredns [6d732e2622f11e5a01de01fc8103ee96383981edc2d6e18b40f0d42178986a25] <==

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c

	CoreDNS-1.11.1

	linux/amd64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:45911 - 30730 "HINFO IN 2397840142540691982.2649863782968500509. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.014966559s

	[INFO] 10.244.0.4:38404 - 3 "AAAA IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 31 0.013105268s

	[INFO] 10.244.0.4:49299 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,rd,ra 60 0.225770527s

	[INFO] 10.244.0.4:41342 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.010990835s

	[INFO] 10.244.0.4:55838 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003903098s

	[INFO] 10.244.0.4:59078 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000163236s

	[INFO] 10.244.0.4:39541 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000147137s

	[INFO] 10.244.0.4:47420 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000120366s

	==> describe nodes <==

	Name:               ha-406291

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-406291

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=1a0d377c34faa85740cf2404ea12566198300600

	                    minikube.k8s.io/name=ha-406291

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_06_21T18_27_25_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Fri, 21 Jun 2024 18:27:23 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-406291

	  AcquireTime:     <unset>

	  RenewTime:       Fri, 21 Jun 2024 18:40:19 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Fri, 21 Jun 2024 18:39:39 +0000   Fri, 21 Jun 2024 18:27:23 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Fri, 21 Jun 2024 18:39:39 +0000   Fri, 21 Jun 2024 18:27:23 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Fri, 21 Jun 2024 18:39:39 +0000   Fri, 21 Jun 2024 18:27:23 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Fri, 21 Jun 2024 18:39:39 +0000   Fri, 21 Jun 2024 18:27:39 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.198

	  Hostname:    ha-406291

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 10b5f2f4e64d426eb3a71e7a23c0cea5

	  System UUID:                10b5f2f4-e64d-426e-b3a7-1e7a23c0cea5

	  Boot ID:                    10778ad9-ed13-4749-a084-25b2b2bfde76

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.2

	  Kube-Proxy Version:         v1.30.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-qvl48              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	  kube-system                 coredns-7db6d8ff4d-7ng4v             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     12m

	  kube-system                 coredns-7db6d8ff4d-nx5xs             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     12m

	  kube-system                 etcd-ha-406291                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         13m

	  kube-system                 kindnet-vnds7                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      12m

	  kube-system                 kube-apiserver-ha-406291             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m

	  kube-system                 kube-controller-manager-ha-406291    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m

	  kube-system                 kube-proxy-xnbqj                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	  kube-system                 kube-scheduler-ha-406291             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m

	  kube-system                 kube-vip-ha-406291                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         13m

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         12m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age   From             Message

	  ----    ------                   ----  ----             -------

	  Normal  Starting                 12m   kube-proxy       

	  Normal  Starting                 13m   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  13m   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  13m   kubelet          Node ha-406291 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    13m   kubelet          Node ha-406291 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     13m   kubelet          Node ha-406291 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           12m   node-controller  Node ha-406291 event: Registered Node ha-406291 in Controller

	  Normal  NodeReady                12m   kubelet          Node ha-406291 status is now: NodeReady

	==> dmesg <==

	[Jun21 18:26] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.051748] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.037330] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.458081] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.725935] systemd-fstab-generator[115]: Ignoring "noauto" option for root device

	[  +4.855560] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000006] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[Jun21 18:27] systemd-fstab-generator[596]: Ignoring "noauto" option for root device

	[  +0.057394] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.056681] systemd-fstab-generator[608]: Ignoring "noauto" option for root device

	[  +0.167604] systemd-fstab-generator[622]: Ignoring "noauto" option for root device

	[  +0.147792] systemd-fstab-generator[634]: Ignoring "noauto" option for root device

	[  +0.253886] systemd-fstab-generator[664]: Ignoring "noauto" option for root device

	[  +3.905184] systemd-fstab-generator[763]: Ignoring "noauto" option for root device

	[  +4.549385] systemd-fstab-generator[943]: Ignoring "noauto" option for root device

	[  +0.060073] kauditd_printk_skb: 158 callbacks suppressed

	[  +7.066237] systemd-fstab-generator[1360]: Ignoring "noauto" option for root device

	[  +0.078680] kauditd_printk_skb: 79 callbacks suppressed

	[ +13.552032] kauditd_printk_skb: 21 callbacks suppressed

	[Jun21 18:28] kauditd_printk_skb: 74 callbacks suppressed

	==> etcd [89b399d67fa40e16a03cabb28dca7a07826900a21f9e90b9b9b97676b58e79f8] <==

	{"level":"info","ts":"2024-06-21T18:27:18.512305Z","caller":"embed/etcd.go:569","msg":"cmux::serve","address":"192.168.39.198:2380"}

	{"level":"info","ts":"2024-06-21T18:27:18.939239Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 is starting a new election at term 1"}

	{"level":"info","ts":"2024-06-21T18:27:18.93929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 became pre-candidate at term 1"}

	{"level":"info","ts":"2024-06-21T18:27:18.93932Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 received MsgPreVoteResp from f1d2ab5330a2a0e3 at term 1"}

	{"level":"info","ts":"2024-06-21T18:27:18.939332Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 became candidate at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.939339Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 received MsgVoteResp from f1d2ab5330a2a0e3 at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.939349Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"f1d2ab5330a2a0e3 became leader at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.93936Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"raft.node: f1d2ab5330a2a0e3 elected leader f1d2ab5330a2a0e3 at term 2"}

	{"level":"info","ts":"2024-06-21T18:27:18.949394Z","caller":"etcdserver/server.go:2578","msg":"setting up initial cluster version using v2 API","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.951989Z","caller":"etcdserver/server.go:2068","msg":"published local member to cluster through raft","local-member-id":"f1d2ab5330a2a0e3","local-member-attributes":"{Name:ha-406291 ClientURLs:[https://192.168.39.198:2379]}","request-path":"/0/members/f1d2ab5330a2a0e3/attributes","cluster-id":"9fb372ad12afeb1b","publish-timeout":"7s"}

	{"level":"info","ts":"2024-06-21T18:27:18.952029Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-06-21T18:27:18.952218Z","caller":"embed/serve.go:103","msg":"ready to serve client requests"}

	{"level":"info","ts":"2024-06-21T18:27:18.966375Z","caller":"membership/cluster.go:584","msg":"set initial cluster version","cluster-id":"9fb372ad12afeb1b","local-member-id":"f1d2ab5330a2a0e3","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.966532Z","caller":"api/capability.go:75","msg":"enabled capabilities for version","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.966591Z","caller":"etcdserver/server.go:2602","msg":"cluster version is updated","cluster-version":"3.5"}

	{"level":"info","ts":"2024-06-21T18:27:18.968078Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"192.168.39.198:2379"}

	{"level":"info","ts":"2024-06-21T18:27:18.969834Z","caller":"embed/serve.go:250","msg":"serving client traffic securely","traffic":"grpc+http","address":"127.0.0.1:2379"}

	{"level":"info","ts":"2024-06-21T18:27:18.973596Z","caller":"etcdmain/main.go:44","msg":"notifying init daemon"}

	{"level":"info","ts":"2024-06-21T18:27:18.986355Z","caller":"etcdmain/main.go:50","msg":"successfully notified init daemon"}

	{"level":"info","ts":"2024-06-21T18:27:37.357719Z","caller":"traceutil/trace.go:171","msg":"trace[571743030] transaction","detail":"{read_only:false; response_revision:348; number_of_response:1; }","duration":"105.067279ms","start":"2024-06-21T18:27:37.252598Z","end":"2024-06-21T18:27:37.357665Z","steps":["trace[571743030] 'process raft request'  (duration: 48.775466ms)","trace[571743030] 'compare'  (duration: 56.093787ms)"],"step_count":2}

	{"level":"warn","ts":"2024-06-21T18:28:12.689426Z","caller":"etcdserver/util.go:170","msg":"apply request took too long","took":"125.176174ms","expected-duration":"100ms","prefix":"","request":"header:<ID:11593268453381319053 username:\"kube-apiserver-etcd-client\" auth_revision:1 > txn:<compare:<target:MOD key:\"/registry/leases/kube-system/plndr-cp-lock\" mod_revision:496 > success:<request_put:<key:\"/registry/leases/kube-system/plndr-cp-lock\" value_size:369 >> failure:<request_range:<key:\"/registry/leases/kube-system/plndr-cp-lock\" > >>","response":"size:16"}

	{"level":"info","ts":"2024-06-21T18:28:12.689586Z","caller":"traceutil/trace.go:171","msg":"trace[939483523] transaction","detail":"{read_only:false; response_revision:499; number_of_response:1; }","duration":"172.541349ms","start":"2024-06-21T18:28:12.517021Z","end":"2024-06-21T18:28:12.689563Z","steps":["trace[939483523] 'process raft request'  (duration: 46.605278ms)","trace[939483523] 'compare'  (duration: 124.988397ms)"],"step_count":2}

	{"level":"info","ts":"2024-06-21T18:37:19.55118Z","caller":"mvcc/index.go:214","msg":"compact tree index","revision":969}

	{"level":"info","ts":"2024-06-21T18:37:19.562898Z","caller":"mvcc/kvstore_compaction.go:68","msg":"finished scheduled compaction","compact-revision":969,"took":"11.353931ms","hash":518064132,"current-db-size-bytes":2441216,"current-db-size":"2.4 MB","current-db-size-in-use-bytes":2441216,"current-db-size-in-use":"2.4 MB"}

	{"level":"info","ts":"2024-06-21T18:37:19.562955Z","caller":"mvcc/hash.go:137","msg":"storing new hash","hash":518064132,"revision":969,"compact-revision":-1}

	==> kernel <==

	 18:40:28 up 13 min,  0 users,  load average: 0.14, 0.18, 0.11

	Linux ha-406291 5.10.207 #1 SMP Fri Jun 21 03:52:19 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [468b13f5a8054a45b113ccc4b53701029f1d0b42ffdac760ce2de5642cce055d] <==

	I0621 18:38:19.456643       1 main.go:227] handling current node

	I0621 18:38:29.460573       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:38:29.460617       1 main.go:227] handling current node

	I0621 18:38:39.464813       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:38:39.464932       1 main.go:227] handling current node

	I0621 18:38:49.476962       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:38:49.477180       1 main.go:227] handling current node

	I0621 18:38:59.489837       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:38:59.489986       1 main.go:227] handling current node

	I0621 18:39:09.501218       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:39:09.501252       1 main.go:227] handling current node

	I0621 18:39:19.504588       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:39:19.504638       1 main.go:227] handling current node

	I0621 18:39:29.510970       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:39:29.511181       1 main.go:227] handling current node

	I0621 18:39:39.514989       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:39:39.515025       1 main.go:227] handling current node

	I0621 18:39:49.520764       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:39:49.520908       1 main.go:227] handling current node

	I0621 18:39:59.524302       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:39:59.524430       1 main.go:227] handling current node

	I0621 18:40:09.536871       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:40:09.536951       1 main.go:227] handling current node

	I0621 18:40:19.546045       1 main.go:223] Handling node with IPs: map[192.168.39.198:{}]

	I0621 18:40:19.546228       1 main.go:227] handling current node

	==> kube-apiserver [2d71c6ae5cee5f15a281850849c500184f8adb3ab533c12e4f88c9c4139ca6b3] <==

	I0621 18:27:21.223679       1 cache.go:39] Caches are synced for autoregister controller

	I0621 18:27:21.228827       1 shared_informer.go:320] Caches are synced for node_authorizer

	I0621 18:27:21.231033       1 shared_informer.go:320] Caches are synced for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0621 18:27:21.231057       1 policy_source.go:224] refreshing policies

	E0621 18:27:21.244004       1 controller.go:145] while syncing ConfigMap "kube-system/kube-apiserver-legacy-service-account-token-tracking", err: namespaces "kube-system" not found

	I0621 18:27:21.291900       1 controller.go:615] quota admission added evaluator for: namespaces

	I0621 18:27:21.301249       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0621 18:27:22.093764       1 storage_scheduling.go:95] created PriorityClass system-node-critical with value 2000001000

	I0621 18:27:22.100226       1 storage_scheduling.go:95] created PriorityClass system-cluster-critical with value 2000000000

	I0621 18:27:22.100345       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	I0621 18:27:22.679124       1 controller.go:615] quota admission added evaluator for: roles.rbac.authorization.k8s.io

	I0621 18:27:22.717908       1 controller.go:615] quota admission added evaluator for: rolebindings.rbac.authorization.k8s.io

	I0621 18:27:22.803597       1 alloc.go:330] "allocated clusterIPs" service="default/kubernetes" clusterIPs={"IPv4":"10.96.0.1"}

	W0621 18:27:22.812663       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.198]

	I0621 18:27:22.813674       1 controller.go:615] quota admission added evaluator for: endpoints

	I0621 18:27:22.817676       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	I0621 18:27:23.142771       1 controller.go:615] quota admission added evaluator for: serviceaccounts

	I0621 18:27:24.323202       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0621 18:27:24.338622       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0621 18:27:24.532806       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0621 18:27:36.921775       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0621 18:27:37.247444       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	E0621 18:40:26.217258       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:52318: use of closed network connection

	E0621 18:40:26.646809       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:52394: use of closed network connection

	E0621 18:40:27.039177       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:52460: use of closed network connection

	==> kube-controller-manager [3fbe446b39e8d30d0239ea55bcafc834021c44bf94d6c5a9d183fcce5cd16a31] <==

	I0621 18:27:36.996032       1 shared_informer.go:320] Caches are synced for cronjob

	I0621 18:27:36.997228       1 shared_informer.go:320] Caches are synced for stateful set

	I0621 18:27:37.047455       1 shared_informer.go:320] Caches are synced for resource quota

	I0621 18:27:37.059247       1 shared_informer.go:320] Caches are synced for resource quota

	I0621 18:27:37.506333       1 shared_informer.go:320] Caches are synced for garbage collector

	I0621 18:27:37.559310       1 shared_informer.go:320] Caches are synced for garbage collector

	I0621 18:27:37.559392       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0621 18:27:37.600276       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="666.508123ms"

	I0621 18:27:37.660728       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="60.34673ms"

	I0621 18:27:37.660938       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="161.085µs"

	I0621 18:27:39.328050       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="55.475µs"

	I0621 18:27:39.330983       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="71.725µs"

	I0621 18:27:39.352409       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="52.246µs"

	I0621 18:27:39.366116       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="60.163µs"

	I0621 18:27:40.575618       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="65.679µs"

	I0621 18:27:40.612176       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="13.937752ms"

	I0621 18:27:40.612598       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="77.232µs"

	I0621 18:27:40.634931       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="14.444693ms"

	I0621 18:27:40.635035       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="51.847µs"

	I0621 18:27:41.885215       1 node_lifecycle_controller.go:1050] "Controller detected that some Nodes are Ready. Exiting master disruption mode" logger="node-lifecycle-controller"

	I0621 18:28:57.137627       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="53.563277ms"

	I0621 18:28:57.164070       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="26.375749ms"

	I0621 18:28:57.164194       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="82.743µs"

	I0621 18:29:00.876863       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="13.452577ms"

	I0621 18:29:00.877083       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="74.932µs"

	==> kube-proxy [e41f8891c51779bf0c1b5871299816d7810f90994a6c83d827d63e437b61d547] <==

	I0621 18:27:38.126736       1 server_linux.go:69] "Using iptables proxy"

	I0621 18:27:38.143236       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.198"]

	I0621 18:27:38.177576       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0621 18:27:38.177626       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0621 18:27:38.177644       1 server_linux.go:165] "Using iptables Proxier"

	I0621 18:27:38.180797       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0621 18:27:38.181002       1 server.go:872] "Version info" version="v1.30.2"

	I0621 18:27:38.181026       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0621 18:27:38.182882       1 config.go:192] "Starting service config controller"

	I0621 18:27:38.183195       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0621 18:27:38.183262       1 config.go:101] "Starting endpoint slice config controller"

	I0621 18:27:38.183278       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0621 18:27:38.184787       1 config.go:319] "Starting node config controller"

	I0621 18:27:38.184819       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0621 18:27:38.283818       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0621 18:27:38.283839       1 shared_informer.go:320] Caches are synced for service config

	I0621 18:27:38.285303       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [a143e6000662ad186e45d6f035abc485373adbc71e6aa228c57cf9ec40199d3d] <==

	W0621 18:27:21.175406       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0621 18:27:21.176948       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0621 18:27:21.176960       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0621 18:27:21.176992       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0621 18:27:21.177025       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:21.177056       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0621 18:27:21.177088       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes is forbidden: User "system:kube-scheduler" cannot list resource "nodes" in API group "" at the cluster scope

	E0621 18:27:21.177120       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: persistentvolumes is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumes" in API group "" at the cluster scope

	E0621 18:27:21.177197       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0621 18:27:21.177204       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:21.177229       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:21.177266       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0621 18:27:22.041765       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:22.041824       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	W0621 18:27:22.144830       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0621 18:27:22.144881       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0621 18:27:22.217224       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0621 18:27:22.217266       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0621 18:27:22.256407       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0621 18:27:22.256450       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0621 18:27:22.361486       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0621 18:27:22.361536       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0621 18:27:22.366073       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	E0621 18:27:22.366190       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: poddisruptionbudgets.policy is forbidden: User "system:kube-scheduler" cannot list resource "poddisruptionbudgets" in API group "policy" at the cluster scope

	I0621 18:27:25.267361       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Jun 21 18:36:24 ha-406291 kubelet[1367]: E0621 18:36:24.482853    1367 iptables.go:577] "Could not set up iptables canary" err=<

	Jun 21 18:36:24 ha-406291 kubelet[1367]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jun 21 18:36:24 ha-406291 kubelet[1367]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jun 21 18:36:24 ha-406291 kubelet[1367]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jun 21 18:36:24 ha-406291 kubelet[1367]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Jun 21 18:37:24 ha-406291 kubelet[1367]: E0621 18:37:24.483671    1367 iptables.go:577] "Could not set up iptables canary" err=<

	Jun 21 18:37:24 ha-406291 kubelet[1367]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jun 21 18:37:24 ha-406291 kubelet[1367]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jun 21 18:37:24 ha-406291 kubelet[1367]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jun 21 18:37:24 ha-406291 kubelet[1367]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Jun 21 18:38:24 ha-406291 kubelet[1367]: E0621 18:38:24.483473    1367 iptables.go:577] "Could not set up iptables canary" err=<

	Jun 21 18:38:24 ha-406291 kubelet[1367]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jun 21 18:38:24 ha-406291 kubelet[1367]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jun 21 18:38:24 ha-406291 kubelet[1367]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jun 21 18:38:24 ha-406291 kubelet[1367]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Jun 21 18:39:24 ha-406291 kubelet[1367]: E0621 18:39:24.484210    1367 iptables.go:577] "Could not set up iptables canary" err=<

	Jun 21 18:39:24 ha-406291 kubelet[1367]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jun 21 18:39:24 ha-406291 kubelet[1367]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jun 21 18:39:24 ha-406291 kubelet[1367]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jun 21 18:39:24 ha-406291 kubelet[1367]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Jun 21 18:40:24 ha-406291 kubelet[1367]: E0621 18:40:24.483552    1367 iptables.go:577] "Could not set up iptables canary" err=<

	Jun 21 18:40:24 ha-406291 kubelet[1367]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jun 21 18:40:24 ha-406291 kubelet[1367]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jun 21 18:40:24 ha-406291 kubelet[1367]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jun 21 18:40:24 ha-406291 kubelet[1367]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	==> storage-provisioner [9d0ad7353127926e3c79ac7b2068cd6d5b94beefb6c266ccac1b3b567113024b] <==

	I0621 18:27:40.053572       1 storage_provisioner.go:116] Initializing the minikube storage provisioner...

	I0621 18:27:40.071388       1 storage_provisioner.go:141] Storage provisioner initialized, now starting service!

	I0621 18:27:40.071477       1 leaderelection.go:243] attempting to acquire leader lease kube-system/k8s.io-minikube-hostpath...

	I0621 18:27:40.092555       1 leaderelection.go:253] successfully acquired lease kube-system/k8s.io-minikube-hostpath

	I0621 18:27:40.093079       1 controller.go:835] Starting provisioner controller k8s.io/minikube-hostpath_ha-406291_9408dd1b-5b4e-4652-aac5-9de4270d5daf!

	I0621 18:27:40.092824       1 event.go:282] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"k8s.io-minikube-hostpath", UID:"3a538f5e-15b2-4fb1-aabe-7ae7b744ce8d", APIVersion:"v1", ResourceVersion:"421", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' ha-406291_9408dd1b-5b4e-4652-aac5-9de4270d5daf became leader

	I0621 18:27:40.194107       1 controller.go:884] Started provisioner controller k8s.io/minikube-hostpath_ha-406291_9408dd1b-5b4e-4652-aac5-9de4270d5daf!

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-406291 -n ha-406291

helpers_test.go:261: (dbg) Run:  kubectl --context ha-406291 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:272: non-running pods: busybox-fc5497c4f-drm4v busybox-fc5497c4f-p2c87

helpers_test.go:274: ======> post-mortem[TestMultiControlPlane/serial/DeployApp]: describe non-running pods <======

helpers_test.go:277: (dbg) Run:  kubectl --context ha-406291 describe pod busybox-fc5497c4f-drm4v busybox-fc5497c4f-p2c87

helpers_test.go:282: (dbg) kubectl --context ha-406291 describe pod busybox-fc5497c4f-drm4v busybox-fc5497c4f-p2c87:

-- stdout --

	Name:             busybox-fc5497c4f-drm4v

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             <none>

	Labels:           app=busybox

	                  pod-template-hash=fc5497c4f

	Annotations:      <none>

	Status:           Pending

	IP:               

	IPs:              <none>

	Controlled By:    ReplicaSet/busybox-fc5497c4f

	Containers:

	  busybox:

	    Image:      gcr.io/k8s-minikube/busybox:1.28

	    Port:       <none>

	    Host Port:  <none>

	    Command:

	      sleep

	      3600

	    Environment:  <none>

	    Mounts:

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-82b4g (ro)

	Conditions:

	  Type           Status

	  PodScheduled   False 

	Volumes:

	  kube-api-access-82b4g:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason            Age                From               Message

	  ----     ------            ----               ----               -------

	  Warning  FailedScheduling  65s (x3 over 11m)  default-scheduler  0/1 nodes are available: 1 node(s) didn't match pod anti-affinity rules. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod.

	Name:             busybox-fc5497c4f-p2c87

	Namespace:        default

	Priority:         0

	Service Account:  default

	Node:             <none>

	Labels:           app=busybox

	                  pod-template-hash=fc5497c4f

	Annotations:      <none>

	Status:           Pending

	IP:               

	IPs:              <none>

	Controlled By:    ReplicaSet/busybox-fc5497c4f

	Containers:

	  busybox:

	    Image:      gcr.io/k8s-minikube/busybox:1.28

	    Port:       <none>

	    Host Port:  <none>

	    Command:

	      sleep

	      3600

	    Environment:  <none>

	    Mounts:

	      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-q8tzk (ro)

	Conditions:

	  Type           Status

	  PodScheduled   False 

	Volumes:

	  kube-api-access-q8tzk:

	    Type:                    Projected (a volume that contains injected data from multiple sources)

	    TokenExpirationSeconds:  3607

	    ConfigMapName:           kube-root-ca.crt

	    ConfigMapOptional:       <nil>

	    DownwardAPI:             true

	QoS Class:                   BestEffort

	Node-Selectors:              <none>

	Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s

	                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s

	Events:

	  Type     Reason            Age                From               Message

	  ----     ------            ----               ----               -------

	  Warning  FailedScheduling  65s (x3 over 11m)  default-scheduler  0/1 nodes are available: 1 node(s) didn't match pod anti-affinity rules. preemption: 0/1 nodes are available: 1 No preemption victims found for incoming pod.

-- /stdout --

helpers_test.go:285: <<< TestMultiControlPlane/serial/DeployApp FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/DeployApp (692.08s)