=== RUN   TestAddons/Setup

addons_test.go:109: (dbg) Run:  out/minikube-linux-amd64 start -p addons-221213 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller

addons_test.go:109: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p addons-221213 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller: signal: killed (39m59.93330849s)

-- stdout --

	* [addons-221213] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=18665

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/18665-75973/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/18665-75973/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on user configuration

	* Starting "addons-221213" primary control-plane node in "addons-221213" cluster

	* Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	* Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	  - Generating certificates and keys ...

	  - Booting up control plane ...

	  - Configuring RBAC rules ...

	* Configuring bridge CNI (Container Networking Interface) ...

	* Verifying Kubernetes components...

	  - Using image docker.io/marcnuri/yakd:0.0.4

	  - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	  - Using image ghcr.io/helm/tiller:v2.17.0

	  - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.15

	  - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	  - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	  - Using image docker.io/registry:2.8.3

	  - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	  - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	  - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	  - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	  - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	  - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	  - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.27.0

	  - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	  - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	  - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.5

	  - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	  - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image docker.io/busybox:stable

	  - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	* To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-221213 service yakd-dashboard -n yakd-dashboard

	* Verifying ingress addon...

	* Verifying registry addon...

	  - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	  - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	* Verifying csi-hostpath-driver addon...

	* Verifying gcp-auth addon...

	* Your GCP credentials will now be mounted into every pod created in the addons-221213 cluster.

	* If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	* If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	* Enabled addons: ingress-dns, default-storageclass, cloud-spanner, metrics-server, nvidia-device-plugin, storage-provisioner, helm-tiller, yakd, inspektor-gadget, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

-- /stdout --

** stderr ** 

	I0417 17:59:14.089515   83763 out.go:291] Setting OutFile to fd 1 ...

	I0417 17:59:14.089781   83763 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 17:59:14.089792   83763 out.go:304] Setting ErrFile to fd 2...

	I0417 17:59:14.089798   83763 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 17:59:14.089990   83763 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 17:59:14.090657   83763 out.go:298] Setting JSON to false

	I0417 17:59:14.091529   83763 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":6102,"bootTime":1713370652,"procs":175,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0417 17:59:14.091597   83763 start.go:139] virtualization: kvm guest

	I0417 17:59:14.094178   83763 out.go:177] * [addons-221213] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)

	I0417 17:59:14.095864   83763 notify.go:220] Checking for updates...

	I0417 17:59:14.095896   83763 out.go:177]   - MINIKUBE_LOCATION=18665

	I0417 17:59:14.097372   83763 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0417 17:59:14.098730   83763 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 17:59:14.100028   83763 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 17:59:14.101338   83763 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0417 17:59:14.102722   83763 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0417 17:59:14.104451   83763 driver.go:392] Setting default libvirt URI to qemu:///system

	I0417 17:59:14.136204   83763 out.go:177] * Using the kvm2 driver based on user configuration

	I0417 17:59:14.137528   83763 start.go:297] selected driver: kvm2

	I0417 17:59:14.137542   83763 start.go:901] validating driver "kvm2" against <nil>

	I0417 17:59:14.137553   83763 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0417 17:59:14.138260   83763 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0417 17:59:14.138328   83763 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18665-75973/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0417 17:59:14.152845   83763 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0

	I0417 17:59:14.152896   83763 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0417 17:59:14.153105   83763 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0417 17:59:14.153175   83763 cni.go:84] Creating CNI manager for ""

	I0417 17:59:14.153187   83763 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0417 17:59:14.153194   83763 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni

	I0417 17:59:14.153253   83763 start.go:340] cluster config:

	{Name:addons-221213 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2 ClusterName:addons-221213 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunt

ime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthS

ock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 17:59:14.153363   83763 iso.go:125] acquiring lock: {Name:mkb4c46d9d11025607234f0b50f29e48600415ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0417 17:59:14.155919   83763 out.go:177] * Starting "addons-221213" primary control-plane node in "addons-221213" cluster

	I0417 17:59:14.157184   83763 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 17:59:14.157225   83763 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4

	I0417 17:59:14.157235   83763 cache.go:56] Caching tarball of preloaded images

	I0417 17:59:14.157323   83763 preload.go:173] Found /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0417 17:59:14.157337   83763 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0-rc.2 on crio

	I0417 17:59:14.157618   83763 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/config.json ...

	I0417 17:59:14.157639   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/config.json: {Name:mk2c661e0c0a474805582b4dea8dc7799593c15d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:14.157791   83763 start.go:360] acquireMachinesLock for addons-221213: {Name:mk477aec4c276e4d91f705836ed4842912dfe2c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0417 17:59:14.157855   83763 start.go:364] duration metric: took 43.171µs to acquireMachinesLock for "addons-221213"

	I0417 17:59:14.157880   83763 start.go:93] Provisioning new machine with config: &{Name:addons-221213 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber

netesVersion:v1.30.0-rc.2 ClusterName:addons-221213 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 17:59:14.157939   83763 start.go:125] createHost starting for "" (driver="kvm2")

	I0417 17:59:14.159575   83763 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

	I0417 17:59:14.159709   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 17:59:14.159759   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 17:59:14.174278   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43733

	I0417 17:59:14.174744   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 17:59:14.175375   83763 main.go:141] libmachine: Using API Version  1

	I0417 17:59:14.175394   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 17:59:14.175811   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 17:59:14.176024   83763 main.go:141] libmachine: (addons-221213) Calling .GetMachineName

	I0417 17:59:14.176180   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:14.176348   83763 start.go:159] libmachine.API.Create for "addons-221213" (driver="kvm2")

	I0417 17:59:14.176387   83763 client.go:168] LocalClient.Create starting

	I0417 17:59:14.176438   83763 main.go:141] libmachine: Creating CA: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem

	I0417 17:59:14.392820   83763 main.go:141] libmachine: Creating client certificate: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem

	I0417 17:59:14.543267   83763 main.go:141] libmachine: Running pre-create checks...

	I0417 17:59:14.543294   83763 main.go:141] libmachine: (addons-221213) Calling .PreCreateCheck

	I0417 17:59:14.543887   83763 main.go:141] libmachine: (addons-221213) Calling .GetConfigRaw

	I0417 17:59:14.544321   83763 main.go:141] libmachine: Creating machine...

	I0417 17:59:14.544338   83763 main.go:141] libmachine: (addons-221213) Calling .Create

	I0417 17:59:14.544472   83763 main.go:141] libmachine: (addons-221213) Creating KVM machine...

	I0417 17:59:14.545970   83763 main.go:141] libmachine: (addons-221213) DBG | found existing default KVM network

	I0417 17:59:14.546750   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:14.546569   83785 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ad0}

	I0417 17:59:14.546777   83763 main.go:141] libmachine: (addons-221213) DBG | created network xml: 

	I0417 17:59:14.546801   83763 main.go:141] libmachine: (addons-221213) DBG | <network>

	I0417 17:59:14.546815   83763 main.go:141] libmachine: (addons-221213) DBG |   <name>mk-addons-221213</name>

	I0417 17:59:14.546825   83763 main.go:141] libmachine: (addons-221213) DBG |   <dns enable='no'/>

	I0417 17:59:14.546835   83763 main.go:141] libmachine: (addons-221213) DBG |   

	I0417 17:59:14.546847   83763 main.go:141] libmachine: (addons-221213) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0417 17:59:14.546861   83763 main.go:141] libmachine: (addons-221213) DBG |     <dhcp>

	I0417 17:59:14.546894   83763 main.go:141] libmachine: (addons-221213) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0417 17:59:14.546919   83763 main.go:141] libmachine: (addons-221213) DBG |     </dhcp>

	I0417 17:59:14.546930   83763 main.go:141] libmachine: (addons-221213) DBG |   </ip>

	I0417 17:59:14.546946   83763 main.go:141] libmachine: (addons-221213) DBG |   

	I0417 17:59:14.546959   83763 main.go:141] libmachine: (addons-221213) DBG | </network>

	I0417 17:59:14.546970   83763 main.go:141] libmachine: (addons-221213) DBG | 

	I0417 17:59:14.552053   83763 main.go:141] libmachine: (addons-221213) DBG | trying to create private KVM network mk-addons-221213 192.168.39.0/24...

	I0417 17:59:14.618149   83763 main.go:141] libmachine: (addons-221213) DBG | private KVM network mk-addons-221213 192.168.39.0/24 created

	I0417 17:59:14.618182   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:14.618086   83785 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 17:59:14.618214   83763 main.go:141] libmachine: (addons-221213) Setting up store path in /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213 ...

	I0417 17:59:14.618235   83763 main.go:141] libmachine: (addons-221213) Building disk image from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso

	I0417 17:59:14.618250   83763 main.go:141] libmachine: (addons-221213) Downloading /home/jenkins/minikube-integration/18665-75973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...

	I0417 17:59:14.853831   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:14.853714   83785 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa...

	I0417 17:59:15.194855   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:15.194692   83785 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/addons-221213.rawdisk...

	I0417 17:59:15.194895   83763 main.go:141] libmachine: (addons-221213) DBG | Writing magic tar header

	I0417 17:59:15.194907   83763 main.go:141] libmachine: (addons-221213) DBG | Writing SSH key tar header

	I0417 17:59:15.194915   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:15.194808   83785 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213 ...

	I0417 17:59:15.194926   83763 main.go:141] libmachine: (addons-221213) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213

	I0417 17:59:15.194933   83763 main.go:141] libmachine: (addons-221213) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines

	I0417 17:59:15.194941   83763 main.go:141] libmachine: (addons-221213) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213 (perms=drwx------)

	I0417 17:59:15.194948   83763 main.go:141] libmachine: (addons-221213) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 17:59:15.194959   83763 main.go:141] libmachine: (addons-221213) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973

	I0417 17:59:15.194968   83763 main.go:141] libmachine: (addons-221213) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines (perms=drwxr-xr-x)

	I0417 17:59:15.194975   83763 main.go:141] libmachine: (addons-221213) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube (perms=drwxr-xr-x)

	I0417 17:59:15.194985   83763 main.go:141] libmachine: (addons-221213) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973 (perms=drwxrwxr-x)

	I0417 17:59:15.194991   83763 main.go:141] libmachine: (addons-221213) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0417 17:59:15.194999   83763 main.go:141] libmachine: (addons-221213) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0417 17:59:15.195004   83763 main.go:141] libmachine: (addons-221213) Creating domain...

	I0417 17:59:15.195014   83763 main.go:141] libmachine: (addons-221213) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0417 17:59:15.195025   83763 main.go:141] libmachine: (addons-221213) DBG | Checking permissions on dir: /home/jenkins

	I0417 17:59:15.195031   83763 main.go:141] libmachine: (addons-221213) DBG | Checking permissions on dir: /home

	I0417 17:59:15.195040   83763 main.go:141] libmachine: (addons-221213) DBG | Skipping /home - not owner

	I0417 17:59:15.196213   83763 main.go:141] libmachine: (addons-221213) define libvirt domain using xml: 

	I0417 17:59:15.196243   83763 main.go:141] libmachine: (addons-221213) <domain type='kvm'>

	I0417 17:59:15.196255   83763 main.go:141] libmachine: (addons-221213)   <name>addons-221213</name>

	I0417 17:59:15.196271   83763 main.go:141] libmachine: (addons-221213)   <memory unit='MiB'>4000</memory>

	I0417 17:59:15.196282   83763 main.go:141] libmachine: (addons-221213)   <vcpu>2</vcpu>

	I0417 17:59:15.196290   83763 main.go:141] libmachine: (addons-221213)   <features>

	I0417 17:59:15.196300   83763 main.go:141] libmachine: (addons-221213)     <acpi/>

	I0417 17:59:15.196325   83763 main.go:141] libmachine: (addons-221213)     <apic/>

	I0417 17:59:15.196336   83763 main.go:141] libmachine: (addons-221213)     <pae/>

	I0417 17:59:15.196347   83763 main.go:141] libmachine: (addons-221213)     

	I0417 17:59:15.196381   83763 main.go:141] libmachine: (addons-221213)   </features>

	I0417 17:59:15.196410   83763 main.go:141] libmachine: (addons-221213)   <cpu mode='host-passthrough'>

	I0417 17:59:15.196423   83763 main.go:141] libmachine: (addons-221213)   

	I0417 17:59:15.196436   83763 main.go:141] libmachine: (addons-221213)   </cpu>

	I0417 17:59:15.196450   83763 main.go:141] libmachine: (addons-221213)   <os>

	I0417 17:59:15.196461   83763 main.go:141] libmachine: (addons-221213)     <type>hvm</type>

	I0417 17:59:15.196473   83763 main.go:141] libmachine: (addons-221213)     <boot dev='cdrom'/>

	I0417 17:59:15.196488   83763 main.go:141] libmachine: (addons-221213)     <boot dev='hd'/>

	I0417 17:59:15.196501   83763 main.go:141] libmachine: (addons-221213)     <bootmenu enable='no'/>

	I0417 17:59:15.196515   83763 main.go:141] libmachine: (addons-221213)   </os>

	I0417 17:59:15.196526   83763 main.go:141] libmachine: (addons-221213)   <devices>

	I0417 17:59:15.196534   83763 main.go:141] libmachine: (addons-221213)     <disk type='file' device='cdrom'>

	I0417 17:59:15.196551   83763 main.go:141] libmachine: (addons-221213)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/boot2docker.iso'/>

	I0417 17:59:15.196570   83763 main.go:141] libmachine: (addons-221213)       <target dev='hdc' bus='scsi'/>

	I0417 17:59:15.196584   83763 main.go:141] libmachine: (addons-221213)       <readonly/>

	I0417 17:59:15.196594   83763 main.go:141] libmachine: (addons-221213)     </disk>

	I0417 17:59:15.196609   83763 main.go:141] libmachine: (addons-221213)     <disk type='file' device='disk'>

	I0417 17:59:15.196622   83763 main.go:141] libmachine: (addons-221213)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0417 17:59:15.196639   83763 main.go:141] libmachine: (addons-221213)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/addons-221213.rawdisk'/>

	I0417 17:59:15.196661   83763 main.go:141] libmachine: (addons-221213)       <target dev='hda' bus='virtio'/>

	I0417 17:59:15.196684   83763 main.go:141] libmachine: (addons-221213)     </disk>

	I0417 17:59:15.196699   83763 main.go:141] libmachine: (addons-221213)     <interface type='network'>

	I0417 17:59:15.196721   83763 main.go:141] libmachine: (addons-221213)       <source network='mk-addons-221213'/>

	I0417 17:59:15.196735   83763 main.go:141] libmachine: (addons-221213)       <model type='virtio'/>

	I0417 17:59:15.196750   83763 main.go:141] libmachine: (addons-221213)     </interface>

	I0417 17:59:15.196788   83763 main.go:141] libmachine: (addons-221213)     <interface type='network'>

	I0417 17:59:15.196811   83763 main.go:141] libmachine: (addons-221213)       <source network='default'/>

	I0417 17:59:15.196844   83763 main.go:141] libmachine: (addons-221213)       <model type='virtio'/>

	I0417 17:59:15.196867   83763 main.go:141] libmachine: (addons-221213)     </interface>

	I0417 17:59:15.196880   83763 main.go:141] libmachine: (addons-221213)     <serial type='pty'>

	I0417 17:59:15.196889   83763 main.go:141] libmachine: (addons-221213)       <target port='0'/>

	I0417 17:59:15.196898   83763 main.go:141] libmachine: (addons-221213)     </serial>

	I0417 17:59:15.196909   83763 main.go:141] libmachine: (addons-221213)     <console type='pty'>

	I0417 17:59:15.196921   83763 main.go:141] libmachine: (addons-221213)       <target type='serial' port='0'/>

	I0417 17:59:15.196931   83763 main.go:141] libmachine: (addons-221213)     </console>

	I0417 17:59:15.196940   83763 main.go:141] libmachine: (addons-221213)     <rng model='virtio'>

	I0417 17:59:15.196957   83763 main.go:141] libmachine: (addons-221213)       <backend model='random'>/dev/random</backend>

	I0417 17:59:15.196969   83763 main.go:141] libmachine: (addons-221213)     </rng>

	I0417 17:59:15.196978   83763 main.go:141] libmachine: (addons-221213)     

	I0417 17:59:15.196984   83763 main.go:141] libmachine: (addons-221213)     

	I0417 17:59:15.196993   83763 main.go:141] libmachine: (addons-221213)   </devices>

	I0417 17:59:15.197006   83763 main.go:141] libmachine: (addons-221213) </domain>

	I0417 17:59:15.197012   83763 main.go:141] libmachine: (addons-221213) 

	I0417 17:59:15.201268   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:12:9c:2b in network default

	I0417 17:59:15.202047   83763 main.go:141] libmachine: (addons-221213) Ensuring networks are active...

	I0417 17:59:15.202069   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:15.202754   83763 main.go:141] libmachine: (addons-221213) Ensuring network default is active

	I0417 17:59:15.203048   83763 main.go:141] libmachine: (addons-221213) Ensuring network mk-addons-221213 is active

	I0417 17:59:15.203491   83763 main.go:141] libmachine: (addons-221213) Getting domain xml...

	I0417 17:59:15.204164   83763 main.go:141] libmachine: (addons-221213) Creating domain...

	I0417 17:59:16.392813   83763 main.go:141] libmachine: (addons-221213) Waiting to get IP...

	I0417 17:59:16.394197   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:16.394783   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:16.394815   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:16.394668   83785 retry.go:31] will retry after 285.013009ms: waiting for machine to come up

	I0417 17:59:16.681331   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:16.681869   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:16.681902   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:16.681817   83785 retry.go:31] will retry after 290.975776ms: waiting for machine to come up

	I0417 17:59:16.974285   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:16.974801   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:16.974838   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:16.974749   83785 retry.go:31] will retry after 410.138679ms: waiting for machine to come up

	I0417 17:59:17.386355   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:17.386761   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:17.386796   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:17.386709   83785 retry.go:31] will retry after 450.714694ms: waiting for machine to come up

	I0417 17:59:17.839527   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:17.839963   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:17.839994   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:17.839899   83785 retry.go:31] will retry after 580.497754ms: waiting for machine to come up

	I0417 17:59:18.421657   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:18.422106   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:18.422136   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:18.422051   83785 retry.go:31] will retry after 863.549256ms: waiting for machine to come up

	I0417 17:59:19.287673   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:19.288061   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:19.288093   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:19.288006   83785 retry.go:31] will retry after 1.078557693s: waiting for machine to come up

	I0417 17:59:20.368281   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:20.368809   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:20.368837   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:20.368746   83785 retry.go:31] will retry after 1.142808151s: waiting for machine to come up

	I0417 17:59:21.512990   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:21.513402   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:21.513434   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:21.513352   83785 retry.go:31] will retry after 1.143736039s: waiting for machine to come up

	I0417 17:59:22.658657   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:22.658988   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:22.659016   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:22.658933   83785 retry.go:31] will retry after 1.763944794s: waiting for machine to come up

	I0417 17:59:24.424509   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:24.424929   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:24.424959   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:24.424897   83785 retry.go:31] will retry after 2.007443383s: waiting for machine to come up

	I0417 17:59:26.433970   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:26.434429   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:26.434461   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:26.434364   83785 retry.go:31] will retry after 2.64291792s: waiting for machine to come up

	I0417 17:59:29.080132   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:29.080545   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:29.080569   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:29.080505   83785 retry.go:31] will retry after 3.644286795s: waiting for machine to come up

	I0417 17:59:32.728795   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:32.729218   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find current IP address of domain addons-221213 in network mk-addons-221213

	I0417 17:59:32.729242   83763 main.go:141] libmachine: (addons-221213) DBG | I0417 17:59:32.729154   83785 retry.go:31] will retry after 3.815754465s: waiting for machine to come up

	I0417 17:59:36.547794   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.548279   83763 main.go:141] libmachine: (addons-221213) Found IP for machine: 192.168.39.199

	I0417 17:59:36.548305   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has current primary IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.548311   83763 main.go:141] libmachine: (addons-221213) Reserving static IP address...

	I0417 17:59:36.548709   83763 main.go:141] libmachine: (addons-221213) DBG | unable to find host DHCP lease matching {name: "addons-221213", mac: "52:54:00:ca:2d:a2", ip: "192.168.39.199"} in network mk-addons-221213

	I0417 17:59:36.623683   83763 main.go:141] libmachine: (addons-221213) Reserved static IP address: 192.168.39.199

	I0417 17:59:36.623715   83763 main.go:141] libmachine: (addons-221213) DBG | Getting to WaitForSSH function...

	I0417 17:59:36.623724   83763 main.go:141] libmachine: (addons-221213) Waiting for SSH to be available...

	I0417 17:59:36.626601   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.627047   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:minikube Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:36.627071   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.627228   83763 main.go:141] libmachine: (addons-221213) DBG | Using SSH client type: external

	I0417 17:59:36.627251   83763 main.go:141] libmachine: (addons-221213) DBG | Using SSH private key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa (-rw-------)

	I0417 17:59:36.627295   83763 main.go:141] libmachine: (addons-221213) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.199 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0417 17:59:36.627313   83763 main.go:141] libmachine: (addons-221213) DBG | About to run SSH command:

	I0417 17:59:36.627325   83763 main.go:141] libmachine: (addons-221213) DBG | exit 0

	I0417 17:59:36.752937   83763 main.go:141] libmachine: (addons-221213) DBG | SSH cmd err, output: <nil>: 

	I0417 17:59:36.753268   83763 main.go:141] libmachine: (addons-221213) KVM machine creation complete!

	I0417 17:59:36.753585   83763 main.go:141] libmachine: (addons-221213) Calling .GetConfigRaw

	I0417 17:59:36.754210   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:36.754480   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:36.754679   83763 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0417 17:59:36.754739   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 17:59:36.755989   83763 main.go:141] libmachine: Detecting operating system of created instance...

	I0417 17:59:36.756004   83763 main.go:141] libmachine: Waiting for SSH to be available...

	I0417 17:59:36.756010   83763 main.go:141] libmachine: Getting to WaitForSSH function...

	I0417 17:59:36.756019   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:36.758339   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.758649   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:36.758678   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.758773   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:36.758938   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:36.759165   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:36.759327   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:36.759513   83763 main.go:141] libmachine: Using SSH client type: native

	I0417 17:59:36.759809   83763 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.199 22 <nil> <nil>}

	I0417 17:59:36.759822   83763 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0417 17:59:36.864138   83763 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 17:59:36.864178   83763 main.go:141] libmachine: Detecting the provisioner...

	I0417 17:59:36.864191   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:36.867042   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.867442   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:36.867470   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.867633   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:36.867854   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:36.868021   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:36.868141   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:36.868301   83763 main.go:141] libmachine: Using SSH client type: native

	I0417 17:59:36.868504   83763 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.199 22 <nil> <nil>}

	I0417 17:59:36.868523   83763 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0417 17:59:36.973489   83763 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0417 17:59:36.973610   83763 main.go:141] libmachine: found compatible host: buildroot

	I0417 17:59:36.973622   83763 main.go:141] libmachine: Provisioning with buildroot...

	I0417 17:59:36.973630   83763 main.go:141] libmachine: (addons-221213) Calling .GetMachineName

	I0417 17:59:36.973892   83763 buildroot.go:166] provisioning hostname "addons-221213"

	I0417 17:59:36.973916   83763 main.go:141] libmachine: (addons-221213) Calling .GetMachineName

	I0417 17:59:36.974106   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:36.976748   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.977187   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:36.977217   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:36.977364   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:36.977542   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:36.977701   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:36.977841   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:36.978052   83763 main.go:141] libmachine: Using SSH client type: native

	I0417 17:59:36.978222   83763 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.199 22 <nil> <nil>}

	I0417 17:59:36.978234   83763 main.go:141] libmachine: About to run SSH command:

	sudo hostname addons-221213 && echo "addons-221213" | sudo tee /etc/hostname

	I0417 17:59:37.096273   83763 main.go:141] libmachine: SSH cmd err, output: <nil>: addons-221213

	I0417 17:59:37.096307   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:37.098945   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.099330   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.099355   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.099495   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:37.099629   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.099835   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.099970   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:37.100116   83763 main.go:141] libmachine: Using SSH client type: native

	I0417 17:59:37.100364   83763 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.199 22 <nil> <nil>}

	I0417 17:59:37.100388   83763 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\saddons-221213' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 addons-221213/g' /etc/hosts;

				else 

					echo '127.0.1.1 addons-221213' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0417 17:59:37.214907   83763 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 17:59:37.214942   83763 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18665-75973/.minikube CaCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18665-75973/.minikube}

	I0417 17:59:37.214997   83763 buildroot.go:174] setting up certificates

	I0417 17:59:37.215012   83763 provision.go:84] configureAuth start

	I0417 17:59:37.215033   83763 main.go:141] libmachine: (addons-221213) Calling .GetMachineName

	I0417 17:59:37.215387   83763 main.go:141] libmachine: (addons-221213) Calling .GetIP

	I0417 17:59:37.218162   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.218513   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.218544   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.218668   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:37.220720   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.221033   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.221075   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.221178   83763 provision.go:143] copyHostCerts

	I0417 17:59:37.221249   83763 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem (1078 bytes)

	I0417 17:59:37.221417   83763 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem (1123 bytes)

	I0417 17:59:37.221525   83763 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem (1679 bytes)

	I0417 17:59:37.221599   83763 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem org=jenkins.addons-221213 san=[127.0.0.1 192.168.39.199 addons-221213 localhost minikube]

	I0417 17:59:37.352602   83763 provision.go:177] copyRemoteCerts

	I0417 17:59:37.352674   83763 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0417 17:59:37.352715   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:37.355675   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.356071   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.356104   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.356244   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:37.356425   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.356635   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:37.356739   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 17:59:37.439152   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0417 17:59:37.464784   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0417 17:59:37.491099   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0417 17:59:37.516488   83763 provision.go:87] duration metric: took 301.457845ms to configureAuth

	I0417 17:59:37.516517   83763 buildroot.go:189] setting minikube options for container-runtime

	I0417 17:59:37.516748   83763 config.go:182] Loaded profile config "addons-221213": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 17:59:37.516860   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:37.519452   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.519822   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.519872   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.520053   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:37.520273   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.520425   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.520569   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:37.520732   83763 main.go:141] libmachine: Using SSH client type: native

	I0417 17:59:37.520983   83763 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.199 22 <nil> <nil>}

	I0417 17:59:37.521002   83763 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %s "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0417 17:59:37.789676   83763 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0417 17:59:37.789710   83763 main.go:141] libmachine: Checking connection to Docker...

	I0417 17:59:37.789719   83763 main.go:141] libmachine: (addons-221213) Calling .GetURL

	I0417 17:59:37.791357   83763 main.go:141] libmachine: (addons-221213) DBG | Using libvirt version 6000000

	I0417 17:59:37.794108   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.794497   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.794524   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.794711   83763 main.go:141] libmachine: Docker is up and running!

	I0417 17:59:37.794727   83763 main.go:141] libmachine: Reticulating splines...

	I0417 17:59:37.794735   83763 client.go:171] duration metric: took 23.618336261s to LocalClient.Create

	I0417 17:59:37.794769   83763 start.go:167] duration metric: took 23.618424878s to libmachine.API.Create "addons-221213"

	I0417 17:59:37.794779   83763 start.go:293] postStartSetup for "addons-221213" (driver="kvm2")

	I0417 17:59:37.794792   83763 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0417 17:59:37.794808   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:37.795078   83763 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0417 17:59:37.795112   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:37.797338   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.797635   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.797675   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.797798   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:37.797969   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.798135   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:37.798289   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 17:59:37.880083   83763 ssh_runner.go:195] Run: cat /etc/os-release

	I0417 17:59:37.884431   83763 info.go:137] Remote host: Buildroot 2023.02.9

	I0417 17:59:37.884457   83763 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/addons for local assets ...

	I0417 17:59:37.884542   83763 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/files for local assets ...

	I0417 17:59:37.884575   83763 start.go:296] duration metric: took 89.789251ms for postStartSetup

	I0417 17:59:37.884622   83763 main.go:141] libmachine: (addons-221213) Calling .GetConfigRaw

	I0417 17:59:37.885423   83763 main.go:141] libmachine: (addons-221213) Calling .GetIP

	I0417 17:59:37.888463   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.888833   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.888864   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.889120   83763 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/config.json ...

	I0417 17:59:37.889356   83763 start.go:128] duration metric: took 23.7314044s to createHost

	I0417 17:59:37.889387   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:37.891587   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.891949   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:37.891978   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:37.892195   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:37.892444   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.892606   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:37.892748   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:37.892968   83763 main.go:141] libmachine: Using SSH client type: native

	I0417 17:59:37.893152   83763 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.199 22 <nil> <nil>}

	I0417 17:59:37.893165   83763 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0417 17:59:37.997790   83763 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713376777.978679713

	I0417 17:59:37.997812   83763 fix.go:216] guest clock: 1713376777.978679713

	I0417 17:59:37.997820   83763 fix.go:229] Guest: 2024-04-17 17:59:37.978679713 +0000 UTC Remote: 2024-04-17 17:59:37.889371545 +0000 UTC m=+23.846038534 (delta=89.308168ms)

	I0417 17:59:37.997857   83763 fix.go:200] guest clock delta is within tolerance: 89.308168ms

	I0417 17:59:37.997862   83763 start.go:83] releasing machines lock for "addons-221213", held for 23.839993821s

	I0417 17:59:37.997884   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:37.998160   83763 main.go:141] libmachine: (addons-221213) Calling .GetIP

	I0417 17:59:38.001173   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:38.001578   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:38.001605   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:38.001811   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:38.002337   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:38.002539   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 17:59:38.002672   83763 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0417 17:59:38.002723   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:38.002825   83763 ssh_runner.go:195] Run: cat /version.json

	I0417 17:59:38.002852   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 17:59:38.005493   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:38.005607   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:38.005884   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:38.005936   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:38.005964   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:38.005984   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:38.006078   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:38.006183   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 17:59:38.006270   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:38.006327   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 17:59:38.006394   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:38.006460   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 17:59:38.006603   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 17:59:38.006623   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 17:59:38.085994   83763 ssh_runner.go:195] Run: systemctl --version

	I0417 17:59:38.105779   83763 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0417 17:59:38.266509   83763 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0417 17:59:38.273673   83763 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0417 17:59:38.273763   83763 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0417 17:59:38.291153   83763 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0417 17:59:38.291184   83763 start.go:494] detecting cgroup driver to use...

	I0417 17:59:38.291283   83763 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0417 17:59:38.306930   83763 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0417 17:59:38.320890   83763 docker.go:217] disabling cri-docker service (if available) ...

	I0417 17:59:38.320956   83763 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0417 17:59:38.334207   83763 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0417 17:59:38.347611   83763 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0417 17:59:38.459533   83763 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0417 17:59:38.622989   83763 docker.go:233] disabling docker service ...

	I0417 17:59:38.623074   83763 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0417 17:59:38.637388   83763 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0417 17:59:38.650463   83763 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0417 17:59:38.765390   83763 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0417 17:59:38.889375   83763 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0417 17:59:38.903783   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0417 17:59:38.923932   83763 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0417 17:59:38.923991   83763 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 17:59:38.934857   83763 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0417 17:59:38.934962   83763 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 17:59:38.945338   83763 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 17:59:38.955828   83763 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 17:59:38.966361   83763 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0417 17:59:38.976990   83763 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 17:59:38.987056   83763 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 17:59:39.004636   83763 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 17:59:39.014838   83763 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0417 17:59:39.024146   83763 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0417 17:59:39.024224   83763 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0417 17:59:39.036949   83763 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0417 17:59:39.047055   83763 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 17:59:39.160231   83763 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0417 17:59:39.300226   83763 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0417 17:59:39.300321   83763 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0417 17:59:39.305291   83763 start.go:562] Will wait 60s for crictl version

	I0417 17:59:39.305346   83763 ssh_runner.go:195] Run: which crictl

	I0417 17:59:39.309246   83763 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0417 17:59:39.350918   83763 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0417 17:59:39.351002   83763 ssh_runner.go:195] Run: crio --version

	I0417 17:59:39.380019   83763 ssh_runner.go:195] Run: crio --version

	I0417 17:59:39.410444   83763 out.go:177] * Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	I0417 17:59:39.411805   83763 main.go:141] libmachine: (addons-221213) Calling .GetIP

	I0417 17:59:39.414288   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:39.414617   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 17:59:39.414641   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 17:59:39.414960   83763 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0417 17:59:39.419393   83763 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 17:59:39.432999   83763 kubeadm.go:877] updating cluster {Name:addons-221213 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.

0-rc.2 ClusterName:addons-221213 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.199 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor

t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0417 17:59:39.433114   83763 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 17:59:39.433154   83763 ssh_runner.go:195] Run: sudo crictl images --output json

	I0417 17:59:39.468023   83763 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0-rc.2". assuming images are not preloaded.

	I0417 17:59:39.468087   83763 ssh_runner.go:195] Run: which lz4

	I0417 17:59:39.472433   83763 ssh_runner.go:195] Run: stat -c "%s %y" /preloaded.tar.lz4

	I0417 17:59:39.476752   83763 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%s %y" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0417 17:59:39.476791   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394547972 bytes)

	I0417 17:59:40.932491   83763 crio.go:462] duration metric: took 1.460088607s to copy over tarball

	I0417 17:59:40.932562   83763 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0417 17:59:43.232319   83763 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.299722197s)

	I0417 17:59:43.232350   83763 crio.go:469] duration metric: took 2.29983253s to extract the tarball

	I0417 17:59:43.232358   83763 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0417 17:59:43.271825   83763 ssh_runner.go:195] Run: sudo crictl images --output json

	I0417 17:59:43.315914   83763 crio.go:514] all images are preloaded for cri-o runtime.

	I0417 17:59:43.315943   83763 cache_images.go:84] Images are preloaded, skipping loading

	I0417 17:59:43.315953   83763 kubeadm.go:928] updating node { 192.168.39.199 8443 v1.30.0-rc.2 crio true true} ...

	I0417 17:59:43.316113   83763 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=addons-221213 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.199

	[Install]

	 config:

	{KubernetesVersion:v1.30.0-rc.2 ClusterName:addons-221213 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0417 17:59:43.316212   83763 ssh_runner.go:195] Run: crio config

	I0417 17:59:43.363453   83763 cni.go:84] Creating CNI manager for ""

	I0417 17:59:43.363488   83763 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0417 17:59:43.363505   83763 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0417 17:59:43.363537   83763 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.199 APIServerPort:8443 KubernetesVersion:v1.30.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:addons-221213 NodeName:addons-221213 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.199"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.199 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/

etc/kubernetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0417 17:59:43.363759   83763 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.199

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "addons-221213"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.199

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.199"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0-rc.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0417 17:59:43.363836   83763 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 17:59:43.374819   83763 binaries.go:44] Found k8s binaries, skipping transfer

	I0417 17:59:43.374897   83763 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube

	I0417 17:59:43.385212   83763 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)

	I0417 17:59:43.402441   83763 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0417 17:59:43.419434   83763 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2162 bytes)

	I0417 17:59:43.437029   83763 ssh_runner.go:195] Run: grep 192.168.39.199	control-plane.minikube.internal$ /etc/hosts

	I0417 17:59:43.441141   83763 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.199	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 17:59:43.454397   83763 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 17:59:43.578200   83763 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 17:59:43.597357   83763 certs.go:68] Setting up /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213 for IP: 192.168.39.199

	I0417 17:59:43.597386   83763 certs.go:194] generating shared ca certs ...

	I0417 17:59:43.597402   83763 certs.go:226] acquiring lock for ca certs: {Name:mk03352eb76143f462405cfdf4da402444190b34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:43.597551   83763 certs.go:240] generating "minikubeCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key

	I0417 17:59:43.680798   83763 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt ...

	I0417 17:59:43.680828   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt: {Name:mk7286f710b302f07f682b16e036d3aaf759645c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:43.681016   83763 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key ...

	I0417 17:59:43.681035   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key: {Name:mk72701f0e875987f4ee296a04840f42d4356f14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:43.681139   83763 certs.go:240] generating "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key

	I0417 17:59:43.829644   83763 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt ...

	I0417 17:59:43.829675   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt: {Name:mk876cfd904c4038dba3b72cc02bab2c34e4e7e1 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:43.829864   83763 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key ...

	I0417 17:59:43.829885   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key: {Name:mk07ca1c0410bfb934a442b193aa15a5997093fc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:43.829980   83763 certs.go:256] generating profile certs ...

	I0417 17:59:43.830120   83763 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/client.key

	I0417 17:59:43.830143   83763 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/client.crt with IP's: []

	I0417 17:59:43.950982   83763 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/client.crt ...

	I0417 17:59:43.951016   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/client.crt: {Name:mk44b94611a4a70db64b227a47a044a157f01442 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:43.951236   83763 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/client.key ...

	I0417 17:59:43.951253   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/client.key: {Name:mk03189e684490c4da191d2b643781b9ebc2cbc7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:43.951353   83763 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.key.a3179eec

	I0417 17:59:43.951380   83763 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.crt.a3179eec with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.199]

	I0417 17:59:44.126410   83763 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.crt.a3179eec ...

	I0417 17:59:44.126442   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.crt.a3179eec: {Name:mk4d32b0e393b70744dc2c71290503b181c5793a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:44.126646   83763 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.key.a3179eec ...

	I0417 17:59:44.126666   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.key.a3179eec: {Name:mkad462fd521b29e1f55be978691ad6f104981d2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:44.126772   83763 certs.go:381] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.crt.a3179eec -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.crt

	I0417 17:59:44.126886   83763 certs.go:385] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.key.a3179eec -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.key

	I0417 17:59:44.126958   83763 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.key

	I0417 17:59:44.126980   83763 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.crt with IP's: []

	I0417 17:59:44.354227   83763 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.crt ...

	I0417 17:59:44.354260   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.crt: {Name:mk86244172b13446446c0bb0d67aaa94f0ef528f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:44.354439   83763 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.key ...

	I0417 17:59:44.354451   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.key: {Name:mk01440fb440910aff14f326c6eeb31419b140e7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 17:59:44.354612   83763 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem (1679 bytes)

	I0417 17:59:44.354648   83763 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem (1078 bytes)

	I0417 17:59:44.354674   83763 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem (1123 bytes)

	I0417 17:59:44.354697   83763 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem (1679 bytes)

	I0417 17:59:44.355392   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0417 17:59:44.393374   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0417 17:59:44.432200   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0417 17:59:44.459344   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0417 17:59:44.484612   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1419 bytes)

	I0417 17:59:44.509737   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0417 17:59:44.534550   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0417 17:59:44.560119   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/addons-221213/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0417 17:59:44.585567   83763 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0417 17:59:44.610574   83763 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)

	I0417 17:59:44.628503   83763 ssh_runner.go:195] Run: openssl version

	I0417 17:59:44.634455   83763 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0417 17:59:44.648689   83763 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0417 17:59:44.653758   83763 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 17 17:59 /usr/share/ca-certificates/minikubeCA.pem

	I0417 17:59:44.653820   83763 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0417 17:59:44.660266   83763 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0417 17:59:44.674558   83763 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0417 17:59:44.679170   83763 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0417 17:59:44.679223   83763 kubeadm.go:391] StartCluster: {Name:addons-221213 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:4000 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-r

c.2 ClusterName:addons-221213 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.199 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 17:59:44.679305   83763 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0417 17:59:44.679354   83763 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0417 17:59:44.726990   83763 cri.go:89] found id: ""

	I0417 17:59:44.727062   83763 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0417 17:59:44.740125   83763 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0417 17:59:44.753027   83763 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0417 17:59:44.765790   83763 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0417 17:59:44.765814   83763 kubeadm.go:156] found existing configuration files:

	I0417 17:59:44.765858   83763 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0417 17:59:44.777845   83763 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0417 17:59:44.777903   83763 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0417 17:59:44.791079   83763 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0417 17:59:44.802130   83763 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0417 17:59:44.802196   83763 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0417 17:59:44.812924   83763 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0417 17:59:44.823194   83763 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0417 17:59:44.823253   83763 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0417 17:59:44.834024   83763 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0417 17:59:44.844414   83763 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0417 17:59:44.844481   83763 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0417 17:59:44.855278   83763 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0417 17:59:44.906842   83763 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0-rc.2

	I0417 17:59:44.906943   83763 kubeadm.go:309] [preflight] Running pre-flight checks

	I0417 17:59:45.039598   83763 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0417 17:59:45.039778   83763 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0417 17:59:45.039919   83763 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0417 17:59:45.289126   83763 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0417 17:59:45.445743   83763 out.go:204]   - Generating certificates and keys ...

	I0417 17:59:45.445868   83763 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0417 17:59:45.445972   83763 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0417 17:59:45.446086   83763 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0417 17:59:45.625927   83763 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0417 17:59:45.846295   83763 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0417 17:59:45.944566   83763 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0417 17:59:46.003872   83763 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0417 17:59:46.004066   83763 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [addons-221213 localhost] and IPs [192.168.39.199 127.0.0.1 ::1]

	I0417 17:59:46.097759   83763 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0417 17:59:46.098017   83763 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [addons-221213 localhost] and IPs [192.168.39.199 127.0.0.1 ::1]

	I0417 17:59:46.251280   83763 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0417 17:59:46.321481   83763 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0417 17:59:46.449543   83763 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0417 17:59:46.449765   83763 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0417 17:59:46.561441   83763 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0417 17:59:46.812365   83763 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0417 17:59:47.058257   83763 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0417 17:59:47.107843   83763 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0417 17:59:47.299985   83763 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0417 17:59:47.300600   83763 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0417 17:59:47.303087   83763 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0417 17:59:47.304979   83763 out.go:204]   - Booting up control plane ...

	I0417 17:59:47.305108   83763 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0417 17:59:47.305183   83763 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0417 17:59:47.305239   83763 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0417 17:59:47.320872   83763 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0417 17:59:47.321727   83763 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0417 17:59:47.321806   83763 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0417 17:59:47.455217   83763 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0417 17:59:47.455350   83763 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0417 17:59:47.958798   83763 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 503.956133ms

	I0417 17:59:47.958902   83763 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0417 17:59:52.958338   83763 kubeadm.go:309] [api-check] The API server is healthy after 5.001463074s

	I0417 17:59:52.974786   83763 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0417 17:59:52.986986   83763 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0417 17:59:53.016359   83763 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0417 17:59:53.016530   83763 kubeadm.go:309] [mark-control-plane] Marking the node addons-221213 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0417 17:59:53.028393   83763 kubeadm.go:309] [bootstrap-token] Using token: jixlo2.ceo5x00xibmq7g1q

	I0417 17:59:53.029967   83763 out.go:204]   - Configuring RBAC rules ...

	I0417 17:59:53.030113   83763 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0417 17:59:53.040592   83763 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0417 17:59:53.052549   83763 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0417 17:59:53.056275   83763 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0417 17:59:53.059926   83763 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0417 17:59:53.063191   83763 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0417 17:59:53.365156   83763 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0417 17:59:53.818976   83763 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0417 17:59:54.365741   83763 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0417 17:59:54.366709   83763 kubeadm.go:309] 

	I0417 17:59:54.366797   83763 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0417 17:59:54.366808   83763 kubeadm.go:309] 

	I0417 17:59:54.366909   83763 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0417 17:59:54.366920   83763 kubeadm.go:309] 

	I0417 17:59:54.366961   83763 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0417 17:59:54.367056   83763 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0417 17:59:54.367138   83763 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0417 17:59:54.367147   83763 kubeadm.go:309] 

	I0417 17:59:54.367241   83763 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0417 17:59:54.367251   83763 kubeadm.go:309] 

	I0417 17:59:54.367317   83763 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0417 17:59:54.367326   83763 kubeadm.go:309] 

	I0417 17:59:54.367398   83763 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0417 17:59:54.367509   83763 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0417 17:59:54.367609   83763 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0417 17:59:54.367618   83763 kubeadm.go:309] 

	I0417 17:59:54.367747   83763 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0417 17:59:54.367819   83763 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0417 17:59:54.367827   83763 kubeadm.go:309] 

	I0417 17:59:54.367909   83763 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token jixlo2.ceo5x00xibmq7g1q \

	I0417 17:59:54.368013   83763 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 \

	I0417 17:59:54.368072   83763 kubeadm.go:309] 	--control-plane 

	I0417 17:59:54.368090   83763 kubeadm.go:309] 

	I0417 17:59:54.368205   83763 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0417 17:59:54.368214   83763 kubeadm.go:309] 

	I0417 17:59:54.368332   83763 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token jixlo2.ceo5x00xibmq7g1q \

	I0417 17:59:54.368501   83763 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 

	I0417 17:59:54.368881   83763 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0417 17:59:54.368919   83763 cni.go:84] Creating CNI manager for ""

	I0417 17:59:54.368930   83763 cni.go:146] "kvm2" driver + "crio" runtime found, recommending bridge

	I0417 17:59:54.371368   83763 out.go:177] * Configuring bridge CNI (Container Networking Interface) ...

	I0417 17:59:54.372667   83763 ssh_runner.go:195] Run: sudo mkdir -p /etc/cni/net.d

	I0417 17:59:54.383856   83763 ssh_runner.go:362] scp memory --> /etc/cni/net.d/1-k8s.conflist (496 bytes)

	I0417 17:59:54.405864   83763 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0417 17:59:54.406001   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:54.406014   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes addons-221213 minikube.k8s.io/updated_at=2024_04_17T17_59_54_0700 minikube.k8s.io/version=v1.33.0-beta.0 minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3 minikube.k8s.io/name=addons-221213 minikube.k8s.io/primary=true

	I0417 17:59:54.561540   83763 ops.go:34] apiserver oom_adj: -16

	I0417 17:59:54.561722   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:55.061816   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:55.562527   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:56.062188   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:56.562031   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:57.061773   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:57.562765   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:58.062623   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:58.561807   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:59.062727   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 17:59:59.562586   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:00.061891   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:00.562821   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:01.062099   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:01.562064   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:02.062538   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:02.562378   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:03.062782   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:03.562031   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:04.062234   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:04.561989   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:05.061706   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:05.562829   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:06.062588   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:06.562451   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:07.061885   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:07.562690   83763 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:00:07.642586   83763 kubeadm.go:1107] duration metric: took 13.236652368s to wait for elevateKubeSystemPrivileges

	W0417 18:00:07.642644   83763 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0417 18:00:07.642656   83763 kubeadm.go:393] duration metric: took 22.96343868s to StartCluster

	I0417 18:00:07.642680   83763 settings.go:142] acquiring lock: {Name:mk5d952127253ee5e60e06b072b3460ff4f86e9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:00:07.642820   83763 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:00:07.643193   83763 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/kubeconfig: {Name:mkca968a5a2538f9f961af0f359c1b9923864131 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:00:07.643363   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0417 18:00:07.643384   83763 start.go:234] Will wait 6m0s for node &{Name: IP:192.168.39.199 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:00:07.645372   83763 out.go:177] * Verifying Kubernetes components...

	I0417 18:00:07.643481   83763 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:true csi-hostpath-driver:true dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:true gvisor:false headlamp:false helm-tiller:true inaccel:false ingress:true ingress-dns:true inspektor-gadget:true istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:true nvidia-device-plugin:true nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:true registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:true volumesnapshots:true yakd:true]

	I0417 18:00:07.643583   83763 config.go:182] Loaded profile config "addons-221213": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:00:07.646811   83763 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:00:07.645484   83763 addons.go:69] Setting cloud-spanner=true in profile "addons-221213"

	I0417 18:00:07.646883   83763 addons.go:234] Setting addon cloud-spanner=true in "addons-221213"

	I0417 18:00:07.646926   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.645493   83763 addons.go:69] Setting inspektor-gadget=true in profile "addons-221213"

	I0417 18:00:07.646962   83763 addons.go:234] Setting addon inspektor-gadget=true in "addons-221213"

	I0417 18:00:07.646992   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.645500   83763 addons.go:69] Setting csi-hostpath-driver=true in profile "addons-221213"

	I0417 18:00:07.645505   83763 addons.go:69] Setting default-storageclass=true in profile "addons-221213"

	I0417 18:00:07.647126   83763 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "addons-221213"

	I0417 18:00:07.645512   83763 addons.go:69] Setting gcp-auth=true in profile "addons-221213"

	I0417 18:00:07.645508   83763 addons.go:69] Setting registry=true in profile "addons-221213"

	I0417 18:00:07.647292   83763 addons.go:234] Setting addon registry=true in "addons-221213"

	I0417 18:00:07.647322   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.645511   83763 addons.go:69] Setting yakd=true in profile "addons-221213"

	I0417 18:00:07.647365   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.647390   83763 addons.go:234] Setting addon yakd=true in "addons-221213"

	I0417 18:00:07.645516   83763 addons.go:69] Setting helm-tiller=true in profile "addons-221213"

	I0417 18:00:07.647421   83763 addons.go:234] Setting addon helm-tiller=true in "addons-221213"

	I0417 18:00:07.647433   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.647445   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.645518   83763 addons.go:69] Setting metrics-server=true in profile "addons-221213"

	I0417 18:00:07.645520   83763 addons.go:69] Setting storage-provisioner=true in profile "addons-221213"

	I0417 18:00:07.645521   83763 addons.go:69] Setting nvidia-device-plugin=true in profile "addons-221213"

	I0417 18:00:07.645521   83763 addons.go:69] Setting ingress-dns=true in profile "addons-221213"

	I0417 18:00:07.645530   83763 addons.go:69] Setting storage-provisioner-rancher=true in profile "addons-221213"

	I0417 18:00:07.645533   83763 addons.go:69] Setting volumesnapshots=true in profile "addons-221213"

	I0417 18:00:07.645545   83763 addons.go:69] Setting ingress=true in profile "addons-221213"

	I0417 18:00:07.647085   83763 addons.go:234] Setting addon csi-hostpath-driver=true in "addons-221213"

	I0417 18:00:07.647393   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.647490   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.647528   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.647534   83763 addons.go:234] Setting addon ingress-dns=true in "addons-221213"

	I0417 18:00:07.647540   83763 addons.go:234] Setting addon storage-provisioner=true in "addons-221213"

	I0417 18:00:07.647490   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.647346   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.647593   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.647598   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.647614   83763 addons.go:234] Setting addon nvidia-device-plugin=true in "addons-221213"

	I0417 18:00:07.647652   83763 addons.go:234] Setting addon volumesnapshots=true in "addons-221213"

	I0417 18:00:07.647655   83763 addons.go:234] Setting addon ingress=true in "addons-221213"

	I0417 18:00:07.647656   83763 addons.go:234] Setting addon metrics-server=true in "addons-221213"

	I0417 18:00:07.647226   83763 mustload.go:65] Loading cluster: addons-221213

	I0417 18:00:07.647844   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.647876   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.647893   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.647994   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648028   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648029   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648067   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648078   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.648137   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.647874   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648237   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648311   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648323   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648392   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648419   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648426   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648434   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648438   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.648472   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.648492   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648496   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648470   83763 addons_storage_classes.go:33] enableOrDisableStorageClasses storage-provisioner-rancher=true on "addons-221213"

	I0417 18:00:07.648602   83763 config.go:182] Loaded profile config "addons-221213": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:00:07.648823   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648893   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.648825   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.648963   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.668500   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34973

	I0417 18:00:07.668766   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42405

	I0417 18:00:07.668808   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46547

	I0417 18:00:07.668978   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.669291   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.669525   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.669559   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.669765   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.669793   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.670171   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.670224   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.670436   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.670857   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.670905   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.671299   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33315

	I0417 18:00:07.671516   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.671693   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.672495   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.672519   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.672674   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.672692   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.673149   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.673343   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.673771   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.673822   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.674650   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.674692   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.674798   83763 addons.go:234] Setting addon default-storageclass=true in "addons-221213"

	I0417 18:00:07.674840   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.679393   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44517

	I0417 18:00:07.681180   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.681228   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.681237   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.681276   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.681328   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.685041   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.685070   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.685420   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.685461   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.686906   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.686997   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37045

	I0417 18:00:07.687356   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.687861   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.687883   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.688528   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.688573   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.688808   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.689340   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.689380   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.707540   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42739

	I0417 18:00:07.707691   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41011

	I0417 18:00:07.708139   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.708245   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.708782   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.708803   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.708913   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.708938   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.709203   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.709412   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.709598   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.710371   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46439

	I0417 18:00:07.710703   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.710734   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.712351   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38731

	I0417 18:00:07.712503   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.713159   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.713406   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.713425   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.713695   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.713768   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.713784   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.713844   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.715746   83763 out.go:177]   - Using image docker.io/marcnuri/yakd:0.0.4

	I0417 18:00:07.714182   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.714683   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.716889   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41891

	I0417 18:00:07.717266   83763 addons.go:426] installing /etc/kubernetes/addons/yakd-ns.yaml

	I0417 18:00:07.717282   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-ns.yaml (171 bytes)

	I0417 18:00:07.717305   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.717402   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.717991   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.718026   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.718728   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42525

	I0417 18:00:07.718907   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.718985   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.719590   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.719607   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.719748   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.719771   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.720315   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.720319   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.720953   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.721286   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.721316   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.722665   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46013

	I0417 18:00:07.723038   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.723351   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.723807   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.723828   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.724146   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.724711   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.724752   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.724990   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.724996   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.725006   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.725039   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.725199   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.727022   83763 out.go:177]   - Using image gcr.io/k8s-minikube/minikube-ingress-dns:0.0.2

	I0417 18:00:07.725526   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.726023   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41901

	I0417 18:00:07.728645   83763 addons.go:426] installing /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0417 18:00:07.728667   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-dns-pod.yaml (2442 bytes)

	I0417 18:00:07.728686   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.728725   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.729333   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.729884   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.729901   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.730294   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.730935   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.730974   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.731178   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37809

	I0417 18:00:07.731186   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39621

	I0417 18:00:07.731621   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.731715   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.732146   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.732168   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.732303   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.732484   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.732634   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.732794   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.733197   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45743

	I0417 18:00:07.737048   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.737572   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.737911   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.737927   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.738249   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.738278   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.738346   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.738864   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.738891   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.739189   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.739753   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.739779   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.741394   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.741419   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.741964   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.742180   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.744111   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.746440   83763 out.go:177]   - Using image ghcr.io/helm/tiller:v2.17.0

	I0417 18:00:07.748194   83763 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-dp.yaml

	I0417 18:00:07.748220   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-dp.yaml (2422 bytes)

	I0417 18:00:07.748245   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.749468   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44003

	I0417 18:00:07.749481   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40587

	I0417 18:00:07.750043   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.750721   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.750762   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.751251   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.751319   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44165

	I0417 18:00:07.751618   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.752229   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.752268   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.752289   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.752513   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.752699   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.752803   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.752999   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.753193   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37445

	I0417 18:00:07.753300   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.753597   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.753719   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.753733   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.756215   83763 out.go:177]   - Using image gcr.io/cloud-spanner-emulator/emulator:1.5.15

	I0417 18:00:07.754308   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.754707   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.758080   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41423

	I0417 18:00:07.758974   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33815

	I0417 18:00:07.759342   83763 addons.go:426] installing /etc/kubernetes/addons/deployment.yaml

	I0417 18:00:07.759362   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/deployment.yaml (1004 bytes)

	I0417 18:00:07.759384   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.760279   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.760392   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.760411   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.760450   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.760490   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43451

	I0417 18:00:07.760535   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.761527   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.761569   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.761611   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.761628   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.761673   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.761763   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.761781   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.762281   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.762296   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.762299   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.762388   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.762398   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.762752   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.762857   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.762908   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39147

	I0417 18:00:07.762925   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.763166   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.763222   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38511

	I0417 18:00:07.763432   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.763643   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.763796   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.764926   83763 addons.go:234] Setting addon storage-provisioner-rancher=true in "addons-221213"

	I0417 18:00:07.764972   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.765289   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.765314   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.765549   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.765583   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.765548   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.765663   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.766266   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.766315   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.766334   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.766341   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.768395   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-resizer:v1.6.0

	I0417 18:00:07.766358   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.766384   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:07.766618   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.766645   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.766855   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.767218   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.770628   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.772093   83763 out.go:177]   - Using image registry.k8s.io/metrics-server/metrics-server:v0.7.1

	I0417 18:00:07.772160   83763 out.go:177]   - Using image docker.io/registry:2.8.3

	I0417 18:00:07.772840   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.773570   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.774897   83763 addons.go:426] installing /etc/kubernetes/addons/metrics-apiservice.yaml

	I0417 18:00:07.774915   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-apiservice.yaml (424 bytes)

	I0417 18:00:07.774938   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.773071   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.773243   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45289

	I0417 18:00:07.773511   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0

	I0417 18:00:07.773576   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.772864   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.774084   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.775580   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.777154   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.777723   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45089

	I0417 18:00:07.777750   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.778848   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37341

	I0417 18:00:07.778873   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.779142   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.779395   83763 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0417 18:00:07.779481   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.779598   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.780494   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-provisioner:v3.3.0

	I0417 18:00:07.780606   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.781606   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.781614   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.780789   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.780949   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.781000   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.781626   83763 out.go:177]   - Using image gcr.io/k8s-minikube/kube-registry-proxy:0.0.6

	I0417 18:00:07.781641   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0417 18:00:07.781815   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.781828   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.781965   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.783266   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-attacher:v4.0.0

	I0417 18:00:07.783324   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.786242   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-external-health-monitor-controller:v0.7.0

	I0417 18:00:07.783639   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.783681   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.783769   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.783943   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.785127   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.787861   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.787922   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.787982   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.787990   83763 addons.go:426] installing /etc/kubernetes/addons/registry-rc.yaml

	I0417 18:00:07.788156   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.788651   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.789337   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/snapshot-controller:v6.1.0

	I0417 18:00:07.789346   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.789779   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.791094   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-rc.yaml (798 bytes)

	I0417 18:00:07.791105   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.6.0

	I0417 18:00:07.791219   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.791517   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.791670   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.791693   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.792853   83763 out.go:177]   - Using image ghcr.io/inspektor-gadget/inspektor-gadget:v0.27.0

	I0417 18:00:07.792873   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.794304   83763 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml

	I0417 18:00:07.794404   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.794488   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.794655   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.796351   83763 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0417 18:00:07.796370   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml (934 bytes)

	I0417 18:00:07.797324   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.797910   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.797958   83763 addons.go:426] installing /etc/kubernetes/addons/ig-namespace.yaml

	I0417 18:00:07.798572   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.799721   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.799785   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.799818   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/hostpathplugin:v1.9.0

	I0417 18:00:07.799954   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.800017   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-namespace.yaml (55 bytes)

	I0417 18:00:07.800050   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37359

	I0417 18:00:07.800176   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.801057   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.801453   83763 out.go:177]   - Using image registry.k8s.io/sig-storage/livenessprobe:v2.8.0

	I0417 18:00:07.801472   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.802957   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.803040   83763 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0417 18:00:07.803352   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.803499   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.804069   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.804610   83763 out.go:177]   - Using image nvcr.io/nvidia/k8s-device-plugin:v0.14.5

	I0417 18:00:07.804807   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.804825   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0417 18:00:07.806144   83763 addons.go:426] installing /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0417 18:00:07.806157   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/nvidia-device-plugin.yaml (1966 bytes)

	I0417 18:00:07.806159   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.806175   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.807605   83763 addons.go:426] installing /etc/kubernetes/addons/rbac-external-attacher.yaml

	I0417 18:00:07.804854   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.807655   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.805131   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.809124   83763 out.go:177]   - Using image registry.k8s.io/ingress-nginx/controller:v1.10.0

	I0417 18:00:07.805429   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.806764   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.807626   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-attacher.yaml (3073 bytes)

	I0417 18:00:07.807923   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.808981   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.809514   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.810461   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.810468   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.812131   83763 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0417 18:00:07.810708   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.810722   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.810798   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.811168   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.811186   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.811187   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.811181   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.811205   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.811221   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.815552   83763 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0417 18:00:07.813656   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.813793   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.813813   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.813866   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.813888   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.814145   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.814515   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.816418   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40737

	I0417 18:00:07.817035   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.817411   83763 addons.go:426] installing /etc/kubernetes/addons/ingress-deploy.yaml

	I0417 18:00:07.817436   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ingress-deploy.yaml (16078 bytes)

	I0417 18:00:07.817454   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.817455   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.817568   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.817704   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.817843   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:07.817894   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:07.817958   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.817973   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.818004   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.818123   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.818292   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.818317   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.818334   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.818628   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.818629   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.818665   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.818888   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.818888   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.819069   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.820858   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.821214   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.821246   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.821441   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.821573   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.821714   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.821822   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:07.840248   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36057

	I0417 18:00:07.840700   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:07.841233   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:07.841258   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:07.841607   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:07.841806   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:07.843444   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:07.845711   83763 out.go:177]   - Using image docker.io/busybox:stable

	I0417 18:00:07.847292   83763 out.go:177]   - Using image docker.io/rancher/local-path-provisioner:v0.0.22

	I0417 18:00:07.848929   83763 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0417 18:00:07.848949   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner-rancher.yaml (3113 bytes)

	I0417 18:00:07.848968   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:07.852252   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.852554   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:07.852582   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:07.852826   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:07.853028   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:07.853220   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:07.853391   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:08.292669   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml

	I0417 18:00:08.307834   83763 addons.go:426] installing /etc/kubernetes/addons/metrics-server-deployment.yaml

	I0417 18:00:08.307872   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-deployment.yaml (1907 bytes)

	I0417 18:00:08.308172   83763 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-rbac.yaml

	I0417 18:00:08.308191   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-rbac.yaml (1188 bytes)

	I0417 18:00:08.319946   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0417 18:00:08.329452   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml

	I0417 18:00:08.344347   83763 addons.go:426] installing /etc/kubernetes/addons/yakd-sa.yaml

	I0417 18:00:08.344375   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-sa.yaml (247 bytes)

	I0417 18:00:08.346373   83763 addons.go:426] installing /etc/kubernetes/addons/registry-svc.yaml

	I0417 18:00:08.346389   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-svc.yaml (398 bytes)

	I0417 18:00:08.363330   83763 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:00:08.363401   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0417 18:00:08.365084   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml

	I0417 18:00:08.370630   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml

	I0417 18:00:08.373531   83763 addons.go:426] installing /etc/kubernetes/addons/ig-serviceaccount.yaml

	I0417 18:00:08.373555   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-serviceaccount.yaml (80 bytes)

	I0417 18:00:08.374911   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0417 18:00:08.376367   83763 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml

	I0417 18:00:08.376382   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml (6471 bytes)

	I0417 18:00:08.377750   83763 addons.go:426] installing /etc/kubernetes/addons/rbac-hostpath.yaml

	I0417 18:00:08.377769   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-hostpath.yaml (4266 bytes)

	I0417 18:00:08.441956   83763 addons.go:426] installing /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0417 18:00:08.441980   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/helm-tiller-svc.yaml (951 bytes)

	I0417 18:00:08.456638   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml

	I0417 18:00:08.517963   83763 addons.go:426] installing /etc/kubernetes/addons/registry-proxy.yaml

	I0417 18:00:08.517990   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/registry-proxy.yaml (947 bytes)

	I0417 18:00:08.540826   83763 addons.go:426] installing /etc/kubernetes/addons/metrics-server-rbac.yaml

	I0417 18:00:08.540857   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-rbac.yaml (2175 bytes)

	I0417 18:00:08.641531   83763 addons.go:426] installing /etc/kubernetes/addons/yakd-crb.yaml

	I0417 18:00:08.641557   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-crb.yaml (422 bytes)

	I0417 18:00:08.658949   83763 addons.go:426] installing /etc/kubernetes/addons/ig-role.yaml

	I0417 18:00:08.658985   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-role.yaml (210 bytes)

	I0417 18:00:08.673899   83763 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml

	I0417 18:00:08.673925   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml (23126 bytes)

	I0417 18:00:08.687623   83763 addons.go:426] installing /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml

	I0417 18:00:08.687656   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml (3038 bytes)

	I0417 18:00:08.734822   83763 addons.go:426] installing /etc/kubernetes/addons/yakd-svc.yaml

	I0417 18:00:08.734858   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-svc.yaml (412 bytes)

	I0417 18:00:08.739655   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml

	I0417 18:00:08.807217   83763 addons.go:426] installing /etc/kubernetes/addons/metrics-server-service.yaml

	I0417 18:00:08.807241   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/metrics-server-service.yaml (446 bytes)

	I0417 18:00:08.808648   83763 addons.go:426] installing /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml

	I0417 18:00:08.808664   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml (19582 bytes)

	I0417 18:00:08.855419   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml

	I0417 18:00:08.884019   83763 addons.go:426] installing /etc/kubernetes/addons/yakd-dp.yaml

	I0417 18:00:08.884047   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/yakd-dp.yaml (2017 bytes)

	I0417 18:00:08.895734   83763 addons.go:426] installing /etc/kubernetes/addons/ig-rolebinding.yaml

	I0417 18:00:08.895762   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-rolebinding.yaml (244 bytes)

	I0417 18:00:08.961414   83763 addons.go:426] installing /etc/kubernetes/addons/rbac-external-provisioner.yaml

	I0417 18:00:08.961438   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-provisioner.yaml (4442 bytes)

	I0417 18:00:08.971062   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml

	I0417 18:00:08.985507   83763 addons.go:426] installing /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml

	I0417 18:00:08.985537   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml (3545 bytes)

	I0417 18:00:09.045189   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml

	I0417 18:00:09.209337   83763 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrole.yaml

	I0417 18:00:09.209367   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrole.yaml (1485 bytes)

	I0417 18:00:09.211146   83763 addons.go:426] installing /etc/kubernetes/addons/rbac-external-resizer.yaml

	I0417 18:00:09.211164   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-resizer.yaml (2943 bytes)

	I0417 18:00:09.275331   83763 addons.go:426] installing /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0417 18:00:09.275357   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml (1475 bytes)

	I0417 18:00:09.461726   83763 addons.go:426] installing /etc/kubernetes/addons/ig-clusterrolebinding.yaml

	I0417 18:00:09.461760   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-clusterrolebinding.yaml (274 bytes)

	I0417 18:00:09.470032   83763 addons.go:426] installing /etc/kubernetes/addons/rbac-external-snapshotter.yaml

	I0417 18:00:09.470058   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/rbac-external-snapshotter.yaml (3149 bytes)

	I0417 18:00:09.685762   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0417 18:00:09.693946   83763 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-attacher.yaml

	I0417 18:00:09.693976   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-attacher.yaml (2143 bytes)

	I0417 18:00:09.707668   83763 addons.go:426] installing /etc/kubernetes/addons/ig-crd.yaml

	I0417 18:00:09.707693   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-crd.yaml (5216 bytes)

	I0417 18:00:09.989572   83763 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml

	I0417 18:00:09.989601   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml (1274 bytes)

	I0417 18:00:10.030004   83763 addons.go:426] installing /etc/kubernetes/addons/ig-daemonset.yaml

	I0417 18:00:10.030036   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/ig-daemonset.yaml (7735 bytes)

	I0417 18:00:10.290401   83763 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-plugin.yaml

	I0417 18:00:10.290435   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-plugin.yaml (8201 bytes)

	I0417 18:00:10.341344   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml

	I0417 18:00:10.778028   83763 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-resizer.yaml

	I0417 18:00:10.778057   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-resizer.yaml (2191 bytes)

	I0417 18:00:11.109601   83763 addons.go:426] installing /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0417 18:00:11.109645   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/csi-hostpath-storageclass.yaml (846 bytes)

	I0417 18:00:11.498373   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml

	I0417 18:00:12.184601   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/ingress-dns-pod.yaml: (3.891884923s)

	I0417 18:00:12.184637   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml: (3.864653919s)

	I0417 18:00:12.184674   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:12.184680   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:12.184689   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:12.184690   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:12.185097   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:12.185102   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:12.185163   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:12.185172   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:12.185180   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:12.185102   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:12.185107   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:12.185281   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:12.185293   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:12.185307   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:12.185402   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:12.185414   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:12.185656   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:12.185670   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:12.205788   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:12.205812   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:12.206293   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:12.206325   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:12.206347   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:14.885126   83763 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_application_credentials.json (162 bytes)

	I0417 18:00:14.885167   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:14.888018   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:14.888414   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:14.888447   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:14.888639   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:14.888891   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:14.889073   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:14.889220   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:15.529046   83763 ssh_runner.go:362] scp memory --> /var/lib/minikube/google_cloud_project (12 bytes)

	I0417 18:00:15.674127   83763 addons.go:234] Setting addon gcp-auth=true in "addons-221213"

	I0417 18:00:15.674191   83763 host.go:66] Checking if "addons-221213" exists ...

	I0417 18:00:15.674758   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:15.674807   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:15.689932   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35627

	I0417 18:00:15.690420   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:15.690987   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:15.691020   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:15.691348   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:15.691796   83763 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:00:15.691833   83763 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:00:15.707339   83763 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46211

	I0417 18:00:15.707847   83763 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:00:15.708307   83763 main.go:141] libmachine: Using API Version  1

	I0417 18:00:15.708329   83763 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:00:15.708636   83763 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:00:15.708853   83763 main.go:141] libmachine: (addons-221213) Calling .GetState

	I0417 18:00:15.710375   83763 main.go:141] libmachine: (addons-221213) Calling .DriverName

	I0417 18:00:15.710632   83763 ssh_runner.go:195] Run: cat /var/lib/minikube/google_application_credentials.json

	I0417 18:00:15.710663   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHHostname

	I0417 18:00:15.713057   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:15.713486   83763 main.go:141] libmachine: (addons-221213) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:ca:2d:a2", ip: ""} in network mk-addons-221213: {Iface:virbr1 ExpiryTime:2024-04-17 18:59:29 +0000 UTC Type:0 Mac:52:54:00:ca:2d:a2 Iaid: IPaddr:192.168.39.199 Prefix:24 Hostname:addons-221213 Clientid:01:52:54:00:ca:2d:a2}

	I0417 18:00:15.713516   83763 main.go:141] libmachine: (addons-221213) DBG | domain addons-221213 has defined IP address 192.168.39.199 and MAC address 52:54:00:ca:2d:a2 in network mk-addons-221213

	I0417 18:00:15.713708   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHPort

	I0417 18:00:15.713870   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHKeyPath

	I0417 18:00:15.714040   83763 main.go:141] libmachine: (addons-221213) Calling .GetSSHUsername

	I0417 18:00:15.714172   83763 sshutil.go:53] new ssh client: &{IP:192.168.39.199 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/addons-221213/id_rsa Username:docker}

	I0417 18:00:16.215082   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/ingress-deploy.yaml: (7.885587817s)

	I0417 18:00:16.215133   83763 ssh_runner.go:235] Completed: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -": (7.85168915s)

	I0417 18:00:16.215146   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215161   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215164   83763 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0417 18:00:16.215208   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/nvidia-device-plugin.yaml: (7.85009521s)

	I0417 18:00:16.215147   83763 ssh_runner.go:235] Completed: sudo systemctl start kubelet: (7.851788461s)

	I0417 18:00:16.215255   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215253   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/deployment.yaml: (7.844593356s)

	I0417 18:00:16.215300   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215315   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215321   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml: (7.840391289s)

	I0417 18:00:16.215342   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215354   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215267   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215424   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.215430   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.215439   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.215447   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215458   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215461   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner-rancher.yaml: (7.758800029s)

	I0417 18:00:16.215475   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215483   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215547   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/helm-tiller-dp.yaml -f /etc/kubernetes/addons/helm-tiller-rbac.yaml -f /etc/kubernetes/addons/helm-tiller-svc.yaml: (7.475865401s)

	I0417 18:00:16.215561   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215569   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215632   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/registry-rc.yaml -f /etc/kubernetes/addons/registry-svc.yaml -f /etc/kubernetes/addons/registry-proxy.yaml: (7.36018152s)

	I0417 18:00:16.215650   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.215660   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.215669   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215676   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215701   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/metrics-apiservice.yaml -f /etc/kubernetes/addons/metrics-server-deployment.yaml -f /etc/kubernetes/addons/metrics-server-rbac.yaml -f /etc/kubernetes/addons/metrics-server-service.yaml: (7.244609741s)

	I0417 18:00:16.215717   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215723   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215725   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215731   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215760   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.215791   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.215793   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/yakd-ns.yaml -f /etc/kubernetes/addons/yakd-sa.yaml -f /etc/kubernetes/addons/yakd-crb.yaml -f /etc/kubernetes/addons/yakd-svc.yaml -f /etc/kubernetes/addons/yakd-dp.yaml: (7.170568425s)

	I0417 18:00:16.215798   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.215805   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215807   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.215812   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215816   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.215941   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (6.530136638s)

	W0417 18:00:16.215966   83763 addons.go:452] apply failed, will retry: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0417 18:00:16.215984   83763 retry.go:31] will retry after 307.556952ms: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: Process exited with status 1

	stdout:

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotclasses.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshotcontents.snapshot.storage.k8s.io created

	customresourcedefinition.apiextensions.k8s.io/volumesnapshots.snapshot.storage.k8s.io created

	serviceaccount/snapshot-controller created

	clusterrole.rbac.authorization.k8s.io/snapshot-controller-runner created

	clusterrolebinding.rbac.authorization.k8s.io/snapshot-controller-role created

	role.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	rolebinding.rbac.authorization.k8s.io/snapshot-controller-leaderelection created

	deployment.apps/snapshot-controller created

	stderr:

	error: resource mapping not found for name: "csi-hostpath-snapclass" namespace: "" from "/etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml": no matches for kind "VolumeSnapshotClass" in version "snapshot.storage.k8s.io/v1"

	ensure CRDs are installed first

	I0417 18:00:16.216083   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/ig-namespace.yaml -f /etc/kubernetes/addons/ig-serviceaccount.yaml -f /etc/kubernetes/addons/ig-role.yaml -f /etc/kubernetes/addons/ig-rolebinding.yaml -f /etc/kubernetes/addons/ig-clusterrole.yaml -f /etc/kubernetes/addons/ig-clusterrolebinding.yaml -f /etc/kubernetes/addons/ig-crd.yaml -f /etc/kubernetes/addons/ig-daemonset.yaml: (5.8746854s)

	I0417 18:00:16.216107   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.216116   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.216193   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.216201   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.216259   83763 node_ready.go:35] waiting up to 6m0s for node "addons-221213" to be "Ready" ...

	I0417 18:00:16.216494   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.216524   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.216532   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.216540   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.216547   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.216604   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.216624   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.216630   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.216637   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.216644   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.216686   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.216706   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.216713   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.216720   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.216726   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.217416   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.217443   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.217450   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.217459   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.217465   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.217507   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.217524   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.217530   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.217537   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.217543   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.217785   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.217809   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.217816   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.217834   83763 addons.go:470] Verifying addon metrics-server=true in "addons-221213"

	I0417 18:00:16.219859   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.219868   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.219879   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.219886   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.219912   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.219919   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.220013   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.220034   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.220054   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.220061   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.220069   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.220075   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.220197   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.220207   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.220733   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.220764   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.220783   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.223538   83763 out.go:177] * To access YAKD - Kubernetes Dashboard, wait for Pod to be ready and run the following command:

		minikube -p addons-221213 service yakd-dashboard -n yakd-dashboard

	I0417 18:00:16.220853   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.220875   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.220901   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.220916   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.220938   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.220952   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.221007   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.225016   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.225030   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.225018   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.225027   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.225040   83763 addons.go:470] Verifying addon ingress=true in "addons-221213"

	I0417 18:00:16.225105   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.225114   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.226755   83763 out.go:177] * Verifying ingress addon...

	I0417 18:00:16.225456   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.225481   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:16.228249   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.228270   83763 addons.go:470] Verifying addon registry=true in "addons-221213"

	I0417 18:00:16.229769   83763 out.go:177] * Verifying registry addon...

	I0417 18:00:16.228997   83763 kapi.go:75] Waiting for pod with label "app.kubernetes.io/name=ingress-nginx" in ns "ingress-nginx" ...

	I0417 18:00:16.231957   83763 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=registry" in ns "kube-system" ...

	I0417 18:00:16.283690   83763 node_ready.go:49] node "addons-221213" has status "Ready":"True"

	I0417 18:00:16.283722   83763 node_ready.go:38] duration metric: took 67.442658ms for node "addons-221213" to be "Ready" ...

	I0417 18:00:16.283737   83763 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:00:16.286886   83763 kapi.go:86] Found 2 Pods for label selector kubernetes.io/minikube-addons=registry

	I0417 18:00:16.286909   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:16.287843   83763 kapi.go:86] Found 3 Pods for label selector app.kubernetes.io/name=ingress-nginx

	I0417 18:00:16.287864   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:16.313412   83763 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-cqs49" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:16.326496   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:16.326521   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:16.326960   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:16.326983   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:16.361186   83763 pod_ready.go:92] pod "coredns-7db6d8ff4d-cqs49" in "kube-system" namespace has status "Ready":"True"

	I0417 18:00:16.361213   83763 pod_ready.go:81] duration metric: took 47.771128ms for pod "coredns-7db6d8ff4d-cqs49" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:16.361223   83763 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-ln4cv" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:16.524441   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml

	I0417 18:00:16.720663   83763 kapi.go:248] "coredns" deployment in "kube-system" namespace and "addons-221213" context rescaled to 1 replicas

	I0417 18:00:16.739342   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:16.742997   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:17.237560   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:17.237919   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:17.737831   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:17.738309   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:18.242390   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:18.255817   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:18.339994   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/rbac-external-attacher.yaml -f /etc/kubernetes/addons/rbac-hostpath.yaml -f /etc/kubernetes/addons/rbac-external-health-monitor-controller.yaml -f /etc/kubernetes/addons/rbac-external-provisioner.yaml -f /etc/kubernetes/addons/rbac-external-resizer.yaml -f /etc/kubernetes/addons/rbac-external-snapshotter.yaml -f /etc/kubernetes/addons/csi-hostpath-attacher.yaml -f /etc/kubernetes/addons/csi-hostpath-driverinfo.yaml -f /etc/kubernetes/addons/csi-hostpath-plugin.yaml -f /etc/kubernetes/addons/csi-hostpath-resizer.yaml -f /etc/kubernetes/addons/csi-hostpath-storageclass.yaml: (6.841557884s)

	I0417 18:00:18.340057   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:18.340075   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:18.340080   83763 ssh_runner.go:235] Completed: cat /var/lib/minikube/google_application_credentials.json: (2.629419571s)

	I0417 18:00:18.341963   83763 out.go:177]   - Using image registry.k8s.io/ingress-nginx/kube-webhook-certgen:v1.4.0

	I0417 18:00:18.340409   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:18.340440   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:18.343448   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:18.343471   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:18.343484   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:18.344895   83763 out.go:177]   - Using image gcr.io/k8s-minikube/gcp-auth-webhook:v0.1.2

	I0417 18:00:18.343748   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:18.343784   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:18.346400   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:18.346414   83763 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-ns.yaml

	I0417 18:00:18.346427   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-ns.yaml (700 bytes)

	I0417 18:00:18.346430   83763 addons.go:470] Verifying addon csi-hostpath-driver=true in "addons-221213"

	I0417 18:00:18.348090   83763 out.go:177] * Verifying csi-hostpath-driver addon...

	I0417 18:00:18.350630   83763 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=csi-hostpath-driver" in ns "kube-system" ...

	I0417 18:00:18.441120   83763 kapi.go:86] Found 3 Pods for label selector kubernetes.io/minikube-addons=csi-hostpath-driver

	I0417 18:00:18.441144   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:18.454692   83763 pod_ready.go:102] pod "coredns-7db6d8ff4d-ln4cv" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:18.572745   83763 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-service.yaml

	I0417 18:00:18.572805   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-service.yaml (788 bytes)

	I0417 18:00:18.741446   83763 addons.go:426] installing /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0417 18:00:18.741467   83763 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/gcp-auth-webhook.yaml (5421 bytes)

	I0417 18:00:18.743657   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:18.744735   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:18.844397   83763 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml

	I0417 18:00:18.858563   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:19.239589   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:19.241771   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:19.329907   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply --force -f /etc/kubernetes/addons/csi-hostpath-snapshotclass.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotclasses.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshotcontents.yaml -f /etc/kubernetes/addons/snapshot.storage.k8s.io_volumesnapshots.yaml -f /etc/kubernetes/addons/rbac-volume-snapshot-controller.yaml -f /etc/kubernetes/addons/volume-snapshot-controller-deployment.yaml: (2.805408745s)

	I0417 18:00:19.329977   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:19.329997   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:19.330274   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:19.330292   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:19.330302   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:19.330325   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:19.330387   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:19.330631   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:19.330647   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:19.356832   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:19.737251   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:19.742592   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:19.861305   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:20.141660   83763 ssh_runner.go:235] Completed: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/gcp-auth-ns.yaml -f /etc/kubernetes/addons/gcp-auth-service.yaml -f /etc/kubernetes/addons/gcp-auth-webhook.yaml: (1.297218783s)

	I0417 18:00:20.141714   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:20.141736   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:20.142064   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:20.142082   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:20.142081   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:20.142096   83763 main.go:141] libmachine: Making call to close driver server

	I0417 18:00:20.142104   83763 main.go:141] libmachine: (addons-221213) Calling .Close

	I0417 18:00:20.142367   83763 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:00:20.142390   83763 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:00:20.142398   83763 main.go:141] libmachine: (addons-221213) DBG | Closing plugin on server side

	I0417 18:00:20.143599   83763 addons.go:470] Verifying addon gcp-auth=true in "addons-221213"

	I0417 18:00:20.145548   83763 out.go:177] * Verifying gcp-auth addon...

	I0417 18:00:20.148183   83763 kapi.go:75] Waiting for pod with label "kubernetes.io/minikube-addons=gcp-auth" in ns "gcp-auth" ...

	I0417 18:00:20.170193   83763 kapi.go:86] Found 1 Pods for label selector kubernetes.io/minikube-addons=gcp-auth

	I0417 18:00:20.170215   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:20.236544   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:20.237111   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:20.356088   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:20.652086   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:20.735314   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:20.739439   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:20.859020   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:20.868093   83763 pod_ready.go:102] pod "coredns-7db6d8ff4d-ln4cv" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:21.152608   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:21.237514   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:21.238059   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:21.368059   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:21.653034   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:21.738430   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:21.738589   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:21.859855   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:22.152223   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:22.238207   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:22.238570   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:22.356727   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:22.651910   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:22.737885   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:22.738189   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:22.856872   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:22.868412   83763 pod_ready.go:102] pod "coredns-7db6d8ff4d-ln4cv" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:23.152114   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:23.236364   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:23.237029   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:23.357418   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:23.367877   83763 pod_ready.go:97] pod "coredns-7db6d8ff4d-ln4cv" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:23 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.39.199 HostIPs:[{IP:192.168.39

.199}] PodIP: PodIPs:[] StartTime:2024-04-17 18:00:07 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-04-17 18:00:11 +0000 UTC,FinishedAt:2024-04-17 18:00:21 +0000 UTC,ContainerID:cri-o://93a82e8ca00def14984dc4caf6e1be7b5fd1451ad64a8b14544963c3ea786042,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.1 ImageID:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 ContainerID:cri-o://93a82e8ca00def14984dc4caf6e1be7b5fd1451ad64a8b14544963c3ea786042 Started:0xc0032cb640 AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}

	I0417 18:00:23.367954   83763 pod_ready.go:81] duration metric: took 7.006721849s for pod "coredns-7db6d8ff4d-ln4cv" in "kube-system" namespace to be "Ready" ...

	E0417 18:00:23.367977   83763 pod_ready.go:66] WaitExtra: waitPodCondition: pod "coredns-7db6d8ff4d-ln4cv" in "kube-system" namespace has status phase "Succeeded" (skipping!): {Phase:Succeeded Conditions:[{Type:PodReadyToStartContainers Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:23 +0000 UTC Reason: Message:} {Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason:PodCompleted Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason:PodCompleted Message:} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason:PodCompleted Message:} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2024-04-17 18:00:07 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:192.168.3

9.199 HostIPs:[{IP:192.168.39.199}] PodIP: PodIPs:[] StartTime:2024-04-17 18:00:07 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:coredns State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:0,Signal:0,Reason:Completed,Message:,StartedAt:2024-04-17 18:00:11 +0000 UTC,FinishedAt:2024-04-17 18:00:21 +0000 UTC,ContainerID:cri-o://93a82e8ca00def14984dc4caf6e1be7b5fd1451ad64a8b14544963c3ea786042,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:registry.k8s.io/coredns/coredns:v1.11.1 ImageID:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4 ContainerID:cri-o://93a82e8ca00def14984dc4caf6e1be7b5fd1451ad64a8b14544963c3ea786042 Started:0xc0032cb640 AllocatedResources:map[] Resources:nil}] QOSClass:Burstable EphemeralContainerStatuses:[] Resize: ResourceClaimStatuses:[]}

	I0417 18:00:23.367989   83763 pod_ready.go:78] waiting up to 6m0s for pod "etcd-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.373119   83763 pod_ready.go:92] pod "etcd-addons-221213" in "kube-system" namespace has status "Ready":"True"

	I0417 18:00:23.373142   83763 pod_ready.go:81] duration metric: took 5.137395ms for pod "etcd-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.373155   83763 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.377380   83763 pod_ready.go:92] pod "kube-apiserver-addons-221213" in "kube-system" namespace has status "Ready":"True"

	I0417 18:00:23.377406   83763 pod_ready.go:81] duration metric: took 4.240133ms for pod "kube-apiserver-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.377418   83763 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.382948   83763 pod_ready.go:92] pod "kube-controller-manager-addons-221213" in "kube-system" namespace has status "Ready":"True"

	I0417 18:00:23.382970   83763 pod_ready.go:81] duration metric: took 5.544358ms for pod "kube-controller-manager-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.382985   83763 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-hhwq6" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.394692   83763 pod_ready.go:92] pod "kube-proxy-hhwq6" in "kube-system" namespace has status "Ready":"True"

	I0417 18:00:23.394719   83763 pod_ready.go:81] duration metric: took 11.726344ms for pod "kube-proxy-hhwq6" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.394731   83763 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.652349   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:23.738280   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:23.743410   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:23.766504   83763 pod_ready.go:92] pod "kube-scheduler-addons-221213" in "kube-system" namespace has status "Ready":"True"

	I0417 18:00:23.766536   83763 pod_ready.go:81] duration metric: took 371.795804ms for pod "kube-scheduler-addons-221213" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.766550   83763 pod_ready.go:78] waiting up to 6m0s for pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace to be "Ready" ...

	I0417 18:00:23.856746   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:24.152093   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:24.238344   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:24.238348   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:24.358730   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:24.651450   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:24.737990   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:24.737996   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:24.857213   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:25.152132   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:25.236239   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:25.237443   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:25.360704   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:25.651535   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:25.739126   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:25.740067   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:25.772535   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:25.856372   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:26.152744   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:26.236414   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:26.238344   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:26.356400   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:26.652658   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:26.737046   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:26.737678   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:26.857154   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:27.152211   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:27.250970   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:27.251473   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:27.357424   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:27.652486   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:27.747502   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:27.747526   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:27.786464   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:27.857215   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:28.153301   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:28.238383   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:28.238898   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:28.357017   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:28.652139   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:28.738716   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:28.739401   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:28.858027   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:29.153078   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:29.235956   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:29.237043   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:29.356839   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:29.652315   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:29.737396   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:29.737532   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:29.856596   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:30.152344   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:30.246424   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:30.246720   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:30.272664   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:30.356296   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:30.652155   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:30.743583   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:30.743758   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:30.860699   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:31.152721   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:31.235718   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:31.238445   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:31.361503   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:31.775438   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:31.775610   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:31.775835   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:31.856414   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:32.151912   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:32.240274   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:32.240966   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:32.273512   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:32.429470   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:32.651705   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:32.737294   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:32.739302   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:32.856561   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:33.153159   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:33.236722   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:33.236976   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:33.359820   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:33.652468   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:33.736168   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:33.737294   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:33.861076   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:34.153660   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:34.238316   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:34.238826   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:34.273838   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:34.356783   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:34.652326   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:34.737848   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:34.739018   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:34.858456   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:35.157412   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:35.238317   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:35.239774   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:35.357723   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:35.652592   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:35.736038   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:35.738024   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:35.856277   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:36.152629   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:36.238652   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:36.239329   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:36.280243   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:36.356398   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:36.652186   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:36.737370   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:36.739012   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:36.858418   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:37.152424   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:37.236478   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:37.239423   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:37.356212   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:37.657137   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:37.738914   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:37.739417   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:37.856468   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:38.157820   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:38.236024   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:38.239292   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:38.356971   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:38.652503   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:38.744940   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:38.745533   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:38.780706   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:38.857185   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:39.152271   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:39.248233   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:39.249608   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:39.360348   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:39.652026   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:39.742547   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:39.744865   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:39.856436   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:40.152349   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:40.236537   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:40.238646   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:40.356868   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:40.653044   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:40.737007   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:40.737968   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:40.858084   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:41.152711   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:41.235819   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:41.238039   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:41.274018   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:41.358377   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:41.652564   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:41.740887   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:41.745365   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:41.857534   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:42.152173   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:42.237552   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:42.238502   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:42.356330   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:42.652278   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:42.738576   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:42.738588   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:42.856058   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:43.151794   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:43.237011   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:43.238934   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:43.356000   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:43.651959   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:43.738523   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:43.738592   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:43.773543   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:44.419814   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:44.421638   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:44.425360   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:44.425737   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:44.429811   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:44.652849   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:44.744081   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:44.744696   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:44.856502   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:45.153001   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:45.240574   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:45.241998   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:45.357343   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:45.652416   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:45.742453   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:45.742605   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:45.858676   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:46.155011   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:46.236162   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:46.238848   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:46.274077   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:46.356517   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:46.652078   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:46.739461   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:46.739971   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:46.857208   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:47.152264   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:47.238351   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:47.238447   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:47.356556   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:47.651897   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:47.741952   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:47.743318   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:47.868762   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:48.152847   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:48.239492   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:48.239613   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:48.356560   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:48.652505   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:48.736580   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:48.738278   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:48.773861   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:48.858511   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:49.152486   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:49.237721   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:49.239235   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:49.356225   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:49.652686   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:49.737781   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:49.738324   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:49.865276   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:50.152926   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:50.236841   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:50.236972   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:50.359033   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:50.652402   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:50.739041   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:50.740734   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:50.856913   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:51.152493   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:51.236065   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:51.239024   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:51.274234   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:51.356689   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:51.652571   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:51.735872   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:51.737377   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:51.856277   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:52.151929   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:52.237650   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:52.237843   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:52.356807   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:52.933336   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:52.940395   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:52.941757   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:52.942601   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:53.152037   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:53.237112   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:53.237516   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:53.275465   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:53.356440   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:53.652408   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:53.735143   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:53.736959   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:53.856269   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:54.152455   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:54.237525   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:54.237830   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:54.356566   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:54.652667   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:54.742280   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:54.742316   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:54.856470   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:55.160509   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:55.237128   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:55.237871   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:55.357472   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:55.652283   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:55.740015   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:55.741813   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:55.773298   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:55.856221   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:56.152153   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:56.238683   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:56.239902   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:56.356418   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:56.652527   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:56.736020   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:56.737594   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=registry", current state: Pending: [<nil>]

	I0417 18:00:56.856340   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:57.152611   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:57.237103   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:57.238665   83763 kapi.go:107] duration metric: took 41.006701461s to wait for kubernetes.io/minikube-addons=registry ...

	I0417 18:00:57.356007   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:57.651971   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:57.736721   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:57.775763   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:00:57.856223   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:58.151918   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:58.236331   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:58.357810   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:58.652472   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:58.738887   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:58.856130   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:59.152140   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:59.235857   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:59.355957   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:00:59.651718   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:00:59.736639   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:00:59.856532   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:00.152356   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:00.236511   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:00.273761   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:00.357208   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:00.652049   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:00.736313   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:00.856870   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:01.152025   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:01.236308   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:01.357855   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:01.653193   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:01.739994   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:01.856724   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:02.153103   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:02.237265   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:02.274556   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:02.358378   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:02.654970   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:02.737040   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:02.858044   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:03.152644   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:03.236112   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:03.357287   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:03.652014   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:03.736491   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:03.856803   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:04.152881   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:04.235687   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:04.380805   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:04.652557   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:04.739048   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:04.774232   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:04.856828   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:05.153450   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:05.241351   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:05.356894   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:05.653198   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:05.738568   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:05.857463   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:06.152932   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:06.238636   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:06.356671   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:06.652295   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:06.736855   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:06.774785   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:06.858090   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:07.154162   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:07.236510   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:07.356999   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:07.652396   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:07.735666   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:07.856763   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:08.152946   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:08.235528   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:08.356285   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:08.652658   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:08.736978   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:08.856089   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:09.269191   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:09.269211   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:09.275228   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:09.356485   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:09.652957   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:09.736033   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:09.857632   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:10.152475   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:10.236078   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:10.359997   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:10.653062   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:10.739633   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:10.861330   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:11.151431   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:11.236190   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:11.284546   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:11.356880   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:11.651935   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:11.736848   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:11.855789   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:12.151818   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:12.236996   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:12.641211   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:12.657417   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:12.735811   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:12.870644   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:13.152113   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:13.236923   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:13.358136   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:13.652979   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:13.736138   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:13.774119   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:13.857139   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:14.152643   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:14.237379   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:14.361698   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:14.653717   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:14.739052   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:14.856859   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:15.152734   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:15.235861   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:15.357239   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:15.670130   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:15.738733   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:16.078754   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:16.080901   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:16.152694   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:16.239063   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:16.357510   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:16.652522   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:16.737041   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:16.856914   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:17.151436   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:17.236847   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:17.356730   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:17.657159   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:17.735780   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:17.858852   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:18.152663   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:18.236354   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:18.273685   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:18.358104   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:18.653896   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:18.742080   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:18.856511   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:19.152534   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:19.236577   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:19.365008   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:19.653397   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:19.735584   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:19.856924   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:20.151845   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:20.235593   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:20.276588   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:20.359132   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:20.652404   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:20.736762   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:20.857886   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:21.151722   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:21.236039   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:21.356824   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:21.661605   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:21.735569   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:21.857446   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:22.152766   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:22.236098   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:22.374439   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:22.652304   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:22.736315   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:22.773224   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:22.859009   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:23.153955   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:23.241947   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:23.819022   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:23.820843   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:23.821685   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:23.860943   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:24.152343   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:24.239997   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:24.356280   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:24.652291   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:24.737017   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:24.856316   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:25.152432   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:25.238518   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:25.279142   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:25.357382   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:25.652671   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:25.736065   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:25.856337   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:26.152224   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:26.236800   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:26.356352   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:26.652473   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:26.736457   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:26.858042   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:27.152542   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:27.236284   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:27.358032   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:27.679386   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:27.736862   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:27.772705   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:27.856498   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:28.152160   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:28.236491   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:28.356394   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:28.652325   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:28.736527   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:28.856345   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:29.155145   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:29.239285   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:29.358349   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:29.652600   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:29.736077   83763 kapi.go:96] waiting for pod "app.kubernetes.io/name=ingress-nginx", current state: Pending: [<nil>]

	I0417 18:01:29.774058   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:29.856419   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:30.151902   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:30.237162   83763 kapi.go:107] duration metric: took 1m14.008154314s to wait for app.kubernetes.io/name=ingress-nginx ...

	I0417 18:01:30.356973   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:30.652194   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:30.856198   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:31.151870   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:31.356671   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:31.654533   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:31.774270   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:31.861947   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:32.153471   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:32.357588   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:32.652835   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:32.857157   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:33.153120   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=gcp-auth", current state: Pending: [<nil>]

	I0417 18:01:33.356433   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:33.652597   83763 kapi.go:107] duration metric: took 1m13.504409599s to wait for kubernetes.io/minikube-addons=gcp-auth ...

	I0417 18:01:33.654541   83763 out.go:177] * Your GCP credentials will now be mounted into every pod created in the addons-221213 cluster.

	I0417 18:01:33.656091   83763 out.go:177] * If you don't want your credentials mounted into a specific pod, add a label with the `gcp-auth-skip-secret` key to your pod configuration.

	I0417 18:01:33.657681   83763 out.go:177] * If you want existing pods to be mounted with credentials, either recreate them or rerun addons enable with --refresh.

	I0417 18:01:33.774739   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:33.857192   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:34.356590   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:34.856752   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:35.357445   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:35.856661   83763 kapi.go:96] waiting for pod "kubernetes.io/minikube-addons=csi-hostpath-driver", current state: Pending: [<nil>]

	I0417 18:01:36.278322   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:36.357020   83763 kapi.go:107] duration metric: took 1m18.006387102s to wait for kubernetes.io/minikube-addons=csi-hostpath-driver ...

	I0417 18:01:36.358986   83763 out.go:177] * Enabled addons: ingress-dns, default-storageclass, cloud-spanner, metrics-server, nvidia-device-plugin, storage-provisioner, helm-tiller, yakd, inspektor-gadget, storage-provisioner-rancher, volumesnapshots, registry, ingress, gcp-auth, csi-hostpath-driver

	I0417 18:01:36.360924   83763 addons.go:505] duration metric: took 1m28.717457096s for enable addons: enabled=[ingress-dns default-storageclass cloud-spanner metrics-server nvidia-device-plugin storage-provisioner helm-tiller yakd inspektor-gadget storage-provisioner-rancher volumesnapshots registry ingress gcp-auth csi-hostpath-driver]

	I0417 18:01:38.287976   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:40.774742   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:42.775356   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:45.273347   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:47.276460   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:49.776859   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:52.273411   83763 pod_ready.go:102] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"False"

	I0417 18:01:54.272455   83763 pod_ready.go:92] pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace has status "Ready":"True"

	I0417 18:01:54.272478   83763 pod_ready.go:81] duration metric: took 1m30.505919707s for pod "metrics-server-c59844bb4-qrcnl" in "kube-system" namespace to be "Ready" ...

	I0417 18:01:54.272488   83763 pod_ready.go:78] waiting up to 6m0s for pod "nvidia-device-plugin-daemonset-fvfbv" in "kube-system" namespace to be "Ready" ...

	I0417 18:01:54.277922   83763 pod_ready.go:92] pod "nvidia-device-plugin-daemonset-fvfbv" in "kube-system" namespace has status "Ready":"True"

	I0417 18:01:54.277947   83763 pod_ready.go:81] duration metric: took 5.45011ms for pod "nvidia-device-plugin-daemonset-fvfbv" in "kube-system" namespace to be "Ready" ...

	I0417 18:01:54.277970   83763 pod_ready.go:38] duration metric: took 1m37.994219501s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:01:54.277995   83763 api_server.go:52] waiting for apiserver process to appear ...

	I0417 18:01:54.278035   83763 cri.go:54] listing CRI containers in root : {State:all Name:kube-apiserver Namespaces:[]}

	I0417 18:01:54.278110   83763 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-apiserver

	I0417 18:01:54.336956   83763 cri.go:89] found id: "cf9babaae1a3ac7854b2b01c5cdd905e506f2a809adc62ab6db3c3f5d8a9f879"

	I0417 18:01:54.336979   83763 cri.go:89] found id: ""

	I0417 18:01:54.336988   83763 logs.go:276] 1 containers: [cf9babaae1a3ac7854b2b01c5cdd905e506f2a809adc62ab6db3c3f5d8a9f879]

	I0417 18:01:54.337046   83763 ssh_runner.go:195] Run: which crictl

	I0417 18:01:54.342533   83763 cri.go:54] listing CRI containers in root : {State:all Name:etcd Namespaces:[]}

	I0417 18:01:54.342640   83763 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=etcd

	I0417 18:01:54.401031   83763 cri.go:89] found id: "9987b117a2003402fe49a7e5bb20fa910affa92366b5451e3f242596465464f2"

	I0417 18:01:54.401057   83763 cri.go:89] found id: ""

	I0417 18:01:54.401069   83763 logs.go:276] 1 containers: [9987b117a2003402fe49a7e5bb20fa910affa92366b5451e3f242596465464f2]

	I0417 18:01:54.401128   83763 ssh_runner.go:195] Run: which crictl

	I0417 18:01:54.405543   83763 cri.go:54] listing CRI containers in root : {State:all Name:coredns Namespaces:[]}

	I0417 18:01:54.405612   83763 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=coredns

	I0417 18:01:54.446219   83763 cri.go:89] found id: "983bd1fea4fdd26bbd10c7790739492ea107dfa78e991e2d21983a7601b56bcb"

	I0417 18:01:54.446243   83763 cri.go:89] found id: ""

	I0417 18:01:54.446257   83763 logs.go:276] 1 containers: [983bd1fea4fdd26bbd10c7790739492ea107dfa78e991e2d21983a7601b56bcb]

	I0417 18:01:54.446303   83763 ssh_runner.go:195] Run: which crictl

	I0417 18:01:54.451627   83763 cri.go:54] listing CRI containers in root : {State:all Name:kube-scheduler Namespaces:[]}

	I0417 18:01:54.451701   83763 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-scheduler

	I0417 18:01:54.505930   83763 cri.go:89] found id: "6b0466fba163eb466c2b80ef179cc96b60666c80b6ce424a005b9b70efff33e8"

	I0417 18:01:54.505957   83763 cri.go:89] found id: ""

	I0417 18:01:54.505968   83763 logs.go:276] 1 containers: [6b0466fba163eb466c2b80ef179cc96b60666c80b6ce424a005b9b70efff33e8]

	I0417 18:01:54.506030   83763 ssh_runner.go:195] Run: which crictl

	I0417 18:01:54.511603   83763 cri.go:54] listing CRI containers in root : {State:all Name:kube-proxy Namespaces:[]}

	I0417 18:01:54.511672   83763 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-proxy

	I0417 18:01:54.549301   83763 cri.go:89] found id: "6dc692e41647ec1abe22ed7b48ffb0d2bdd6aabf6752584088a5557ad295a8a6"

	I0417 18:01:54.549324   83763 cri.go:89] found id: ""

	I0417 18:01:54.549332   83763 logs.go:276] 1 containers: [6dc692e41647ec1abe22ed7b48ffb0d2bdd6aabf6752584088a5557ad295a8a6]

	I0417 18:01:54.549384   83763 ssh_runner.go:195] Run: which crictl

	I0417 18:01:54.553919   83763 cri.go:54] listing CRI containers in root : {State:all Name:kube-controller-manager Namespaces:[]}

	I0417 18:01:54.553979   83763 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kube-controller-manager

	I0417 18:01:54.596738   83763 cri.go:89] found id: "2c7aecf3c666f94b144db488c1a1e3ab01e25f9c5ce2d44c0b579223b277ac76"

	I0417 18:01:54.596760   83763 cri.go:89] found id: ""

	I0417 18:01:54.596782   83763 logs.go:276] 1 containers: [2c7aecf3c666f94b144db488c1a1e3ab01e25f9c5ce2d44c0b579223b277ac76]

	I0417 18:01:54.596836   83763 ssh_runner.go:195] Run: which crictl

	I0417 18:01:54.601298   83763 cri.go:54] listing CRI containers in root : {State:all Name:kindnet Namespaces:[]}

	I0417 18:01:54.601359   83763 ssh_runner.go:195] Run: sudo crictl ps -a --quiet --name=kindnet

	I0417 18:01:54.658594   83763 cri.go:89] found id: ""

	I0417 18:01:54.658626   83763 logs.go:276] 0 containers: []

	W0417 18:01:54.658638   83763 logs.go:278] No container was found matching "kindnet"

	I0417 18:01:54.658649   83763 logs.go:123] Gathering logs for kube-apiserver [cf9babaae1a3ac7854b2b01c5cdd905e506f2a809adc62ab6db3c3f5d8a9f879] ...

	I0417 18:01:54.658670   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 cf9babaae1a3ac7854b2b01c5cdd905e506f2a809adc62ab6db3c3f5d8a9f879"

	I0417 18:01:54.712438   83763 logs.go:123] Gathering logs for kube-proxy [6dc692e41647ec1abe22ed7b48ffb0d2bdd6aabf6752584088a5557ad295a8a6] ...

	I0417 18:01:54.712471   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6dc692e41647ec1abe22ed7b48ffb0d2bdd6aabf6752584088a5557ad295a8a6"

	I0417 18:01:54.760822   83763 logs.go:123] Gathering logs for kube-controller-manager [2c7aecf3c666f94b144db488c1a1e3ab01e25f9c5ce2d44c0b579223b277ac76] ...

	I0417 18:01:54.760862   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 2c7aecf3c666f94b144db488c1a1e3ab01e25f9c5ce2d44c0b579223b277ac76"

	I0417 18:01:54.827097   83763 logs.go:123] Gathering logs for container status ...

	I0417 18:01:54.827137   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0417 18:01:54.882084   83763 logs.go:123] Gathering logs for describe nodes ...

	I0417 18:01:54.882126   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0417 18:01:55.026554   83763 logs.go:123] Gathering logs for dmesg ...

	I0417 18:01:55.026589   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0417 18:01:55.046763   83763 logs.go:123] Gathering logs for etcd [9987b117a2003402fe49a7e5bb20fa910affa92366b5451e3f242596465464f2] ...

	I0417 18:01:55.046804   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 9987b117a2003402fe49a7e5bb20fa910affa92366b5451e3f242596465464f2"

	I0417 18:01:55.103680   83763 logs.go:123] Gathering logs for coredns [983bd1fea4fdd26bbd10c7790739492ea107dfa78e991e2d21983a7601b56bcb] ...

	I0417 18:01:55.103715   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 983bd1fea4fdd26bbd10c7790739492ea107dfa78e991e2d21983a7601b56bcb"

	I0417 18:01:55.149009   83763 logs.go:123] Gathering logs for kube-scheduler [6b0466fba163eb466c2b80ef179cc96b60666c80b6ce424a005b9b70efff33e8] ...

	I0417 18:01:55.149047   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo /usr/bin/crictl logs --tail 400 6b0466fba163eb466c2b80ef179cc96b60666c80b6ce424a005b9b70efff33e8"

	I0417 18:01:55.199643   83763 logs.go:123] Gathering logs for CRI-O ...

	I0417 18:01:55.199680   83763 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u crio -n 400"

** /stderr **

addons_test.go:111: out/minikube-linux-amd64 start -p addons-221213 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=kvm2  --container-runtime=crio --addons=ingress --addons=ingress-dns --addons=helm-tiller failed: signal: killed

--- FAIL: TestAddons/Setup (2400.04s)

=== RUN   TestMultiControlPlane/serial/StopSecondaryNode

ha_test.go:363: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 node stop m02 -v=7 --alsologtostderr

E0417 18:54:00.282952   83207 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/functional-169848/client.crt: no such file or directory

E0417 18:54:41.243382   83207 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/functional-169848/client.crt: no such file or directory

ha_test.go:363: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 node stop m02 -v=7 --alsologtostderr: exit status 30 (2m0.504725383s)

-- stdout --

	* Stopping node "ha-467706-m02"  ...

-- /stdout --

** stderr ** 

	I0417 18:53:56.269263   99782 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:53:56.269380   99782 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:53:56.269389   99782 out.go:304] Setting ErrFile to fd 2...

	I0417 18:53:56.269394   99782 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:53:56.269594   99782 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:53:56.269850   99782 mustload.go:65] Loading cluster: ha-467706

	I0417 18:53:56.270212   99782 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:53:56.270234   99782 stop.go:39] StopHost: ha-467706-m02

	I0417 18:53:56.270585   99782 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:53:56.270634   99782 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:53:56.287792   99782 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37629

	I0417 18:53:56.288354   99782 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:53:56.289090   99782 main.go:141] libmachine: Using API Version  1

	I0417 18:53:56.289117   99782 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:53:56.289581   99782 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:53:56.291763   99782 out.go:177] * Stopping node "ha-467706-m02"  ...

	I0417 18:53:56.293124   99782 machine.go:157] backing up vm config to /var/lib/minikube/backup: [/etc/cni /etc/kubernetes]

	I0417 18:53:56.293174   99782 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:53:56.293457   99782 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/backup

	I0417 18:53:56.293506   99782 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:53:56.296960   99782 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:53:56.297514   99782 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:53:56.297553   99782 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:53:56.297759   99782 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:53:56.297961   99782 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:53:56.298139   99782 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:53:56.298460   99782 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:53:56.387906   99782 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/cni /var/lib/minikube/backup

	I0417 18:53:56.445611   99782 ssh_runner.go:195] Run: sudo rsync --archive --relative /etc/kubernetes /var/lib/minikube/backup

	I0417 18:53:56.503252   99782 main.go:141] libmachine: Stopping "ha-467706-m02"...

	I0417 18:53:56.503292   99782 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:53:56.505182   99782 main.go:141] libmachine: (ha-467706-m02) Calling .Stop

	I0417 18:53:56.509346   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 0/120

	I0417 18:53:57.511464   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 1/120

	I0417 18:53:58.513862   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 2/120

	I0417 18:53:59.515894   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 3/120

	I0417 18:54:00.517409   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 4/120

	I0417 18:54:01.519214   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 5/120

	I0417 18:54:02.520801   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 6/120

	I0417 18:54:03.522468   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 7/120

	I0417 18:54:04.524001   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 8/120

	I0417 18:54:05.525463   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 9/120

	I0417 18:54:06.527861   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 10/120

	I0417 18:54:07.529741   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 11/120

	I0417 18:54:08.531101   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 12/120

	I0417 18:54:09.532462   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 13/120

	I0417 18:54:10.534121   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 14/120

	I0417 18:54:11.535488   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 15/120

	I0417 18:54:12.536847   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 16/120

	I0417 18:54:13.538288   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 17/120

	I0417 18:54:14.539890   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 18/120

	I0417 18:54:15.541334   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 19/120

	I0417 18:54:16.543340   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 20/120

	I0417 18:54:17.544849   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 21/120

	I0417 18:54:18.546221   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 22/120

	I0417 18:54:19.547802   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 23/120

	I0417 18:54:20.549331   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 24/120

	I0417 18:54:21.551003   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 25/120

	I0417 18:54:22.552313   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 26/120

	I0417 18:54:23.553601   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 27/120

	I0417 18:54:24.555060   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 28/120

	I0417 18:54:25.557377   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 29/120

	I0417 18:54:26.559497   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 30/120

	I0417 18:54:27.561019   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 31/120

	I0417 18:54:28.562465   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 32/120

	I0417 18:54:29.564183   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 33/120

	I0417 18:54:30.565419   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 34/120

	I0417 18:54:31.567114   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 35/120

	I0417 18:54:32.569399   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 36/120

	I0417 18:54:33.570855   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 37/120

	I0417 18:54:34.572968   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 38/120

	I0417 18:54:35.574375   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 39/120

	I0417 18:54:36.575470   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 40/120

	I0417 18:54:37.576924   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 41/120

	I0417 18:54:38.578402   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 42/120

	I0417 18:54:39.580045   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 43/120

	I0417 18:54:40.581410   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 44/120

	I0417 18:54:41.583418   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 45/120

	I0417 18:54:42.584825   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 46/120

	I0417 18:54:43.586226   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 47/120

	I0417 18:54:44.587859   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 48/120

	I0417 18:54:45.589549   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 49/120

	I0417 18:54:46.591749   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 50/120

	I0417 18:54:47.593202   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 51/120

	I0417 18:54:48.595630   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 52/120

	I0417 18:54:49.596916   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 53/120

	I0417 18:54:50.598220   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 54/120

	I0417 18:54:51.600475   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 55/120

	I0417 18:54:52.602586   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 56/120

	I0417 18:54:53.604317   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 57/120

	I0417 18:54:54.605685   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 58/120

	I0417 18:54:55.607443   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 59/120

	I0417 18:54:56.609768   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 60/120

	I0417 18:54:57.611452   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 61/120

	I0417 18:54:58.612855   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 62/120

	I0417 18:54:59.614236   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 63/120

	I0417 18:55:00.615850   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 64/120

	I0417 18:55:01.617854   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 65/120

	I0417 18:55:02.619530   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 66/120

	I0417 18:55:03.621009   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 67/120

	I0417 18:55:04.623306   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 68/120

	I0417 18:55:05.625042   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 69/120

	I0417 18:55:06.626929   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 70/120

	I0417 18:55:07.628684   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 71/120

	I0417 18:55:08.630279   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 72/120

	I0417 18:55:09.632547   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 73/120

	I0417 18:55:10.633907   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 74/120

	I0417 18:55:11.636003   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 75/120

	I0417 18:55:12.637790   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 76/120

	I0417 18:55:13.639315   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 77/120

	I0417 18:55:14.640690   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 78/120

	I0417 18:55:15.642694   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 79/120

	I0417 18:55:16.644079   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 80/120

	I0417 18:55:17.646130   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 81/120

	I0417 18:55:18.647751   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 82/120

	I0417 18:55:19.649134   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 83/120

	I0417 18:55:20.650828   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 84/120

	I0417 18:55:21.653006   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 85/120

	I0417 18:55:22.654322   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 86/120

	I0417 18:55:23.655779   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 87/120

	I0417 18:55:24.657156   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 88/120

	I0417 18:55:25.658760   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 89/120

	I0417 18:55:26.660822   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 90/120

	I0417 18:55:27.662170   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 91/120

	I0417 18:55:28.663647   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 92/120

	I0417 18:55:29.665306   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 93/120

	I0417 18:55:30.667682   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 94/120

	I0417 18:55:31.669646   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 95/120

	I0417 18:55:32.671360   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 96/120

	I0417 18:55:33.672582   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 97/120

	I0417 18:55:34.674243   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 98/120

	I0417 18:55:35.676378   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 99/120

	I0417 18:55:36.678794   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 100/120

	I0417 18:55:37.680352   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 101/120

	I0417 18:55:38.682598   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 102/120

	I0417 18:55:39.683954   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 103/120

	I0417 18:55:40.686023   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 104/120

	I0417 18:55:41.688078   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 105/120

	I0417 18:55:42.689391   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 106/120

	I0417 18:55:43.691933   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 107/120

	I0417 18:55:44.693574   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 108/120

	I0417 18:55:45.695077   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 109/120

	I0417 18:55:46.697605   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 110/120

	I0417 18:55:47.699547   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 111/120

	I0417 18:55:48.701034   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 112/120

	I0417 18:55:49.703441   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 113/120

	I0417 18:55:50.704917   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 114/120

	I0417 18:55:51.706197   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 115/120

	I0417 18:55:52.707680   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 116/120

	I0417 18:55:53.710106   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 117/120

	I0417 18:55:54.712293   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 118/120

	I0417 18:55:55.713687   99782 main.go:141] libmachine: (ha-467706-m02) Waiting for machine to stop 119/120

	I0417 18:55:56.714245   99782 stop.go:66] stop err: unable to stop vm, current state "Running"

	W0417 18:55:56.714467   99782 out.go:239] X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

	X Failed to stop node m02: Temporary Error: stop: unable to stop vm, current state "Running"

** /stderr **

ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-linux-amd64 -p ha-467706 node stop m02 -v=7 --alsologtostderr": exit status 30

ha_test.go:369: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

E0417 18:56:03.164038   83207 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/functional-169848/client.crt: no such file or directory

ha_test.go:369: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 3 (19.117911745s)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:55:56.772138  100087 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:55:56.772290  100087 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:55:56.772302  100087 out.go:304] Setting ErrFile to fd 2...

	I0417 18:55:56.772308  100087 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:55:56.772537  100087 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:55:56.772748  100087 out.go:298] Setting JSON to false

	I0417 18:55:56.772795  100087 mustload.go:65] Loading cluster: ha-467706

	I0417 18:55:56.772831  100087 notify.go:220] Checking for updates...

	I0417 18:55:56.774188  100087 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:55:56.774239  100087 status.go:255] checking status of ha-467706 ...

	I0417 18:55:56.775138  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:55:56.775217  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:55:56.790953  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33787

	I0417 18:55:56.791377  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:55:56.792214  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:55:56.792243  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:55:56.792622  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:55:56.792830  100087 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:55:56.794736  100087 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:55:56.794757  100087 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:55:56.795082  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:55:56.795159  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:55:56.810262  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35027

	I0417 18:55:56.810637  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:55:56.811096  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:55:56.811117  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:55:56.811411  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:55:56.811608  100087 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:55:56.814223  100087 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:55:56.814677  100087 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:55:56.814711  100087 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:55:56.814839  100087 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:55:56.815117  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:55:56.815157  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:55:56.830385  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40041

	I0417 18:55:56.830772  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:55:56.831179  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:55:56.831200  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:55:56.831626  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:55:56.831848  100087 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:55:56.832054  100087 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:55:56.832082  100087 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:55:56.834751  100087 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:55:56.835113  100087 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:55:56.835136  100087 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:55:56.835318  100087 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:55:56.835507  100087 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:55:56.835679  100087 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:55:56.835809  100087 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:55:56.920293  100087 ssh_runner.go:195] Run: systemctl --version

	I0417 18:55:56.928101  100087 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:55:56.947386  100087 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:55:56.947424  100087 api_server.go:166] Checking apiserver status ...

	I0417 18:55:56.947461  100087 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:55:56.966181  100087 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:55:56.978350  100087 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:55:56.978419  100087 ssh_runner.go:195] Run: ls

	I0417 18:55:56.983561  100087 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:55:56.987859  100087 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:55:56.987885  100087 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:55:56.987895  100087 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:55:56.987919  100087 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:55:56.988237  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:55:56.988278  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:55:57.004413  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42593

	I0417 18:55:57.004946  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:55:57.005536  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:55:57.005567  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:55:57.005951  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:55:57.006160  100087 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:55:57.007798  100087 status.go:330] ha-467706-m02 host status = "Running" (err=<nil>)

	I0417 18:55:57.007818  100087 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:55:57.008106  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:55:57.008142  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:55:57.023441  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36691

	I0417 18:55:57.023879  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:55:57.024467  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:55:57.024498  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:55:57.024959  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:55:57.025186  100087 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:55:57.028106  100087 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:55:57.028484  100087 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:55:57.028521  100087 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:55:57.028702  100087 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:55:57.029064  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:55:57.029104  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:55:57.043779  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40345

	I0417 18:55:57.044141  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:55:57.044628  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:55:57.044649  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:55:57.045053  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:55:57.045267  100087 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:55:57.045447  100087 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:55:57.045467  100087 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:55:57.047909  100087 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:55:57.048349  100087 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:55:57.048383  100087 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:55:57.048528  100087 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:55:57.048711  100087 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:55:57.048874  100087 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:55:57.049040  100087 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	W0417 18:56:15.437013  100087 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:15.437122  100087 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	E0417 18:56:15.437143  100087 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:15.437155  100087 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0417 18:56:15.437219  100087 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:15.437227  100087 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:56:15.437631  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:15.437707  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:15.453506  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46437

	I0417 18:56:15.454025  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:15.454580  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:56:15.454610  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:15.454948  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:15.455157  100087 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:56:15.456795  100087 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:56:15.456814  100087 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:15.457113  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:15.457185  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:15.472223  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34107

	I0417 18:56:15.472706  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:15.473304  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:56:15.473328  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:15.473753  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:15.473981  100087 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:56:15.476591  100087 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:15.477034  100087 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:15.477062  100087 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:15.477166  100087 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:15.477521  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:15.477572  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:15.492617  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35449

	I0417 18:56:15.493124  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:15.493665  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:56:15.493688  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:15.494023  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:15.494244  100087 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:56:15.494473  100087 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:15.494497  100087 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:56:15.497473  100087 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:15.497892  100087 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:15.497919  100087 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:15.498111  100087 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:56:15.498301  100087 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:56:15.498499  100087 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:56:15.498689  100087 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:56:15.591845  100087 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:15.612347  100087 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:15.612378  100087 api_server.go:166] Checking apiserver status ...

	I0417 18:56:15.612410  100087 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:15.636598  100087 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:56:15.648865  100087 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:15.648936  100087 ssh_runner.go:195] Run: ls

	I0417 18:56:15.654481  100087 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:15.661961  100087 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:15.661994  100087 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:56:15.662007  100087 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:15.662027  100087 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:56:15.662382  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:15.662433  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:15.677706  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38053

	I0417 18:56:15.678241  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:15.678790  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:56:15.678820  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:15.679147  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:15.679345  100087 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:56:15.681128  100087 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:56:15.681144  100087 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:15.681496  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:15.681535  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:15.696846  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45705

	I0417 18:56:15.697318  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:15.697822  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:56:15.697848  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:15.698249  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:15.698440  100087 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:56:15.701355  100087 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:15.701794  100087 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:15.701829  100087 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:15.701980  100087 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:15.702276  100087 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:15.702327  100087 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:15.718344  100087 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34385

	I0417 18:56:15.718813  100087 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:15.719368  100087 main.go:141] libmachine: Using API Version  1

	I0417 18:56:15.719388  100087 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:15.719700  100087 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:15.719883  100087 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:56:15.720088  100087 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:15.720111  100087 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:56:15.722767  100087 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:15.723192  100087 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:15.723229  100087 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:15.723388  100087 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:56:15.723545  100087 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:56:15.723658  100087 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:56:15.723816  100087 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:56:15.811271  100087 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:15.831819  100087 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:372: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr" : exit status 3

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-467706 -n ha-467706

helpers_test.go:244: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/StopSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-467706 logs -n 25: (1.599575034s)

helpers_test.go:252: TestMultiControlPlane/serial/StopSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|----------------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   |    Version     |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|----------------|---------------------|---------------------|

	| cp      | ha-467706 cp ha-467706-m03:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile2860960912/001/cp-test_ha-467706-m03.txt |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m03:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706:/home/docker/cp-test_ha-467706-m03_ha-467706.txt                       |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706 sudo cat                                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m03_ha-467706.txt                                 |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m03:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m02:/home/docker/cp-test_ha-467706-m03_ha-467706-m02.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m02 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m03_ha-467706-m02.txt                             |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m03:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04:/home/docker/cp-test_ha-467706-m03_ha-467706-m04.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m04 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m03_ha-467706-m04.txt                             |           |         |                |                     |                     |

	| cp      | ha-467706 cp testdata/cp-test.txt                                                | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04:/home/docker/cp-test.txt                                           |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile2860960912/001/cp-test_ha-467706-m04.txt |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706:/home/docker/cp-test_ha-467706-m04_ha-467706.txt                       |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706 sudo cat                                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m04_ha-467706.txt                                 |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m02:/home/docker/cp-test_ha-467706-m04_ha-467706-m02.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m02 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m04_ha-467706-m02.txt                             |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03:/home/docker/cp-test_ha-467706-m04_ha-467706-m03.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m03 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m04_ha-467706-m03.txt                             |           |         |                |                     |                     |

	| node    | ha-467706 node stop m02 -v=7                                                     | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |                |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|----------------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/04/17 18:49:22

	Running on machine: ubuntu-20-agent-7

	Binary: Built with gc go1.22.1 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0417 18:49:22.621343   96006 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:49:22.621632   96006 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:49:22.621642   96006 out.go:304] Setting ErrFile to fd 2...

	I0417 18:49:22.621647   96006 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:49:22.621840   96006 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:49:22.622485   96006 out.go:298] Setting JSON to false

	I0417 18:49:22.623337   96006 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":9111,"bootTime":1713370652,"procs":173,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0417 18:49:22.623412   96006 start.go:139] virtualization: kvm guest

	I0417 18:49:22.625735   96006 out.go:177] * [ha-467706] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)

	I0417 18:49:22.627418   96006 out.go:177]   - MINIKUBE_LOCATION=18665

	I0417 18:49:22.629062   96006 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0417 18:49:22.627413   96006 notify.go:220] Checking for updates...

	I0417 18:49:22.630766   96006 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:49:22.632309   96006 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:49:22.633783   96006 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0417 18:49:22.635377   96006 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0417 18:49:22.636911   96006 driver.go:392] Setting default libvirt URI to qemu:///system

	I0417 18:49:22.672838   96006 out.go:177] * Using the kvm2 driver based on user configuration

	I0417 18:49:22.674139   96006 start.go:297] selected driver: kvm2

	I0417 18:49:22.674151   96006 start.go:901] validating driver "kvm2" against <nil>

	I0417 18:49:22.674166   96006 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0417 18:49:22.674857   96006 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0417 18:49:22.674927   96006 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18665-75973/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0417 18:49:22.690558   96006 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0

	I0417 18:49:22.690619   96006 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0417 18:49:22.690882   96006 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0417 18:49:22.691013   96006 cni.go:84] Creating CNI manager for ""

	I0417 18:49:22.691030   96006 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0417 18:49:22.691039   96006 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0417 18:49:22.691121   96006 start.go:340] cluster config:

	{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio

CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHA

gentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:49:22.691296   96006 iso.go:125] acquiring lock: {Name:mkb4c46d9d11025607234f0b50f29e48600415ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0417 18:49:22.693487   96006 out.go:177] * Starting "ha-467706" primary control-plane node in "ha-467706" cluster

	I0417 18:49:22.694987   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:49:22.695039   96006 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4

	I0417 18:49:22.695047   96006 cache.go:56] Caching tarball of preloaded images

	I0417 18:49:22.695149   96006 preload.go:173] Found /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0417 18:49:22.695174   96006 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0-rc.2 on crio

	I0417 18:49:22.695683   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:49:22.695728   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json: {Name:mk22dabb72a30759b87fd992aca98de3628495f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:22.695916   96006 start.go:360] acquireMachinesLock for ha-467706: {Name:mk477aec4c276e4d91f705836ed4842912dfe2c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0417 18:49:22.695957   96006 start.go:364] duration metric: took 24.804µs to acquireMachinesLock for "ha-467706"

	I0417 18:49:22.695978   96006 start.go:93] Provisioning new machine with config: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:49:22.696064   96006 start.go:125] createHost starting for "" (driver="kvm2")

	I0417 18:49:22.697982   96006 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0417 18:49:22.698141   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:49:22.698192   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:49:22.713521   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42335

	I0417 18:49:22.714905   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:49:22.715477   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:49:22.715503   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:49:22.715863   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:49:22.716093   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:22.716258   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:22.716442   96006 start.go:159] libmachine.API.Create for "ha-467706" (driver="kvm2")

	I0417 18:49:22.716465   96006 client.go:168] LocalClient.Create starting

	I0417 18:49:22.716497   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem

	I0417 18:49:22.716531   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:49:22.716546   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:49:22.716601   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem

	I0417 18:49:22.716619   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:49:22.716649   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:49:22.716665   96006 main.go:141] libmachine: Running pre-create checks...

	I0417 18:49:22.716674   96006 main.go:141] libmachine: (ha-467706) Calling .PreCreateCheck

	I0417 18:49:22.717100   96006 main.go:141] libmachine: (ha-467706) Calling .GetConfigRaw

	I0417 18:49:22.717515   96006 main.go:141] libmachine: Creating machine...

	I0417 18:49:22.717530   96006 main.go:141] libmachine: (ha-467706) Calling .Create

	I0417 18:49:22.717669   96006 main.go:141] libmachine: (ha-467706) Creating KVM machine...

	I0417 18:49:22.719151   96006 main.go:141] libmachine: (ha-467706) DBG | found existing default KVM network

	I0417 18:49:22.719847   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:22.719679   96029 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ac0}

	I0417 18:49:22.719880   96006 main.go:141] libmachine: (ha-467706) DBG | created network xml: 

	I0417 18:49:22.719893   96006 main.go:141] libmachine: (ha-467706) DBG | <network>

	I0417 18:49:22.719903   96006 main.go:141] libmachine: (ha-467706) DBG |   <name>mk-ha-467706</name>

	I0417 18:49:22.719910   96006 main.go:141] libmachine: (ha-467706) DBG |   <dns enable='no'/>

	I0417 18:49:22.719918   96006 main.go:141] libmachine: (ha-467706) DBG |   

	I0417 18:49:22.719930   96006 main.go:141] libmachine: (ha-467706) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0417 18:49:22.719948   96006 main.go:141] libmachine: (ha-467706) DBG |     <dhcp>

	I0417 18:49:22.719957   96006 main.go:141] libmachine: (ha-467706) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0417 18:49:22.719970   96006 main.go:141] libmachine: (ha-467706) DBG |     </dhcp>

	I0417 18:49:22.719982   96006 main.go:141] libmachine: (ha-467706) DBG |   </ip>

	I0417 18:49:22.719991   96006 main.go:141] libmachine: (ha-467706) DBG |   

	I0417 18:49:22.719999   96006 main.go:141] libmachine: (ha-467706) DBG | </network>

	I0417 18:49:22.720008   96006 main.go:141] libmachine: (ha-467706) DBG | 

	I0417 18:49:22.725332   96006 main.go:141] libmachine: (ha-467706) DBG | trying to create private KVM network mk-ha-467706 192.168.39.0/24...

	I0417 18:49:22.793280   96006 main.go:141] libmachine: (ha-467706) DBG | private KVM network mk-ha-467706 192.168.39.0/24 created

	I0417 18:49:22.793320   96006 main.go:141] libmachine: (ha-467706) Setting up store path in /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706 ...

	I0417 18:49:22.793340   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:22.793255   96029 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:49:22.793359   96006 main.go:141] libmachine: (ha-467706) Building disk image from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso

	I0417 18:49:22.793504   96006 main.go:141] libmachine: (ha-467706) Downloading /home/jenkins/minikube-integration/18665-75973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...

	I0417 18:49:23.035075   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:23.034912   96029 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa...

	I0417 18:49:23.188428   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:23.188292   96029 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/ha-467706.rawdisk...

	I0417 18:49:23.188457   96006 main.go:141] libmachine: (ha-467706) DBG | Writing magic tar header

	I0417 18:49:23.188493   96006 main.go:141] libmachine: (ha-467706) DBG | Writing SSH key tar header

	I0417 18:49:23.188535   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:23.188433   96029 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706 ...

	I0417 18:49:23.188563   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706

	I0417 18:49:23.188608   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706 (perms=drwx------)

	I0417 18:49:23.188626   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines (perms=drwxr-xr-x)

	I0417 18:49:23.188635   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube (perms=drwxr-xr-x)

	I0417 18:49:23.188645   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973 (perms=drwxrwxr-x)

	I0417 18:49:23.188657   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0417 18:49:23.188664   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines

	I0417 18:49:23.188698   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0417 18:49:23.188716   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:49:23.188722   96006 main.go:141] libmachine: (ha-467706) Creating domain...

	I0417 18:49:23.188733   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973

	I0417 18:49:23.188744   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0417 18:49:23.188761   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins

	I0417 18:49:23.188787   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home

	I0417 18:49:23.188798   96006 main.go:141] libmachine: (ha-467706) DBG | Skipping /home - not owner

	I0417 18:49:23.190017   96006 main.go:141] libmachine: (ha-467706) define libvirt domain using xml: 

	I0417 18:49:23.190033   96006 main.go:141] libmachine: (ha-467706) <domain type='kvm'>

	I0417 18:49:23.190039   96006 main.go:141] libmachine: (ha-467706)   <name>ha-467706</name>

	I0417 18:49:23.190044   96006 main.go:141] libmachine: (ha-467706)   <memory unit='MiB'>2200</memory>

	I0417 18:49:23.190049   96006 main.go:141] libmachine: (ha-467706)   <vcpu>2</vcpu>

	I0417 18:49:23.190054   96006 main.go:141] libmachine: (ha-467706)   <features>

	I0417 18:49:23.190059   96006 main.go:141] libmachine: (ha-467706)     <acpi/>

	I0417 18:49:23.190067   96006 main.go:141] libmachine: (ha-467706)     <apic/>

	I0417 18:49:23.190072   96006 main.go:141] libmachine: (ha-467706)     <pae/>

	I0417 18:49:23.190086   96006 main.go:141] libmachine: (ha-467706)     

	I0417 18:49:23.190091   96006 main.go:141] libmachine: (ha-467706)   </features>

	I0417 18:49:23.190098   96006 main.go:141] libmachine: (ha-467706)   <cpu mode='host-passthrough'>

	I0417 18:49:23.190103   96006 main.go:141] libmachine: (ha-467706)   

	I0417 18:49:23.190110   96006 main.go:141] libmachine: (ha-467706)   </cpu>

	I0417 18:49:23.190115   96006 main.go:141] libmachine: (ha-467706)   <os>

	I0417 18:49:23.190136   96006 main.go:141] libmachine: (ha-467706)     <type>hvm</type>

	I0417 18:49:23.190145   96006 main.go:141] libmachine: (ha-467706)     <boot dev='cdrom'/>

	I0417 18:49:23.190149   96006 main.go:141] libmachine: (ha-467706)     <boot dev='hd'/>

	I0417 18:49:23.190154   96006 main.go:141] libmachine: (ha-467706)     <bootmenu enable='no'/>

	I0417 18:49:23.190161   96006 main.go:141] libmachine: (ha-467706)   </os>

	I0417 18:49:23.190166   96006 main.go:141] libmachine: (ha-467706)   <devices>

	I0417 18:49:23.190182   96006 main.go:141] libmachine: (ha-467706)     <disk type='file' device='cdrom'>

	I0417 18:49:23.190196   96006 main.go:141] libmachine: (ha-467706)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/boot2docker.iso'/>

	I0417 18:49:23.190209   96006 main.go:141] libmachine: (ha-467706)       <target dev='hdc' bus='scsi'/>

	I0417 18:49:23.190242   96006 main.go:141] libmachine: (ha-467706)       <readonly/>

	I0417 18:49:23.190268   96006 main.go:141] libmachine: (ha-467706)     </disk>

	I0417 18:49:23.190284   96006 main.go:141] libmachine: (ha-467706)     <disk type='file' device='disk'>

	I0417 18:49:23.190297   96006 main.go:141] libmachine: (ha-467706)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0417 18:49:23.190312   96006 main.go:141] libmachine: (ha-467706)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/ha-467706.rawdisk'/>

	I0417 18:49:23.190324   96006 main.go:141] libmachine: (ha-467706)       <target dev='hda' bus='virtio'/>

	I0417 18:49:23.190351   96006 main.go:141] libmachine: (ha-467706)     </disk>

	I0417 18:49:23.190371   96006 main.go:141] libmachine: (ha-467706)     <interface type='network'>

	I0417 18:49:23.190381   96006 main.go:141] libmachine: (ha-467706)       <source network='mk-ha-467706'/>

	I0417 18:49:23.190392   96006 main.go:141] libmachine: (ha-467706)       <model type='virtio'/>

	I0417 18:49:23.190400   96006 main.go:141] libmachine: (ha-467706)     </interface>

	I0417 18:49:23.190409   96006 main.go:141] libmachine: (ha-467706)     <interface type='network'>

	I0417 18:49:23.190418   96006 main.go:141] libmachine: (ha-467706)       <source network='default'/>

	I0417 18:49:23.190423   96006 main.go:141] libmachine: (ha-467706)       <model type='virtio'/>

	I0417 18:49:23.190430   96006 main.go:141] libmachine: (ha-467706)     </interface>

	I0417 18:49:23.190435   96006 main.go:141] libmachine: (ha-467706)     <serial type='pty'>

	I0417 18:49:23.190444   96006 main.go:141] libmachine: (ha-467706)       <target port='0'/>

	I0417 18:49:23.190450   96006 main.go:141] libmachine: (ha-467706)     </serial>

	I0417 18:49:23.190455   96006 main.go:141] libmachine: (ha-467706)     <console type='pty'>

	I0417 18:49:23.190463   96006 main.go:141] libmachine: (ha-467706)       <target type='serial' port='0'/>

	I0417 18:49:23.190468   96006 main.go:141] libmachine: (ha-467706)     </console>

	I0417 18:49:23.190475   96006 main.go:141] libmachine: (ha-467706)     <rng model='virtio'>

	I0417 18:49:23.190481   96006 main.go:141] libmachine: (ha-467706)       <backend model='random'>/dev/random</backend>

	I0417 18:49:23.190488   96006 main.go:141] libmachine: (ha-467706)     </rng>

	I0417 18:49:23.190493   96006 main.go:141] libmachine: (ha-467706)     

	I0417 18:49:23.190503   96006 main.go:141] libmachine: (ha-467706)     

	I0417 18:49:23.190512   96006 main.go:141] libmachine: (ha-467706)   </devices>

	I0417 18:49:23.190527   96006 main.go:141] libmachine: (ha-467706) </domain>

	I0417 18:49:23.190535   96006 main.go:141] libmachine: (ha-467706) 

	I0417 18:49:23.194869   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:02:89:fa in network default

	I0417 18:49:23.195525   96006 main.go:141] libmachine: (ha-467706) Ensuring networks are active...

	I0417 18:49:23.195544   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:23.196256   96006 main.go:141] libmachine: (ha-467706) Ensuring network default is active

	I0417 18:49:23.196508   96006 main.go:141] libmachine: (ha-467706) Ensuring network mk-ha-467706 is active

	I0417 18:49:23.196986   96006 main.go:141] libmachine: (ha-467706) Getting domain xml...

	I0417 18:49:23.197668   96006 main.go:141] libmachine: (ha-467706) Creating domain...

	I0417 18:49:24.377122   96006 main.go:141] libmachine: (ha-467706) Waiting to get IP...

	I0417 18:49:24.378185   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:24.378610   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:24.378673   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:24.378570   96029 retry.go:31] will retry after 187.650817ms: waiting for machine to come up

	I0417 18:49:24.568112   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:24.568585   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:24.568610   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:24.568519   96029 retry.go:31] will retry after 263.565831ms: waiting for machine to come up

	I0417 18:49:24.834051   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:24.834456   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:24.834493   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:24.834423   96029 retry.go:31] will retry after 431.588458ms: waiting for machine to come up

	I0417 18:49:25.268032   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:25.268496   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:25.268516   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:25.268462   96029 retry.go:31] will retry after 586.894254ms: waiting for machine to come up

	I0417 18:49:25.857433   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:25.857951   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:25.857983   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:25.857879   96029 retry.go:31] will retry after 478.597863ms: waiting for machine to come up

	I0417 18:49:26.337567   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:26.337946   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:26.337971   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:26.337906   96029 retry.go:31] will retry after 722.019817ms: waiting for machine to come up

	I0417 18:49:27.061866   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:27.062146   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:27.062192   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:27.062092   96029 retry.go:31] will retry after 901.648194ms: waiting for machine to come up

	I0417 18:49:27.965748   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:27.966079   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:27.966102   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:27.966048   96029 retry.go:31] will retry after 954.18526ms: waiting for machine to come up

	I0417 18:49:28.921955   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:28.922298   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:28.922330   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:28.922239   96029 retry.go:31] will retry after 1.478334758s: waiting for machine to come up

	I0417 18:49:30.401822   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:30.402348   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:30.402377   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:30.402273   96029 retry.go:31] will retry after 2.24649483s: waiting for machine to come up

	I0417 18:49:32.651659   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:32.652032   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:32.652060   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:32.651979   96029 retry.go:31] will retry after 2.647468116s: waiting for machine to come up

	I0417 18:49:35.302402   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:35.302798   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:35.302829   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:35.302749   96029 retry.go:31] will retry after 2.438483753s: waiting for machine to come up

	I0417 18:49:37.743278   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:37.743704   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:37.743739   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:37.743648   96029 retry.go:31] will retry after 3.206013787s: waiting for machine to come up

	I0417 18:49:40.953078   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:40.953481   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:40.953510   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:40.953465   96029 retry.go:31] will retry after 4.754103915s: waiting for machine to come up

	I0417 18:49:45.711373   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.711801   96006 main.go:141] libmachine: (ha-467706) Found IP for machine: 192.168.39.159

	I0417 18:49:45.711825   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has current primary IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.711832   96006 main.go:141] libmachine: (ha-467706) Reserving static IP address...

	I0417 18:49:45.712231   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find host DHCP lease matching {name: "ha-467706", mac: "52:54:00:3b:c1:55", ip: "192.168.39.159"} in network mk-ha-467706

	I0417 18:49:45.790706   96006 main.go:141] libmachine: (ha-467706) Reserved static IP address: 192.168.39.159

	I0417 18:49:45.790759   96006 main.go:141] libmachine: (ha-467706) Waiting for SSH to be available...

	I0417 18:49:45.790772   96006 main.go:141] libmachine: (ha-467706) DBG | Getting to WaitForSSH function...

	I0417 18:49:45.793775   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.794200   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:minikube Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:45.794236   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.794395   96006 main.go:141] libmachine: (ha-467706) DBG | Using SSH client type: external

	I0417 18:49:45.794422   96006 main.go:141] libmachine: (ha-467706) DBG | Using SSH private key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa (-rw-------)

	I0417 18:49:45.794455   96006 main.go:141] libmachine: (ha-467706) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.159 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0417 18:49:45.794471   96006 main.go:141] libmachine: (ha-467706) DBG | About to run SSH command:

	I0417 18:49:45.794484   96006 main.go:141] libmachine: (ha-467706) DBG | exit 0

	I0417 18:49:45.917151   96006 main.go:141] libmachine: (ha-467706) DBG | SSH cmd err, output: <nil>: 

	I0417 18:49:45.917423   96006 main.go:141] libmachine: (ha-467706) KVM machine creation complete!

	I0417 18:49:45.917783   96006 main.go:141] libmachine: (ha-467706) Calling .GetConfigRaw

	I0417 18:49:45.918347   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:45.918561   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:45.918782   96006 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0417 18:49:45.918799   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:49:45.920179   96006 main.go:141] libmachine: Detecting operating system of created instance...

	I0417 18:49:45.920196   96006 main.go:141] libmachine: Waiting for SSH to be available...

	I0417 18:49:45.920204   96006 main.go:141] libmachine: Getting to WaitForSSH function...

	I0417 18:49:45.920218   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:45.922787   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.923202   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:45.923230   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.923388   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:45.923626   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:45.923791   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:45.923975   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:45.924120   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:45.924416   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:45.924434   96006 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0417 18:49:46.020232   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:49:46.020256   96006 main.go:141] libmachine: Detecting the provisioner...

	I0417 18:49:46.020267   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.023222   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.023614   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.023642   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.023856   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.024087   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.024295   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.024474   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.024674   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.024895   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.024909   96006 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0417 18:49:46.122008   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0417 18:49:46.122077   96006 main.go:141] libmachine: found compatible host: buildroot

	I0417 18:49:46.122084   96006 main.go:141] libmachine: Provisioning with buildroot...

	I0417 18:49:46.122093   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:46.122346   96006 buildroot.go:166] provisioning hostname "ha-467706"

	I0417 18:49:46.122366   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:46.122583   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.125229   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.125668   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.125696   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.125858   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.126051   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.126223   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.126403   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.126575   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.126745   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.126758   96006 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-467706 && echo "ha-467706" | sudo tee /etc/hostname

	I0417 18:49:46.241359   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-467706

	I0417 18:49:46.241388   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.244126   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.244567   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.244610   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.244867   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.245076   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.245277   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.245428   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.245620   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.245841   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.245860   96006 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-467706' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-467706/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-467706' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0417 18:49:46.356754   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:49:46.356807   96006 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18665-75973/.minikube CaCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18665-75973/.minikube}

	I0417 18:49:46.356900   96006 buildroot.go:174] setting up certificates

	I0417 18:49:46.356915   96006 provision.go:84] configureAuth start

	I0417 18:49:46.356931   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:46.357220   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:46.359879   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.360284   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.360311   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.360453   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.362942   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.363300   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.363331   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.363469   96006 provision.go:143] copyHostCerts

	I0417 18:49:46.363499   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:49:46.363558   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem, removing ...

	I0417 18:49:46.363584   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:49:46.363675   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem (1078 bytes)

	I0417 18:49:46.363791   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:49:46.363813   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem, removing ...

	I0417 18:49:46.363818   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:49:46.363848   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem (1123 bytes)

	I0417 18:49:46.363901   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:49:46.363917   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem, removing ...

	I0417 18:49:46.363923   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:49:46.363943   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem (1679 bytes)

	I0417 18:49:46.364003   96006 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem org=jenkins.ha-467706 san=[127.0.0.1 192.168.39.159 ha-467706 localhost minikube]

	I0417 18:49:46.547992   96006 provision.go:177] copyRemoteCerts

	I0417 18:49:46.548058   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0417 18:49:46.548085   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.550923   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.551238   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.551272   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.551446   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.551662   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.551812   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.551945   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:46.631629   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0417 18:49:46.631706   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0417 18:49:46.660510   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0417 18:49:46.660601   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0417 18:49:46.686435   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0417 18:49:46.686519   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0417 18:49:46.712855   96006 provision.go:87] duration metric: took 355.924441ms to configureAuth

	I0417 18:49:46.712892   96006 buildroot.go:189] setting minikube options for container-runtime

	I0417 18:49:46.713118   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:49:46.713214   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.715807   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.716194   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.716214   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.716475   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.716658   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.716844   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.717015   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.717222   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.717455   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.717479   96006 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0417 18:49:46.986253   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0417 18:49:46.986294   96006 main.go:141] libmachine: Checking connection to Docker...

	I0417 18:49:46.986306   96006 main.go:141] libmachine: (ha-467706) Calling .GetURL

	I0417 18:49:46.987867   96006 main.go:141] libmachine: (ha-467706) DBG | Using libvirt version 6000000

	I0417 18:49:46.990607   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.991025   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.991057   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.991208   96006 main.go:141] libmachine: Docker is up and running!

	I0417 18:49:46.991225   96006 main.go:141] libmachine: Reticulating splines...

	I0417 18:49:46.991235   96006 client.go:171] duration metric: took 24.274758262s to LocalClient.Create

	I0417 18:49:46.991267   96006 start.go:167] duration metric: took 24.274825568s to libmachine.API.Create "ha-467706"

	I0417 18:49:46.991278   96006 start.go:293] postStartSetup for "ha-467706" (driver="kvm2")

	I0417 18:49:46.991298   96006 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0417 18:49:46.991317   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:46.991606   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0417 18:49:46.991639   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.994027   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.994408   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.994434   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.994582   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.994815   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.994988   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.995160   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:47.075556   96006 ssh_runner.go:195] Run: cat /etc/os-release

	I0417 18:49:47.080124   96006 info.go:137] Remote host: Buildroot 2023.02.9

	I0417 18:49:47.080157   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/addons for local assets ...

	I0417 18:49:47.080240   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/files for local assets ...

	I0417 18:49:47.080378   96006 filesync.go:149] local asset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> 832072.pem in /etc/ssl/certs

	I0417 18:49:47.080395   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /etc/ssl/certs/832072.pem

	I0417 18:49:47.080509   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0417 18:49:47.090584   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:49:47.116825   96006 start.go:296] duration metric: took 125.527222ms for postStartSetup

	I0417 18:49:47.116884   96006 main.go:141] libmachine: (ha-467706) Calling .GetConfigRaw

	I0417 18:49:47.117502   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:47.120183   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.120522   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.120553   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.120862   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:49:47.121043   96006 start.go:128] duration metric: took 24.424966199s to createHost

	I0417 18:49:47.121067   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:47.123333   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.123641   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.123669   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.123762   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:47.123939   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.124163   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.124296   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:47.124473   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:47.124691   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:47.124711   96006 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0417 18:49:47.226058   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713379787.196532675

	I0417 18:49:47.226085   96006 fix.go:216] guest clock: 1713379787.196532675

	I0417 18:49:47.226096   96006 fix.go:229] Guest: 2024-04-17 18:49:47.196532675 +0000 UTC Remote: 2024-04-17 18:49:47.12105477 +0000 UTC m=+24.548401797 (delta=75.477905ms)

	I0417 18:49:47.226122   96006 fix.go:200] guest clock delta is within tolerance: 75.477905ms

	I0417 18:49:47.226132   96006 start.go:83] releasing machines lock for "ha-467706", held for 24.530164s

	I0417 18:49:47.226159   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.226466   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:47.229254   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.229610   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.229641   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.229826   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.230365   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.230563   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.230659   96006 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0417 18:49:47.230708   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:47.230824   96006 ssh_runner.go:195] Run: cat /version.json

	I0417 18:49:47.230857   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:47.233295   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.233738   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.233769   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.233789   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.234080   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:47.234254   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.234319   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.234371   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.234459   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:47.234461   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:47.234625   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.234712   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:47.234758   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:47.234859   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:47.332201   96006 ssh_runner.go:195] Run: systemctl --version

	I0417 18:49:47.338467   96006 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0417 18:49:47.503987   96006 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0417 18:49:47.510271   96006 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0417 18:49:47.510357   96006 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0417 18:49:47.526939   96006 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0417 18:49:47.526969   96006 start.go:494] detecting cgroup driver to use...

	I0417 18:49:47.527048   96006 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0417 18:49:47.544808   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0417 18:49:47.560276   96006 docker.go:217] disabling cri-docker service (if available) ...

	I0417 18:49:47.560342   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0417 18:49:47.575493   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0417 18:49:47.590305   96006 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0417 18:49:47.703106   96006 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0417 18:49:47.847924   96006 docker.go:233] disabling docker service ...

	I0417 18:49:47.848005   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0417 18:49:47.863461   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0417 18:49:47.877676   96006 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0417 18:49:48.022562   96006 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0417 18:49:48.151007   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0417 18:49:48.166077   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0417 18:49:48.186073   96006 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0417 18:49:48.186142   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.197296   96006 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0417 18:49:48.197367   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.209670   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.221372   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.233508   96006 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0417 18:49:48.245432   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.257212   96006 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.276089   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.288509   96006 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0417 18:49:48.299360   96006 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0417 18:49:48.299433   96006 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0417 18:49:48.313454   96006 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0417 18:49:48.324328   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:49:48.450531   96006 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0417 18:49:48.594212   96006 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0417 18:49:48.594298   96006 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0417 18:49:48.599281   96006 start.go:562] Will wait 60s for crictl version

	I0417 18:49:48.599344   96006 ssh_runner.go:195] Run: which crictl

	I0417 18:49:48.603340   96006 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0417 18:49:48.642689   96006 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0417 18:49:48.642799   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:49:48.671577   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:49:48.702661   96006 out.go:177] * Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	I0417 18:49:48.704026   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:48.706752   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:48.707106   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:48.707135   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:48.707492   96006 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0417 18:49:48.712013   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:49:48.726914   96006 kubeadm.go:877] updating cluster {Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc

.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0417 18:49:48.727027   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:49:48.727072   96006 ssh_runner.go:195] Run: sudo crictl images --output json

	I0417 18:49:48.763371   96006 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0-rc.2". assuming images are not preloaded.

	I0417 18:49:48.763447   96006 ssh_runner.go:195] Run: which lz4

	I0417 18:49:48.767730   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0417 18:49:48.767859   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0417 18:49:48.772298   96006 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0417 18:49:48.772335   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394547972 bytes)

	I0417 18:49:50.300197   96006 crio.go:462] duration metric: took 1.532382815s to copy over tarball

	I0417 18:49:50.300268   96006 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0417 18:49:52.542643   96006 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.242348458s)

	I0417 18:49:52.542670   96006 crio.go:469] duration metric: took 2.242444327s to extract the tarball

	I0417 18:49:52.542679   96006 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0417 18:49:52.580669   96006 ssh_runner.go:195] Run: sudo crictl images --output json

	I0417 18:49:52.627109   96006 crio.go:514] all images are preloaded for cri-o runtime.

	I0417 18:49:52.627137   96006 cache_images.go:84] Images are preloaded, skipping loading

	I0417 18:49:52.627146   96006 kubeadm.go:928] updating node { 192.168.39.159 8443 v1.30.0-rc.2 crio true true} ...

	I0417 18:49:52.627259   96006 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-467706 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.159

	[Install]

	 config:

	{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0417 18:49:52.627324   96006 ssh_runner.go:195] Run: crio config

	I0417 18:49:52.672604   96006 cni.go:84] Creating CNI manager for ""

	I0417 18:49:52.672627   96006 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0417 18:49:52.672640   96006 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0417 18:49:52.672667   96006 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.159 APIServerPort:8443 KubernetesVersion:v1.30.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-467706 NodeName:ha-467706 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.159"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.159 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube

rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0417 18:49:52.672846   96006 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.159

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-467706"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.159

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.159"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0-rc.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0417 18:49:52.672877   96006 kube-vip.go:111] generating kube-vip config ...

	I0417 18:49:52.672919   96006 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0417 18:49:52.690262   96006 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0417 18:49:52.690373   96006 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0417 18:49:52.690446   96006 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:49:52.701509   96006 binaries.go:44] Found k8s binaries, skipping transfer

	I0417 18:49:52.701583   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0417 18:49:52.711831   96006 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (314 bytes)

	I0417 18:49:52.729846   96006 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0417 18:49:52.747405   96006 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)

	I0417 18:49:52.764754   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1352 bytes)

	I0417 18:49:52.782535   96006 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0417 18:49:52.786592   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:49:52.799666   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:49:52.916690   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:49:52.934217   96006 certs.go:68] Setting up /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706 for IP: 192.168.39.159

	I0417 18:49:52.934251   96006 certs.go:194] generating shared ca certs ...

	I0417 18:49:52.934274   96006 certs.go:226] acquiring lock for ca certs: {Name:mk03352eb76143f462405cfdf4da402444190b34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:52.934431   96006 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key

	I0417 18:49:52.934472   96006 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key

	I0417 18:49:52.934483   96006 certs.go:256] generating profile certs ...

	I0417 18:49:52.934530   96006 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key

	I0417 18:49:52.934544   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt with IP's: []

	I0417 18:49:53.244202   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt ...

	I0417 18:49:53.244236   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt: {Name:mk260beaef924a663e20e604d910222418991c1e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.244413   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key ...

	I0417 18:49:53.244425   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key: {Name:mka6e83ab53b9a78e8580ba26a408c6fe0aa4108 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.244500   96006 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce

	I0417 18:49:53.244516   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.159 192.168.39.254]

	I0417 18:49:53.351159   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce ...

	I0417 18:49:53.351195   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce: {Name:mk0d007a3059514906a38e3c48ad705a629ef9c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.351349   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce ...

	I0417 18:49:53.351371   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce: {Name:mkb0a296faba2ad3992fca03f9ce3ee187f67de6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.351441   96006 certs.go:381] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt

	I0417 18:49:53.351513   96006 certs.go:385] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key

	I0417 18:49:53.351566   96006 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key

	I0417 18:49:53.351580   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt with IP's: []

	I0417 18:49:53.481387   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt ...

	I0417 18:49:53.481422   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt: {Name:mk08465b193680de7d272e691e702536866d5179 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.481583   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key ...

	I0417 18:49:53.481594   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key: {Name:mkb793bc73b35b3c9b394526c75bb288dee06af9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.481657   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0417 18:49:53.481675   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0417 18:49:53.481685   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0417 18:49:53.481696   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0417 18:49:53.481714   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0417 18:49:53.481727   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0417 18:49:53.481739   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0417 18:49:53.481760   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0417 18:49:53.481808   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem (1338 bytes)

	W0417 18:49:53.481843   96006 certs.go:480] ignoring /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207_empty.pem, impossibly tiny 0 bytes

	I0417 18:49:53.481853   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem (1679 bytes)

	I0417 18:49:53.481877   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem (1078 bytes)

	I0417 18:49:53.481899   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem (1123 bytes)

	I0417 18:49:53.481925   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem (1679 bytes)

	I0417 18:49:53.481960   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:49:53.481987   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem -> /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.482001   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.482013   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.482612   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0417 18:49:53.509306   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0417 18:49:53.537445   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0417 18:49:53.565313   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0417 18:49:53.592648   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0417 18:49:53.619996   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0417 18:49:53.649884   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0417 18:49:53.679489   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0417 18:49:53.718882   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem --> /usr/share/ca-certificates/83207.pem (1338 bytes)

	I0417 18:49:53.756459   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /usr/share/ca-certificates/832072.pem (1708 bytes)

	I0417 18:49:53.791680   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0417 18:49:53.818386   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)

	I0417 18:49:53.836408   96006 ssh_runner.go:195] Run: openssl version

	I0417 18:49:53.842201   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0417 18:49:53.854077   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.858810   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 17 17:59 /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.858878   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.864686   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0417 18:49:53.876271   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/83207.pem && ln -fs /usr/share/ca-certificates/83207.pem /etc/ssl/certs/83207.pem"

	I0417 18:49:53.888608   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.893582   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 17 18:40 /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.893662   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.899643   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/83207.pem /etc/ssl/certs/51391683.0"

	I0417 18:49:53.912156   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/832072.pem && ln -fs /usr/share/ca-certificates/832072.pem /etc/ssl/certs/832072.pem"

	I0417 18:49:53.924518   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.929666   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 17 18:40 /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.929743   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.935925   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/832072.pem /etc/ssl/certs/3ec20f2e.0"

	I0417 18:49:53.948824   96006 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0417 18:49:53.953491   96006 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0417 18:49:53.953551   96006 kubeadm.go:391] StartCluster: {Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2

ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP

ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:49:53.953647   96006 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0417 18:49:53.953694   96006 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0417 18:49:53.994421   96006 cri.go:89] found id: ""

	I0417 18:49:53.994501   96006 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0417 18:49:54.006024   96006 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0417 18:49:54.017184   96006 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0417 18:49:54.027791   96006 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0417 18:49:54.027814   96006 kubeadm.go:156] found existing configuration files:

	I0417 18:49:54.027869   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0417 18:49:54.037957   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0417 18:49:54.038021   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0417 18:49:54.048431   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0417 18:49:54.058368   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0417 18:49:54.058435   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0417 18:49:54.069360   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0417 18:49:54.080326   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0417 18:49:54.080383   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0417 18:49:54.091346   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0417 18:49:54.101536   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0417 18:49:54.101611   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0417 18:49:54.112092   96006 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0417 18:49:54.221173   96006 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0-rc.2

	I0417 18:49:54.221276   96006 kubeadm.go:309] [preflight] Running pre-flight checks

	I0417 18:49:54.345642   96006 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0417 18:49:54.345788   96006 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0417 18:49:54.345991   96006 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0417 18:49:54.586516   96006 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0417 18:49:54.750772   96006 out.go:204]   - Generating certificates and keys ...

	I0417 18:49:54.750922   96006 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0417 18:49:54.751062   96006 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0417 18:49:54.751194   96006 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0417 18:49:54.903367   96006 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0417 18:49:54.954630   96006 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0417 18:49:55.127672   96006 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0417 18:49:55.391718   96006 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0417 18:49:55.391885   96006 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-467706 localhost] and IPs [192.168.39.159 127.0.0.1 ::1]

	I0417 18:49:55.502336   96006 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0417 18:49:55.502504   96006 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-467706 localhost] and IPs [192.168.39.159 127.0.0.1 ::1]

	I0417 18:49:55.698045   96006 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0417 18:49:55.867661   96006 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0417 18:49:56.226068   96006 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0417 18:49:56.226276   96006 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0417 18:49:56.336532   96006 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0417 18:49:56.482956   96006 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0417 18:49:56.554416   96006 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0417 18:49:56.815239   96006 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0417 18:49:56.902120   96006 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0417 18:49:56.902695   96006 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0417 18:49:56.906066   96006 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0417 18:49:56.908270   96006 out.go:204]   - Booting up control plane ...

	I0417 18:49:56.908379   96006 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0417 18:49:56.908500   96006 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0417 18:49:56.908588   96006 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0417 18:49:56.925089   96006 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0417 18:49:56.925875   96006 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0417 18:49:56.925950   96006 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0417 18:49:57.077441   96006 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0417 18:49:57.077590   96006 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0417 18:49:57.579007   96006 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 501.961199ms

	I0417 18:49:57.579109   96006 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0417 18:50:03.508397   96006 kubeadm.go:309] [api-check] The API server is healthy after 5.933545161s

	I0417 18:50:03.524830   96006 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0417 18:50:03.541796   96006 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0417 18:50:03.571323   96006 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0417 18:50:03.571530   96006 kubeadm.go:309] [mark-control-plane] Marking the node ha-467706 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0417 18:50:03.583854   96006 kubeadm.go:309] [bootstrap-token] Using token: hjpiw8.6t8szkhj41h84dis

	I0417 18:50:03.585429   96006 out.go:204]   - Configuring RBAC rules ...

	I0417 18:50:03.585594   96006 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0417 18:50:03.600099   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0417 18:50:03.615453   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0417 18:50:03.619726   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0417 18:50:03.624618   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0417 18:50:03.628356   96006 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0417 18:50:03.917165   96006 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0417 18:50:04.368237   96006 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0417 18:50:04.916872   96006 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0417 18:50:04.918021   96006 kubeadm.go:309] 

	I0417 18:50:04.918113   96006 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0417 18:50:04.918127   96006 kubeadm.go:309] 

	I0417 18:50:04.918209   96006 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0417 18:50:04.918220   96006 kubeadm.go:309] 

	I0417 18:50:04.918272   96006 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0417 18:50:04.918340   96006 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0417 18:50:04.918418   96006 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0417 18:50:04.918429   96006 kubeadm.go:309] 

	I0417 18:50:04.918492   96006 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0417 18:50:04.918511   96006 kubeadm.go:309] 

	I0417 18:50:04.918573   96006 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0417 18:50:04.918588   96006 kubeadm.go:309] 

	I0417 18:50:04.918691   96006 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0417 18:50:04.918802   96006 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0417 18:50:04.918901   96006 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0417 18:50:04.918912   96006 kubeadm.go:309] 

	I0417 18:50:04.919032   96006 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0417 18:50:04.919142   96006 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0417 18:50:04.919153   96006 kubeadm.go:309] 

	I0417 18:50:04.919262   96006 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token hjpiw8.6t8szkhj41h84dis \

	I0417 18:50:04.919431   96006 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 \

	I0417 18:50:04.919479   96006 kubeadm.go:309] 	--control-plane 

	I0417 18:50:04.919489   96006 kubeadm.go:309] 

	I0417 18:50:04.919599   96006 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0417 18:50:04.919614   96006 kubeadm.go:309] 

	I0417 18:50:04.919715   96006 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token hjpiw8.6t8szkhj41h84dis \

	I0417 18:50:04.919854   96006 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 

	I0417 18:50:04.920711   96006 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0417 18:50:04.920755   96006 cni.go:84] Creating CNI manager for ""

	I0417 18:50:04.920765   96006 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0417 18:50:04.922745   96006 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0417 18:50:04.924119   96006 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0417 18:50:04.932915   96006 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl ...

	I0417 18:50:04.932940   96006 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0417 18:50:04.958687   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0417 18:50:05.317320   96006 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0417 18:50:05.317440   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:05.317469   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-467706 minikube.k8s.io/updated_at=2024_04_17T18_50_05_0700 minikube.k8s.io/version=v1.33.0-beta.0 minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3 minikube.k8s.io/name=ha-467706 minikube.k8s.io/primary=true

	I0417 18:50:05.374278   96006 ops.go:34] apiserver oom_adj: -16

	I0417 18:50:05.507845   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:06.008879   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:06.508139   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:07.008349   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:07.507966   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:08.008041   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:08.508561   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:09.008903   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:09.508146   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:10.007855   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:10.508919   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:11.008695   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:11.508789   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:12.008689   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:12.508392   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:13.008145   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:13.508071   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:14.008218   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:14.508449   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:15.008880   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:15.508603   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:16.008586   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:16.508154   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:17.008458   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:17.152345   96006 kubeadm.go:1107] duration metric: took 11.83496435s to wait for elevateKubeSystemPrivileges

	W0417 18:50:17.152395   96006 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0417 18:50:17.152405   96006 kubeadm.go:393] duration metric: took 23.198862653s to StartCluster

	I0417 18:50:17.152426   96006 settings.go:142] acquiring lock: {Name:mk5d952127253ee5e60e06b072b3460ff4f86e9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:17.152501   96006 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:50:17.153264   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/kubeconfig: {Name:mkca968a5a2538f9f961af0f359c1b9923864131 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:17.153473   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0417 18:50:17.153481   96006 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:50:17.153503   96006 start.go:240] waiting for startup goroutines ...

	I0417 18:50:17.153521   96006 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]

	I0417 18:50:17.153623   96006 addons.go:69] Setting storage-provisioner=true in profile "ha-467706"

	I0417 18:50:17.153655   96006 addons.go:234] Setting addon storage-provisioner=true in "ha-467706"

	I0417 18:50:17.153681   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:17.153624   96006 addons.go:69] Setting default-storageclass=true in profile "ha-467706"

	I0417 18:50:17.153746   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:17.153771   96006 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-467706"

	I0417 18:50:17.154085   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.154124   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.154162   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.154197   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.169960   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35067

	I0417 18:50:17.170015   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41635

	I0417 18:50:17.170413   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.170442   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.170930   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.170951   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.171058   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.171079   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.171343   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.171539   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.171702   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:17.171975   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.172010   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.174031   96006 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:50:17.174414   96006 kapi.go:59] client config for ha-467706: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt", KeyFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key", CAFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5e2a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0417 18:50:17.175002   96006 cert_rotation.go:137] Starting client certificate rotation controller

	I0417 18:50:17.175289   96006 addons.go:234] Setting addon default-storageclass=true in "ha-467706"

	I0417 18:50:17.175344   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:17.175731   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.175781   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.187657   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42907

	I0417 18:50:17.188199   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.188829   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.188857   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.189272   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.189618   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:17.190208   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35787

	I0417 18:50:17.190573   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.191100   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.191124   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.191523   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.191659   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:17.193826   96006 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0417 18:50:17.192154   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.195104   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.195281   96006 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0417 18:50:17.195305   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0417 18:50:17.195330   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:17.198235   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.198524   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:17.198546   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.198731   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:17.198949   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:17.199120   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:17.199263   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:17.210463   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34261

	I0417 18:50:17.210875   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.211399   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.211424   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.211846   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.212069   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:17.213887   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:17.214200   96006 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0417 18:50:17.214223   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0417 18:50:17.214245   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:17.216977   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.217385   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:17.217430   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.217612   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:17.217792   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:17.217935   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:17.218076   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:17.317822   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0417 18:50:17.367713   96006 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0417 18:50:17.380094   96006 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0417 18:50:17.756247   96006 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0417 18:50:18.075807   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.075832   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.075894   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.075922   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.076153   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076172   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.076183   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.076191   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.076270   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076290   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.076295   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.076315   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.076329   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.076399   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076410   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.076440   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.076507   96006 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0417 18:50:18.076528   96006 round_trippers.go:469] Request Headers:

	I0417 18:50:18.076539   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:50:18.076543   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:50:18.076684   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076729   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.076748   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.090116   96006 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0417 18:50:18.091273   96006 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0417 18:50:18.091296   96006 round_trippers.go:469] Request Headers:

	I0417 18:50:18.091315   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:50:18.091320   96006 round_trippers.go:473]     Content-Type: application/json

	I0417 18:50:18.091328   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:50:18.094312   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:50:18.094536   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.094557   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.094830   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.094851   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.094873   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.096565   96006 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0417 18:50:18.098207   96006 addons.go:505] duration metric: took 944.687777ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I0417 18:50:18.098255   96006 start.go:245] waiting for cluster config update ...

	I0417 18:50:18.098273   96006 start.go:254] writing updated cluster config ...

	I0417 18:50:18.099861   96006 out.go:177] 

	I0417 18:50:18.101568   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:18.101676   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:50:18.103543   96006 out.go:177] * Starting "ha-467706-m02" control-plane node in "ha-467706" cluster

	I0417 18:50:18.104867   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:50:18.104900   96006 cache.go:56] Caching tarball of preloaded images

	I0417 18:50:18.105008   96006 preload.go:173] Found /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0417 18:50:18.105026   96006 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0-rc.2 on crio

	I0417 18:50:18.105143   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:50:18.105367   96006 start.go:360] acquireMachinesLock for ha-467706-m02: {Name:mk477aec4c276e4d91f705836ed4842912dfe2c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0417 18:50:18.105445   96006 start.go:364] duration metric: took 47.307µs to acquireMachinesLock for "ha-467706-m02"

	I0417 18:50:18.105473   96006 start.go:93] Provisioning new machine with config: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true E

xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:50:18.105578   96006 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0417 18:50:18.107330   96006 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0417 18:50:18.107431   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:18.107460   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:18.122242   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42417

	I0417 18:50:18.122702   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:18.123187   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:18.123210   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:18.123536   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:18.123731   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:18.123878   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:18.124060   96006 start.go:159] libmachine.API.Create for "ha-467706" (driver="kvm2")

	I0417 18:50:18.124089   96006 client.go:168] LocalClient.Create starting

	I0417 18:50:18.124126   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem

	I0417 18:50:18.124174   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:50:18.124193   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:50:18.124264   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem

	I0417 18:50:18.124291   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:50:18.124571   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:50:18.124658   96006 main.go:141] libmachine: Running pre-create checks...

	I0417 18:50:18.124674   96006 main.go:141] libmachine: (ha-467706-m02) Calling .PreCreateCheck

	I0417 18:50:18.125072   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetConfigRaw

	I0417 18:50:18.126362   96006 main.go:141] libmachine: Creating machine...

	I0417 18:50:18.126386   96006 main.go:141] libmachine: (ha-467706-m02) Calling .Create

	I0417 18:50:18.126923   96006 main.go:141] libmachine: (ha-467706-m02) Creating KVM machine...

	I0417 18:50:18.128081   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found existing default KVM network

	I0417 18:50:18.128226   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found existing private KVM network mk-ha-467706

	I0417 18:50:18.128361   96006 main.go:141] libmachine: (ha-467706-m02) Setting up store path in /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02 ...

	I0417 18:50:18.128389   96006 main.go:141] libmachine: (ha-467706-m02) Building disk image from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso

	I0417 18:50:18.128482   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.128356   96351 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:50:18.128617   96006 main.go:141] libmachine: (ha-467706-m02) Downloading /home/jenkins/minikube-integration/18665-75973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...

	I0417 18:50:18.367880   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.367714   96351 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa...

	I0417 18:50:18.531251   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.531111   96351 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/ha-467706-m02.rawdisk...

	I0417 18:50:18.531282   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Writing magic tar header

	I0417 18:50:18.531293   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Writing SSH key tar header

	I0417 18:50:18.531301   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.531231   96351 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02 ...

	I0417 18:50:18.531380   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02

	I0417 18:50:18.531401   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines

	I0417 18:50:18.531413   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02 (perms=drwx------)

	I0417 18:50:18.531434   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines (perms=drwxr-xr-x)

	I0417 18:50:18.531449   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube (perms=drwxr-xr-x)

	I0417 18:50:18.531462   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:50:18.531475   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973

	I0417 18:50:18.531484   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0417 18:50:18.531493   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973 (perms=drwxrwxr-x)

	I0417 18:50:18.531501   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0417 18:50:18.531510   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0417 18:50:18.531524   96006 main.go:141] libmachine: (ha-467706-m02) Creating domain...

	I0417 18:50:18.531537   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins

	I0417 18:50:18.531549   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home

	I0417 18:50:18.531561   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Skipping /home - not owner

	I0417 18:50:18.532389   96006 main.go:141] libmachine: (ha-467706-m02) define libvirt domain using xml: 

	I0417 18:50:18.532412   96006 main.go:141] libmachine: (ha-467706-m02) <domain type='kvm'>

	I0417 18:50:18.532440   96006 main.go:141] libmachine: (ha-467706-m02)   <name>ha-467706-m02</name>

	I0417 18:50:18.532464   96006 main.go:141] libmachine: (ha-467706-m02)   <memory unit='MiB'>2200</memory>

	I0417 18:50:18.532474   96006 main.go:141] libmachine: (ha-467706-m02)   <vcpu>2</vcpu>

	I0417 18:50:18.532484   96006 main.go:141] libmachine: (ha-467706-m02)   <features>

	I0417 18:50:18.532495   96006 main.go:141] libmachine: (ha-467706-m02)     <acpi/>

	I0417 18:50:18.532508   96006 main.go:141] libmachine: (ha-467706-m02)     <apic/>

	I0417 18:50:18.532574   96006 main.go:141] libmachine: (ha-467706-m02)     <pae/>

	I0417 18:50:18.532610   96006 main.go:141] libmachine: (ha-467706-m02)     

	I0417 18:50:18.532633   96006 main.go:141] libmachine: (ha-467706-m02)   </features>

	I0417 18:50:18.532649   96006 main.go:141] libmachine: (ha-467706-m02)   <cpu mode='host-passthrough'>

	I0417 18:50:18.532666   96006 main.go:141] libmachine: (ha-467706-m02)   

	I0417 18:50:18.532678   96006 main.go:141] libmachine: (ha-467706-m02)   </cpu>

	I0417 18:50:18.532690   96006 main.go:141] libmachine: (ha-467706-m02)   <os>

	I0417 18:50:18.532702   96006 main.go:141] libmachine: (ha-467706-m02)     <type>hvm</type>

	I0417 18:50:18.532716   96006 main.go:141] libmachine: (ha-467706-m02)     <boot dev='cdrom'/>

	I0417 18:50:18.532738   96006 main.go:141] libmachine: (ha-467706-m02)     <boot dev='hd'/>

	I0417 18:50:18.532751   96006 main.go:141] libmachine: (ha-467706-m02)     <bootmenu enable='no'/>

	I0417 18:50:18.532766   96006 main.go:141] libmachine: (ha-467706-m02)   </os>

	I0417 18:50:18.532791   96006 main.go:141] libmachine: (ha-467706-m02)   <devices>

	I0417 18:50:18.532809   96006 main.go:141] libmachine: (ha-467706-m02)     <disk type='file' device='cdrom'>

	I0417 18:50:18.532826   96006 main.go:141] libmachine: (ha-467706-m02)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/boot2docker.iso'/>

	I0417 18:50:18.532838   96006 main.go:141] libmachine: (ha-467706-m02)       <target dev='hdc' bus='scsi'/>

	I0417 18:50:18.532850   96006 main.go:141] libmachine: (ha-467706-m02)       <readonly/>

	I0417 18:50:18.532869   96006 main.go:141] libmachine: (ha-467706-m02)     </disk>

	I0417 18:50:18.532879   96006 main.go:141] libmachine: (ha-467706-m02)     <disk type='file' device='disk'>

	I0417 18:50:18.532897   96006 main.go:141] libmachine: (ha-467706-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0417 18:50:18.532914   96006 main.go:141] libmachine: (ha-467706-m02)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/ha-467706-m02.rawdisk'/>

	I0417 18:50:18.532926   96006 main.go:141] libmachine: (ha-467706-m02)       <target dev='hda' bus='virtio'/>

	I0417 18:50:18.532938   96006 main.go:141] libmachine: (ha-467706-m02)     </disk>

	I0417 18:50:18.532949   96006 main.go:141] libmachine: (ha-467706-m02)     <interface type='network'>

	I0417 18:50:18.532961   96006 main.go:141] libmachine: (ha-467706-m02)       <source network='mk-ha-467706'/>

	I0417 18:50:18.532975   96006 main.go:141] libmachine: (ha-467706-m02)       <model type='virtio'/>

	I0417 18:50:18.532994   96006 main.go:141] libmachine: (ha-467706-m02)     </interface>

	I0417 18:50:18.533013   96006 main.go:141] libmachine: (ha-467706-m02)     <interface type='network'>

	I0417 18:50:18.533026   96006 main.go:141] libmachine: (ha-467706-m02)       <source network='default'/>

	I0417 18:50:18.533043   96006 main.go:141] libmachine: (ha-467706-m02)       <model type='virtio'/>

	I0417 18:50:18.533056   96006 main.go:141] libmachine: (ha-467706-m02)     </interface>

	I0417 18:50:18.533067   96006 main.go:141] libmachine: (ha-467706-m02)     <serial type='pty'>

	I0417 18:50:18.533079   96006 main.go:141] libmachine: (ha-467706-m02)       <target port='0'/>

	I0417 18:50:18.533089   96006 main.go:141] libmachine: (ha-467706-m02)     </serial>

	I0417 18:50:18.533105   96006 main.go:141] libmachine: (ha-467706-m02)     <console type='pty'>

	I0417 18:50:18.533116   96006 main.go:141] libmachine: (ha-467706-m02)       <target type='serial' port='0'/>

	I0417 18:50:18.533138   96006 main.go:141] libmachine: (ha-467706-m02)     </console>

	I0417 18:50:18.533161   96006 main.go:141] libmachine: (ha-467706-m02)     <rng model='virtio'>

	I0417 18:50:18.533179   96006 main.go:141] libmachine: (ha-467706-m02)       <backend model='random'>/dev/random</backend>

	I0417 18:50:18.533191   96006 main.go:141] libmachine: (ha-467706-m02)     </rng>

	I0417 18:50:18.533202   96006 main.go:141] libmachine: (ha-467706-m02)     

	I0417 18:50:18.533212   96006 main.go:141] libmachine: (ha-467706-m02)     

	I0417 18:50:18.533224   96006 main.go:141] libmachine: (ha-467706-m02)   </devices>

	I0417 18:50:18.533238   96006 main.go:141] libmachine: (ha-467706-m02) </domain>

	I0417 18:50:18.533255   96006 main.go:141] libmachine: (ha-467706-m02) 

	I0417 18:50:18.540094   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:22:42:74 in network default

	I0417 18:50:18.540741   96006 main.go:141] libmachine: (ha-467706-m02) Ensuring networks are active...

	I0417 18:50:18.540791   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:18.541484   96006 main.go:141] libmachine: (ha-467706-m02) Ensuring network default is active

	I0417 18:50:18.541781   96006 main.go:141] libmachine: (ha-467706-m02) Ensuring network mk-ha-467706 is active

	I0417 18:50:18.542114   96006 main.go:141] libmachine: (ha-467706-m02) Getting domain xml...

	I0417 18:50:18.542779   96006 main.go:141] libmachine: (ha-467706-m02) Creating domain...

	I0417 18:50:19.758274   96006 main.go:141] libmachine: (ha-467706-m02) Waiting to get IP...

	I0417 18:50:19.759295   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:19.759776   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:19.759831   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:19.759753   96351 retry.go:31] will retry after 297.823603ms: waiting for machine to come up

	I0417 18:50:20.059605   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:20.060162   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:20.060192   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:20.060099   96351 retry.go:31] will retry after 378.130105ms: waiting for machine to come up

	I0417 18:50:20.439850   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:20.440396   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:20.440423   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:20.440349   96351 retry.go:31] will retry after 309.850338ms: waiting for machine to come up

	I0417 18:50:20.751969   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:20.752504   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:20.752529   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:20.752447   96351 retry.go:31] will retry after 484.021081ms: waiting for machine to come up

	I0417 18:50:21.238166   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:21.238627   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:21.238653   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:21.238571   96351 retry.go:31] will retry after 723.470091ms: waiting for machine to come up

	I0417 18:50:21.963754   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:21.964274   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:21.964316   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:21.964185   96351 retry.go:31] will retry after 820.645081ms: waiting for machine to come up

	I0417 18:50:22.786393   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:22.786856   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:22.786885   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:22.786809   96351 retry.go:31] will retry after 997.774765ms: waiting for machine to come up

	I0417 18:50:23.786284   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:23.786664   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:23.786685   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:23.786639   96351 retry.go:31] will retry after 1.38947065s: waiting for machine to come up

	I0417 18:50:25.177959   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:25.178412   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:25.178445   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:25.178346   96351 retry.go:31] will retry after 1.352777892s: waiting for machine to come up

	I0417 18:50:26.532959   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:26.533453   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:26.533485   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:26.533400   96351 retry.go:31] will retry after 2.218994741s: waiting for machine to come up

	I0417 18:50:28.754002   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:28.754519   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:28.754555   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:28.754456   96351 retry.go:31] will retry after 1.815056829s: waiting for machine to come up

	I0417 18:50:30.572601   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:30.573175   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:30.573208   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:30.573099   96351 retry.go:31] will retry after 2.735191697s: waiting for machine to come up

	I0417 18:50:33.309522   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:33.309997   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:33.310028   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:33.309953   96351 retry.go:31] will retry after 3.13218678s: waiting for machine to come up

	I0417 18:50:36.446318   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:36.446793   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:36.446824   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:36.446734   96351 retry.go:31] will retry after 5.302006713s: waiting for machine to come up

	I0417 18:50:41.753177   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.753633   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has current primary IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.753665   96006 main.go:141] libmachine: (ha-467706-m02) Found IP for machine: 192.168.39.236

	I0417 18:50:41.753703   96006 main.go:141] libmachine: (ha-467706-m02) Reserving static IP address...

	I0417 18:50:41.754045   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find host DHCP lease matching {name: "ha-467706-m02", mac: "52:54:00:d8:50:50", ip: "192.168.39.236"} in network mk-ha-467706

	I0417 18:50:41.829586   96006 main.go:141] libmachine: (ha-467706-m02) Reserved static IP address: 192.168.39.236

	I0417 18:50:41.829617   96006 main.go:141] libmachine: (ha-467706-m02) Waiting for SSH to be available...

	I0417 18:50:41.829627   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Getting to WaitForSSH function...

	I0417 18:50:41.832895   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.833340   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:minikube Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:41.833363   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.833541   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Using SSH client type: external

	I0417 18:50:41.833571   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa (-rw-------)

	I0417 18:50:41.833601   96006 main.go:141] libmachine: (ha-467706-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.236 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0417 18:50:41.833614   96006 main.go:141] libmachine: (ha-467706-m02) DBG | About to run SSH command:

	I0417 18:50:41.833630   96006 main.go:141] libmachine: (ha-467706-m02) DBG | exit 0

	I0417 18:50:41.960706   96006 main.go:141] libmachine: (ha-467706-m02) DBG | SSH cmd err, output: <nil>: 

	I0417 18:50:41.960994   96006 main.go:141] libmachine: (ha-467706-m02) KVM machine creation complete!

	I0417 18:50:41.961334   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetConfigRaw

	I0417 18:50:41.961844   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:41.962061   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:41.962225   96006 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0417 18:50:41.962238   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:50:41.963436   96006 main.go:141] libmachine: Detecting operating system of created instance...

	I0417 18:50:41.963451   96006 main.go:141] libmachine: Waiting for SSH to be available...

	I0417 18:50:41.963456   96006 main.go:141] libmachine: Getting to WaitForSSH function...

	I0417 18:50:41.963463   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:41.965691   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.965995   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:41.966028   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.966103   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:41.966297   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:41.966455   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:41.966606   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:41.966798   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:41.966995   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:41.967007   96006 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0417 18:50:42.072210   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:50:42.072233   96006 main.go:141] libmachine: Detecting the provisioner...

	I0417 18:50:42.072241   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.075072   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.075435   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.075465   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.075768   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.075992   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.076161   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.076307   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.076475   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.076688   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.076702   96006 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0417 18:50:42.185913   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0417 18:50:42.185995   96006 main.go:141] libmachine: found compatible host: buildroot

	I0417 18:50:42.186002   96006 main.go:141] libmachine: Provisioning with buildroot...

	I0417 18:50:42.186011   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:42.186288   96006 buildroot.go:166] provisioning hostname "ha-467706-m02"

	I0417 18:50:42.186321   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:42.186569   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.189252   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.189677   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.189709   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.189846   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.190047   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.190213   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.190368   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.190523   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.190728   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.190744   96006 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-467706-m02 && echo "ha-467706-m02" | sudo tee /etc/hostname

	I0417 18:50:42.311838   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-467706-m02

	I0417 18:50:42.311871   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.314488   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.314887   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.314914   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.315085   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.315336   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.315547   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.315701   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.315908   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.316085   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.316102   96006 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-467706-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-467706-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-467706-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0417 18:50:42.434077   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:50:42.434113   96006 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18665-75973/.minikube CaCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18665-75973/.minikube}

	I0417 18:50:42.434135   96006 buildroot.go:174] setting up certificates

	I0417 18:50:42.434148   96006 provision.go:84] configureAuth start

	I0417 18:50:42.434166   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:42.434487   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:42.437258   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.437702   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.437734   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.437882   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.440159   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.440448   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.440490   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.440578   96006 provision.go:143] copyHostCerts

	I0417 18:50:42.440617   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:50:42.440657   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem, removing ...

	I0417 18:50:42.440669   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:50:42.440748   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem (1078 bytes)

	I0417 18:50:42.440873   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:50:42.440901   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem, removing ...

	I0417 18:50:42.440909   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:50:42.440952   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem (1123 bytes)

	I0417 18:50:42.441025   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:50:42.441048   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem, removing ...

	I0417 18:50:42.441054   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:50:42.441088   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem (1679 bytes)

	I0417 18:50:42.441162   96006 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem org=jenkins.ha-467706-m02 san=[127.0.0.1 192.168.39.236 ha-467706-m02 localhost minikube]

	I0417 18:50:42.760848   96006 provision.go:177] copyRemoteCerts

	I0417 18:50:42.760909   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0417 18:50:42.760938   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.763523   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.763809   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.763835   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.763992   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.764230   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.764378   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.764519   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:42.847766   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0417 18:50:42.847833   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0417 18:50:42.873757   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0417 18:50:42.873849   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0417 18:50:42.899584   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0417 18:50:42.899649   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0417 18:50:42.925517   96006 provision.go:87] duration metric: took 491.346719ms to configureAuth

	I0417 18:50:42.925550   96006 buildroot.go:189] setting minikube options for container-runtime

	I0417 18:50:42.925744   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:42.925844   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.928428   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.928795   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.928848   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.929039   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.929254   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.929439   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.929593   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.929783   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.929940   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.929955   96006 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0417 18:50:43.215765   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0417 18:50:43.215798   96006 main.go:141] libmachine: Checking connection to Docker...

	I0417 18:50:43.215807   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetURL

	I0417 18:50:43.217123   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Using libvirt version 6000000

	I0417 18:50:43.219595   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.220034   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.220066   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.220248   96006 main.go:141] libmachine: Docker is up and running!

	I0417 18:50:43.220262   96006 main.go:141] libmachine: Reticulating splines...

	I0417 18:50:43.220270   96006 client.go:171] duration metric: took 25.096172136s to LocalClient.Create

	I0417 18:50:43.220292   96006 start.go:167] duration metric: took 25.096248433s to libmachine.API.Create "ha-467706"

	I0417 18:50:43.220302   96006 start.go:293] postStartSetup for "ha-467706-m02" (driver="kvm2")

	I0417 18:50:43.220314   96006 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0417 18:50:43.220347   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.220618   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0417 18:50:43.220650   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:43.222911   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.223248   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.223279   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.223454   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.223636   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.223808   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.223996   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:43.309604   96006 ssh_runner.go:195] Run: cat /etc/os-release

	I0417 18:50:43.314300   96006 info.go:137] Remote host: Buildroot 2023.02.9

	I0417 18:50:43.314329   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/addons for local assets ...

	I0417 18:50:43.314402   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/files for local assets ...

	I0417 18:50:43.314489   96006 filesync.go:149] local asset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> 832072.pem in /etc/ssl/certs

	I0417 18:50:43.314503   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /etc/ssl/certs/832072.pem

	I0417 18:50:43.314613   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0417 18:50:43.324876   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:50:43.352537   96006 start.go:296] duration metric: took 132.222885ms for postStartSetup

	I0417 18:50:43.352594   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetConfigRaw

	I0417 18:50:43.353271   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:43.355939   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.356297   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.356327   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.356586   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:50:43.356837   96006 start.go:128] duration metric: took 25.251245741s to createHost

	I0417 18:50:43.356869   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:43.358910   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.359264   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.359292   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.359361   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.359556   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.359731   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.359873   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.360045   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:43.360216   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:43.360227   96006 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0417 18:50:43.469667   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713379843.419472324

	I0417 18:50:43.469695   96006 fix.go:216] guest clock: 1713379843.419472324

	I0417 18:50:43.469704   96006 fix.go:229] Guest: 2024-04-17 18:50:43.419472324 +0000 UTC Remote: 2024-04-17 18:50:43.356854721 +0000 UTC m=+80.784201764 (delta=62.617603ms)

	I0417 18:50:43.469725   96006 fix.go:200] guest clock delta is within tolerance: 62.617603ms

	I0417 18:50:43.469732   96006 start.go:83] releasing machines lock for "ha-467706-m02", held for 25.364268885s

	I0417 18:50:43.469750   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.470040   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:43.472586   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.473021   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.473047   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.475263   96006 out.go:177] * Found network options:

	I0417 18:50:43.476714   96006 out.go:177]   - NO_PROXY=192.168.39.159

	W0417 18:50:43.477965   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:50:43.478009   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.478640   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.478829   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.478917   96006 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0417 18:50:43.478957   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	W0417 18:50:43.479048   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:50:43.479126   96006 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0417 18:50:43.479148   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:43.481734   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.481965   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.482051   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.482106   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.482197   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.482332   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.482357   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.482366   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.482509   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.482559   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.482676   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.482729   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:43.482839   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.482978   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:43.723186   96006 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0417 18:50:43.729400   96006 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0417 18:50:43.729487   96006 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0417 18:50:43.747191   96006 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0417 18:50:43.747222   96006 start.go:494] detecting cgroup driver to use...

	I0417 18:50:43.747298   96006 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0417 18:50:43.766134   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0417 18:50:43.782049   96006 docker.go:217] disabling cri-docker service (if available) ...

	I0417 18:50:43.782103   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0417 18:50:43.796842   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0417 18:50:43.811837   96006 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0417 18:50:43.955183   96006 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0417 18:50:44.119405   96006 docker.go:233] disabling docker service ...

	I0417 18:50:44.119488   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0417 18:50:44.135751   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0417 18:50:44.150314   96006 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0417 18:50:44.289369   96006 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0417 18:50:44.419335   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0417 18:50:44.434448   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0417 18:50:44.454265   96006 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0417 18:50:44.454341   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.465548   96006 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0417 18:50:44.465626   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.477204   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.488510   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.500218   96006 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0417 18:50:44.511859   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.523479   96006 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.544983   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.556679   96006 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0417 18:50:44.567217   96006 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0417 18:50:44.567280   96006 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0417 18:50:44.581851   96006 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0417 18:50:44.592445   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:50:44.730545   96006 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0417 18:50:44.871219   96006 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0417 18:50:44.871302   96006 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0417 18:50:44.876072   96006 start.go:562] Will wait 60s for crictl version

	I0417 18:50:44.876152   96006 ssh_runner.go:195] Run: which crictl

	I0417 18:50:44.880114   96006 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0417 18:50:44.920173   96006 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0417 18:50:44.920278   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:50:44.949069   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:50:44.987468   96006 out.go:177] * Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	I0417 18:50:44.988990   96006 out.go:177]   - env NO_PROXY=192.168.39.159

	I0417 18:50:44.990345   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:44.992870   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:44.993230   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:44.993253   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:44.993438   96006 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0417 18:50:44.998037   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:50:45.011925   96006 mustload.go:65] Loading cluster: ha-467706

	I0417 18:50:45.012122   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:45.012364   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:45.012402   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:45.027180   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40427

	I0417 18:50:45.027710   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:45.028266   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:45.028293   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:45.028637   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:45.029263   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:45.031035   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:45.031317   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:45.031355   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:45.046157   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35907

	I0417 18:50:45.046558   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:45.047075   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:45.047105   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:45.047444   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:45.047639   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:45.047800   96006 certs.go:68] Setting up /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706 for IP: 192.168.39.236

	I0417 18:50:45.047815   96006 certs.go:194] generating shared ca certs ...

	I0417 18:50:45.047834   96006 certs.go:226] acquiring lock for ca certs: {Name:mk03352eb76143f462405cfdf4da402444190b34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:45.047966   96006 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key

	I0417 18:50:45.048005   96006 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key

	I0417 18:50:45.048014   96006 certs.go:256] generating profile certs ...

	I0417 18:50:45.048106   96006 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key

	I0417 18:50:45.048131   96006 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3

	I0417 18:50:45.048146   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.159 192.168.39.236 192.168.39.254]

	I0417 18:50:45.216050   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3 ...

	I0417 18:50:45.216082   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3: {Name:mke40eb0bbfa4a257d69dee7c0db8615a28a2c02 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:45.216247   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3 ...

	I0417 18:50:45.216267   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3: {Name:mk744f487b85aae0492308fe90f1def1e1057446 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:45.216334   96006 certs.go:381] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt

	I0417 18:50:45.216463   96006 certs.go:385] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key

	I0417 18:50:45.216592   96006 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key

	I0417 18:50:45.216609   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0417 18:50:45.216622   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0417 18:50:45.216636   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0417 18:50:45.216647   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0417 18:50:45.216658   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0417 18:50:45.216668   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0417 18:50:45.216682   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0417 18:50:45.216694   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0417 18:50:45.216742   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem (1338 bytes)

	W0417 18:50:45.216789   96006 certs.go:480] ignoring /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207_empty.pem, impossibly tiny 0 bytes

	I0417 18:50:45.216800   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem (1679 bytes)

	I0417 18:50:45.216830   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem (1078 bytes)

	I0417 18:50:45.216853   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem (1123 bytes)

	I0417 18:50:45.216875   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem (1679 bytes)

	I0417 18:50:45.216912   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:50:45.216937   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem -> /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.216951   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.216966   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.217028   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:45.220190   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:45.220566   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:45.220597   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:45.220791   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:45.221049   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:45.221236   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:45.221414   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:45.293203   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0417 18:50:45.298477   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0417 18:50:45.313225   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0417 18:50:45.318150   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0417 18:50:45.332489   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0417 18:50:45.340783   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0417 18:50:45.351476   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0417 18:50:45.355935   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0417 18:50:45.368043   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0417 18:50:45.372901   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0417 18:50:45.385103   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0417 18:50:45.390349   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0417 18:50:45.403053   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0417 18:50:45.428841   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0417 18:50:45.453137   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0417 18:50:45.478112   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0417 18:50:45.503276   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0417 18:50:45.528841   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0417 18:50:45.554403   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0417 18:50:45.581253   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0417 18:50:45.609231   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem --> /usr/share/ca-certificates/83207.pem (1338 bytes)

	I0417 18:50:45.635402   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /usr/share/ca-certificates/832072.pem (1708 bytes)

	I0417 18:50:45.661160   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0417 18:50:45.687529   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0417 18:50:45.704763   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0417 18:50:45.721300   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0417 18:50:45.738377   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0417 18:50:45.755487   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0417 18:50:45.772301   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0417 18:50:45.789375   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (758 bytes)

	I0417 18:50:45.807294   96006 ssh_runner.go:195] Run: openssl version

	I0417 18:50:45.813499   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/83207.pem && ln -fs /usr/share/ca-certificates/83207.pem /etc/ssl/certs/83207.pem"

	I0417 18:50:45.825040   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.830049   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 17 18:40 /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.830110   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.836295   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/83207.pem /etc/ssl/certs/51391683.0"

	I0417 18:50:45.848368   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/832072.pem && ln -fs /usr/share/ca-certificates/832072.pem /etc/ssl/certs/832072.pem"

	I0417 18:50:45.859950   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.865632   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 17 18:40 /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.865700   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.871771   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/832072.pem /etc/ssl/certs/3ec20f2e.0"

	I0417 18:50:45.883399   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0417 18:50:45.894718   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.900008   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 17 17:59 /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.900078   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.906155   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0417 18:50:45.917743   96006 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0417 18:50:45.922549   96006 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0417 18:50:45.922604   96006 kubeadm.go:928] updating node {m02 192.168.39.236 8443 v1.30.0-rc.2 crio true true} ...

	I0417 18:50:45.922716   96006 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-467706-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.236

	[Install]

	 config:

	{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0417 18:50:45.922752   96006 kube-vip.go:111] generating kube-vip config ...

	I0417 18:50:45.922800   96006 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0417 18:50:45.943173   96006 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0417 18:50:45.943265   96006 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0417 18:50:45.943322   96006 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:50:45.956026   96006 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0-rc.2': No such file or directory

	Initiating transfer...

	I0417 18:50:45.956087   96006 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:50:45.967843   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl.sha256

	I0417 18:50:45.967881   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:50:45.967960   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:50:45.967964   96006 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet

	I0417 18:50:45.967984   96006 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm

	I0417 18:50:45.972622   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubectl': No such file or directory

	I0417 18:50:45.972648   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl (51454104 bytes)

	I0417 18:50:48.202574   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:50:48.202664   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:50:48.208132   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm': No such file or directory

	I0417 18:50:48.208171   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm (50249880 bytes)

	I0417 18:50:50.185607   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:50:50.201809   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:50:50.201893   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:50:50.207126   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet': No such file or directory

	I0417 18:50:50.207170   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet (100100024 bytes)

	I0417 18:50:50.649074   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0417 18:50:50.659340   96006 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)

	I0417 18:50:50.678040   96006 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0417 18:50:50.697112   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0417 18:50:50.715650   96006 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0417 18:50:50.720043   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:50:50.733632   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:50:50.869987   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:50:50.888165   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:50.888697   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:50.888785   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:50.904309   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44235

	I0417 18:50:50.904752   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:50.905310   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:50.905332   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:50.905622   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:50.905847   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:50.906027   96006 start.go:316] joinCluster: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2 Cl

usterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:

0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:50:50.906152   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0417 18:50:50.906180   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:50.909437   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:50.909900   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:50.909928   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:50.910110   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:50.910342   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:50.910526   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:50.910722   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:51.055851   96006 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:50:51.055919   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zt3ppm.k6jpgcx1jeyj2jt1 --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m02 --control-plane --apiserver-advertise-address=192.168.39.236 --apiserver-bind-port=8443"

	I0417 18:51:13.972353   96006 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zt3ppm.k6jpgcx1jeyj2jt1 --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m02 --control-plane --apiserver-advertise-address=192.168.39.236 --apiserver-bind-port=8443": (22.916397784s)

	I0417 18:51:13.972395   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0417 18:51:14.574803   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-467706-m02 minikube.k8s.io/updated_at=2024_04_17T18_51_14_0700 minikube.k8s.io/version=v1.33.0-beta.0 minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3 minikube.k8s.io/name=ha-467706 minikube.k8s.io/primary=false

	I0417 18:51:14.717411   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-467706-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0417 18:51:14.893231   96006 start.go:318] duration metric: took 23.987209952s to joinCluster

	I0417 18:51:14.893330   96006 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:51:14.895174   96006 out.go:177] * Verifying Kubernetes components...

	I0417 18:51:14.893626   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:51:14.896844   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:51:15.183083   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:51:15.224796   96006 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:51:15.225073   96006 kapi.go:59] client config for ha-467706: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt", KeyFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key", CAFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5e2a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0417 18:51:15.225173   96006 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.159:8443

	I0417 18:51:15.225692   96006 node_ready.go:35] waiting up to 6m0s for node "ha-467706-m02" to be "Ready" ...

	I0417 18:51:15.225869   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:15.225880   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:15.225892   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:15.225896   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:15.236705   96006 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0417 18:51:15.726883   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:15.726910   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:15.726922   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:15.726928   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:15.735017   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:16.226972   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:16.227006   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:16.227019   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:16.227024   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:16.231152   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:16.726335   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:16.726359   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:16.726368   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:16.726371   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:16.730277   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:17.226638   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:17.226669   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:17.226678   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:17.226681   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:17.230662   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:17.231373   96006 node_ready.go:53] node "ha-467706-m02" has status "Ready":"False"

	I0417 18:51:17.726905   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:17.726929   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:17.726938   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:17.726941   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:17.731821   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:18.226785   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:18.226823   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:18.226835   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:18.226841   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:18.231456   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:18.726414   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:18.726439   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:18.726448   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:18.726451   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:18.742533   96006 round_trippers.go:574] Response Status: 200 OK in 16 milliseconds

	I0417 18:51:19.225974   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:19.225999   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:19.226009   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:19.226014   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:19.231635   96006 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0417 18:51:19.233042   96006 node_ready.go:53] node "ha-467706-m02" has status "Ready":"False"

	I0417 18:51:19.726389   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:19.726411   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:19.726420   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:19.726425   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:19.729897   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:20.225875   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:20.225899   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:20.225907   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:20.225911   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:20.229100   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:20.726901   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:20.726924   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:20.726932   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:20.726936   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:20.730417   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:21.226005   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:21.226091   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:21.226109   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:21.226117   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:21.230666   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:21.726785   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:21.726806   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:21.726813   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:21.726818   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:21.731509   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:21.732328   96006 node_ready.go:53] node "ha-467706-m02" has status "Ready":"False"

	I0417 18:51:22.226721   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:22.226745   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:22.226756   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:22.226761   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:22.231754   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:22.726964   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:22.726997   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:22.727010   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:22.727018   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:22.735454   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:23.226383   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:23.226413   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.226428   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.226437   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.229878   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:23.230663   96006 node_ready.go:49] node "ha-467706-m02" has status "Ready":"True"

	I0417 18:51:23.230683   96006 node_ready.go:38] duration metric: took 8.0049708s for node "ha-467706-m02" to be "Ready" ...

	I0417 18:51:23.230694   96006 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:51:23.230814   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:23.230827   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.230835   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.230838   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.239654   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:23.246313   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.246432   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-56dz8

	I0417 18:51:23.246443   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.246451   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.246454   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.249987   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:23.251471   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:23.251491   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.251498   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.251503   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.254142   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.254681   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:23.254699   96006 pod_ready.go:81] duration metric: took 8.360266ms for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.254707   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.254764   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-kcdqn

	I0417 18:51:23.254773   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.254780   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.254784   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.257241   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.257923   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:23.257937   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.257944   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.257947   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.260197   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.260616   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:23.260631   96006 pod_ready.go:81] duration metric: took 5.918629ms for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.260640   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.260696   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706

	I0417 18:51:23.260705   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.260712   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.260723   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.263098   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.263593   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:23.263606   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.263612   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.263616   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.266189   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.267242   96006 pod_ready.go:92] pod "etcd-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:23.267256   96006 pod_ready.go:81] duration metric: took 6.610637ms for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.267265   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.267312   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:23.267322   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.267328   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.267331   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.269674   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.270282   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:23.270294   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.270301   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.270304   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.272657   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.767707   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:23.767738   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.767746   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.767751   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.770927   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:23.771848   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:23.771867   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.771877   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.771882   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.774590   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:24.267451   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:24.267480   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.267493   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.267498   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.271213   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:24.272086   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:24.272102   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.272109   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.272114   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.275365   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:24.768469   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:24.768502   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.768514   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.768519   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.772128   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:24.773012   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:24.773028   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.773037   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.773041   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.776084   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:25.268038   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:25.268060   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.268068   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.268073   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.271535   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:25.272213   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:25.272231   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.272239   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.272244   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.275254   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:25.275716   96006 pod_ready.go:102] pod "etcd-ha-467706-m02" in "kube-system" namespace has status "Ready":"False"

	I0417 18:51:25.768203   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:25.768229   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.768239   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.768245   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.771806   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:25.772566   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:25.772611   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.772619   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.772625   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.775636   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:26.268063   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:26.268099   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.268124   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.268129   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.272010   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:26.272908   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:26.272926   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.272937   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.272942   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.275754   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:26.767796   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:26.767819   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.767827   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.767831   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.771440   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:26.772137   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:26.772157   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.772168   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.772174   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.775107   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.267560   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:27.267584   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.267592   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.267597   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.271553   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:27.272200   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:27.272217   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.272226   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.272229   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.274967   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.275841   96006 pod_ready.go:92] pod "etcd-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:27.275858   96006 pod_ready.go:81] duration metric: took 4.008587704s for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.275872   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.275926   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706

	I0417 18:51:27.275934   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.275941   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.275945   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.278731   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.279548   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:27.279562   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.279569   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.279572   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.282012   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.282523   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:27.282541   96006 pod_ready.go:81] duration metric: took 6.66288ms for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.282549   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.282597   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:27.282605   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.282612   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.282616   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.285219   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.285913   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:27.285925   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.285932   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.285936   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.288353   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.782927   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:27.782951   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.782962   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.782966   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.787431   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:27.788870   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:27.788887   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.788895   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.788900   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.792215   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:28.283697   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:28.283728   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.283737   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.283741   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.287291   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:28.288522   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:28.288535   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.288545   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.288548   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.291872   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:28.782825   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:28.782848   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.782857   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.782862   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.787118   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:28.787874   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:28.787889   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.787897   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.787902   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.791077   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:29.283249   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:29.283280   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.283292   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.283297   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.288519   96006 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0417 18:51:29.289409   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:29.289428   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.289440   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.289446   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.292965   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:29.293591   96006 pod_ready.go:102] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"False"

	I0417 18:51:29.782904   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:29.782929   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.782940   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.782944   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.787500   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:29.789301   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:29.789322   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.789333   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.789339   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.793831   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:30.283438   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:30.283462   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.283470   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.283474   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.286931   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:30.287797   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:30.287812   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.287820   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.287825   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.290475   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:30.783555   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:30.783578   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.783586   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.783591   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.787803   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:30.788747   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:30.788767   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.788804   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.788811   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.792158   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:31.283747   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:31.283777   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.283790   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.283795   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.288177   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:31.289081   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:31.289095   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.289103   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.289107   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.292276   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:31.783370   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:31.783402   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.783414   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.783420   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.786680   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:31.787486   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:31.787503   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.787510   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.787514   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.790453   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:31.790996   96006 pod_ready.go:102] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"False"

	I0417 18:51:32.283343   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:32.283366   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.283375   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.283380   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.287390   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.289101   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.289117   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.289129   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.289137   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.297645   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:32.298808   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.298825   96006 pod_ready.go:81] duration metric: took 5.016269549s for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.298836   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.298896   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706

	I0417 18:51:32.298903   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.298911   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.298918   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.303341   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:32.304646   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:32.304662   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.304670   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.304675   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.307481   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:32.307982   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.308001   96006 pod_ready.go:81] duration metric: took 9.157988ms for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.308011   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.308072   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m02

	I0417 18:51:32.308080   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.308087   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.308090   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.310622   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:32.311286   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.311300   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.311306   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.311309   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.314424   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.315460   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.315477   96006 pod_ready.go:81] duration metric: took 7.460114ms for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.315486   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.315539   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-hd469

	I0417 18:51:32.315547   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.315554   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.315562   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.318568   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:32.426747   96006 request.go:629] Waited for 107.278257ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:32.426836   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:32.426844   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.426855   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.426865   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.430214   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.430962   96006 pod_ready.go:92] pod "kube-proxy-hd469" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.430982   96006 pod_ready.go:81] duration metric: took 115.490294ms for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.430993   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.626388   96006 request.go:629] Waited for 195.326382ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:51:32.626452   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:51:32.626458   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.626466   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.626478   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.630307   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.827284   96006 request.go:629] Waited for 196.366908ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.827344   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.827349   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.827357   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.827364   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.831913   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:32.832435   96006 pod_ready.go:92] pod "kube-proxy-qxtf4" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.832455   96006 pod_ready.go:81] duration metric: took 401.454584ms for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.832469   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.026738   96006 request.go:629] Waited for 194.18784ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:51:33.026803   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:51:33.026810   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.026821   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.026837   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.030357   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:33.226664   96006 request.go:629] Waited for 195.467878ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:33.226745   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:33.226754   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.226763   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.226766   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.230848   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:33.231696   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:33.231721   96006 pod_ready.go:81] duration metric: took 399.24464ms for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.231736   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.426832   96006 request.go:629] Waited for 194.99926ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:51:33.426911   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:51:33.426918   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.426927   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.426938   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.430894   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:33.626958   96006 request.go:629] Waited for 195.422824ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:33.627025   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:33.627030   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.627038   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.627041   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.631026   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:33.631774   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:33.631795   96006 pod_ready.go:81] duration metric: took 400.050921ms for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.631806   96006 pod_ready.go:38] duration metric: took 10.401080338s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:51:33.631822   96006 api_server.go:52] waiting for apiserver process to appear ...

	I0417 18:51:33.631879   96006 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:51:33.648554   96006 api_server.go:72] duration metric: took 18.75517691s to wait for apiserver process to appear ...

	I0417 18:51:33.648600   96006 api_server.go:88] waiting for apiserver healthz status ...

	I0417 18:51:33.648626   96006 api_server.go:253] Checking apiserver healthz at https://192.168.39.159:8443/healthz ...

	I0417 18:51:33.653277   96006 api_server.go:279] https://192.168.39.159:8443/healthz returned 200:

	ok

	I0417 18:51:33.653354   96006 round_trippers.go:463] GET https://192.168.39.159:8443/version

	I0417 18:51:33.653362   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.653370   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.653374   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.654340   96006 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0417 18:51:33.654453   96006 api_server.go:141] control plane version: v1.30.0-rc.2

	I0417 18:51:33.654471   96006 api_server.go:131] duration metric: took 5.864211ms to wait for apiserver health ...

	I0417 18:51:33.654480   96006 system_pods.go:43] waiting for kube-system pods to appear ...

	I0417 18:51:33.826909   96006 request.go:629] Waited for 172.335088ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:33.826975   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:33.826981   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.826989   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.826993   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.832448   96006 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0417 18:51:33.837613   96006 system_pods.go:59] 17 kube-system pods found

	I0417 18:51:33.837640   96006 system_pods.go:61] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:51:33.837646   96006 system_pods.go:61] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:51:33.837650   96006 system_pods.go:61] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:51:33.837654   96006 system_pods.go:61] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:51:33.837659   96006 system_pods.go:61] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:51:33.837663   96006 system_pods.go:61] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:51:33.837668   96006 system_pods.go:61] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:51:33.837675   96006 system_pods.go:61] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:51:33.837681   96006 system_pods.go:61] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:51:33.837690   96006 system_pods.go:61] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:51:33.837698   96006 system_pods.go:61] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:51:33.837703   96006 system_pods.go:61] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:51:33.837709   96006 system_pods.go:61] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:51:33.837713   96006 system_pods.go:61] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:51:33.837718   96006 system_pods.go:61] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:51:33.837721   96006 system_pods.go:61] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:51:33.837726   96006 system_pods.go:61] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:51:33.837732   96006 system_pods.go:74] duration metric: took 183.242044ms to wait for pod list to return data ...

	I0417 18:51:33.837743   96006 default_sa.go:34] waiting for default service account to be created ...

	I0417 18:51:34.027238   96006 request.go:629] Waited for 189.408907ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:51:34.027344   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:51:34.027356   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:34.027369   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:34.027387   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:34.031074   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:34.031378   96006 default_sa.go:45] found service account: "default"

	I0417 18:51:34.031406   96006 default_sa.go:55] duration metric: took 193.654279ms for default service account to be created ...

	I0417 18:51:34.031422   96006 system_pods.go:116] waiting for k8s-apps to be running ...

	I0417 18:51:34.226919   96006 request.go:629] Waited for 195.41558ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:34.227010   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:34.227019   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:34.227035   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:34.227045   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:34.233257   96006 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0417 18:51:34.238042   96006 system_pods.go:86] 17 kube-system pods found

	I0417 18:51:34.238071   96006 system_pods.go:89] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:51:34.238076   96006 system_pods.go:89] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:51:34.238081   96006 system_pods.go:89] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:51:34.238087   96006 system_pods.go:89] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:51:34.238093   96006 system_pods.go:89] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:51:34.238099   96006 system_pods.go:89] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:51:34.238104   96006 system_pods.go:89] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:51:34.238111   96006 system_pods.go:89] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:51:34.238121   96006 system_pods.go:89] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:51:34.238129   96006 system_pods.go:89] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:51:34.238135   96006 system_pods.go:89] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:51:34.238144   96006 system_pods.go:89] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:51:34.238152   96006 system_pods.go:89] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:51:34.238162   96006 system_pods.go:89] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:51:34.238171   96006 system_pods.go:89] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:51:34.238180   96006 system_pods.go:89] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:51:34.238189   96006 system_pods.go:89] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:51:34.238202   96006 system_pods.go:126] duration metric: took 206.768944ms to wait for k8s-apps to be running ...

	I0417 18:51:34.238215   96006 system_svc.go:44] waiting for kubelet service to be running ....

	I0417 18:51:34.238275   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:51:34.255222   96006 system_svc.go:56] duration metric: took 16.993241ms WaitForService to wait for kubelet

	I0417 18:51:34.255257   96006 kubeadm.go:576] duration metric: took 19.361885993s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0417 18:51:34.255285   96006 node_conditions.go:102] verifying NodePressure condition ...

	I0417 18:51:34.426766   96006 request.go:629] Waited for 171.388544ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes

	I0417 18:51:34.426844   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes

	I0417 18:51:34.426849   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:34.426857   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:34.426862   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:34.430450   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:34.431543   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:51:34.431577   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:51:34.431593   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:51:34.431598   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:51:34.431605   96006 node_conditions.go:105] duration metric: took 176.314123ms to run NodePressure ...

	I0417 18:51:34.431620   96006 start.go:240] waiting for startup goroutines ...

	I0417 18:51:34.431657   96006 start.go:254] writing updated cluster config ...

	I0417 18:51:34.433887   96006 out.go:177] 

	I0417 18:51:34.435625   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:51:34.435731   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:51:34.437530   96006 out.go:177] * Starting "ha-467706-m03" control-plane node in "ha-467706" cluster

	I0417 18:51:34.438965   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:51:34.438995   96006 cache.go:56] Caching tarball of preloaded images

	I0417 18:51:34.439105   96006 preload.go:173] Found /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0417 18:51:34.439117   96006 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0-rc.2 on crio

	I0417 18:51:34.439238   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:51:34.439424   96006 start.go:360] acquireMachinesLock for ha-467706-m03: {Name:mk477aec4c276e4d91f705836ed4842912dfe2c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0417 18:51:34.439471   96006 start.go:364] duration metric: took 26.368µs to acquireMachinesLock for "ha-467706-m03"

	I0417 18:51:34.439490   96006 start.go:93] Provisioning new machine with config: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false in

gress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Binary

Mirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:51:34.439582   96006 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0417 18:51:34.441053   96006 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0417 18:51:34.441163   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:51:34.441212   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:51:34.456551   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37695

	I0417 18:51:34.457105   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:51:34.457624   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:51:34.457646   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:51:34.457978   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:51:34.458265   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:34.458431   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:34.458625   96006 start.go:159] libmachine.API.Create for "ha-467706" (driver="kvm2")

	I0417 18:51:34.458663   96006 client.go:168] LocalClient.Create starting

	I0417 18:51:34.458711   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem

	I0417 18:51:34.458750   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:51:34.458773   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:51:34.458838   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem

	I0417 18:51:34.458866   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:51:34.458883   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:51:34.458907   96006 main.go:141] libmachine: Running pre-create checks...

	I0417 18:51:34.458920   96006 main.go:141] libmachine: (ha-467706-m03) Calling .PreCreateCheck

	I0417 18:51:34.459099   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetConfigRaw

	I0417 18:51:34.459607   96006 main.go:141] libmachine: Creating machine...

	I0417 18:51:34.459627   96006 main.go:141] libmachine: (ha-467706-m03) Calling .Create

	I0417 18:51:34.459808   96006 main.go:141] libmachine: (ha-467706-m03) Creating KVM machine...

	I0417 18:51:34.461114   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found existing default KVM network

	I0417 18:51:34.461289   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found existing private KVM network mk-ha-467706

	I0417 18:51:34.461430   96006 main.go:141] libmachine: (ha-467706-m03) Setting up store path in /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03 ...

	I0417 18:51:34.461457   96006 main.go:141] libmachine: (ha-467706-m03) Building disk image from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso

	I0417 18:51:34.461539   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.461418   96690 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:51:34.461604   96006 main.go:141] libmachine: (ha-467706-m03) Downloading /home/jenkins/minikube-integration/18665-75973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...

	I0417 18:51:34.702350   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.702215   96690 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa...

	I0417 18:51:34.869742   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.869577   96690 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/ha-467706-m03.rawdisk...

	I0417 18:51:34.869789   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Writing magic tar header

	I0417 18:51:34.869844   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Writing SSH key tar header

	I0417 18:51:34.869872   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03 (perms=drwx------)

	I0417 18:51:34.869891   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.869703   96690 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03 ...

	I0417 18:51:34.869911   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03

	I0417 18:51:34.869926   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines

	I0417 18:51:34.869933   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines (perms=drwxr-xr-x)

	I0417 18:51:34.869949   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube (perms=drwxr-xr-x)

	I0417 18:51:34.869960   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973 (perms=drwxrwxr-x)

	I0417 18:51:34.869974   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:51:34.869987   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973

	I0417 18:51:34.869996   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0417 18:51:34.870021   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins

	I0417 18:51:34.870047   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home

	I0417 18:51:34.870063   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0417 18:51:34.870079   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0417 18:51:34.870089   96006 main.go:141] libmachine: (ha-467706-m03) Creating domain...

	I0417 18:51:34.870104   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Skipping /home - not owner

	I0417 18:51:34.871109   96006 main.go:141] libmachine: (ha-467706-m03) define libvirt domain using xml: 

	I0417 18:51:34.871128   96006 main.go:141] libmachine: (ha-467706-m03) <domain type='kvm'>

	I0417 18:51:34.871138   96006 main.go:141] libmachine: (ha-467706-m03)   <name>ha-467706-m03</name>

	I0417 18:51:34.871151   96006 main.go:141] libmachine: (ha-467706-m03)   <memory unit='MiB'>2200</memory>

	I0417 18:51:34.871163   96006 main.go:141] libmachine: (ha-467706-m03)   <vcpu>2</vcpu>

	I0417 18:51:34.871169   96006 main.go:141] libmachine: (ha-467706-m03)   <features>

	I0417 18:51:34.871176   96006 main.go:141] libmachine: (ha-467706-m03)     <acpi/>

	I0417 18:51:34.871183   96006 main.go:141] libmachine: (ha-467706-m03)     <apic/>

	I0417 18:51:34.871196   96006 main.go:141] libmachine: (ha-467706-m03)     <pae/>

	I0417 18:51:34.871206   96006 main.go:141] libmachine: (ha-467706-m03)     

	I0417 18:51:34.871248   96006 main.go:141] libmachine: (ha-467706-m03)   </features>

	I0417 18:51:34.871271   96006 main.go:141] libmachine: (ha-467706-m03)   <cpu mode='host-passthrough'>

	I0417 18:51:34.871280   96006 main.go:141] libmachine: (ha-467706-m03)   

	I0417 18:51:34.871291   96006 main.go:141] libmachine: (ha-467706-m03)   </cpu>

	I0417 18:51:34.871315   96006 main.go:141] libmachine: (ha-467706-m03)   <os>

	I0417 18:51:34.871336   96006 main.go:141] libmachine: (ha-467706-m03)     <type>hvm</type>

	I0417 18:51:34.871348   96006 main.go:141] libmachine: (ha-467706-m03)     <boot dev='cdrom'/>

	I0417 18:51:34.871358   96006 main.go:141] libmachine: (ha-467706-m03)     <boot dev='hd'/>

	I0417 18:51:34.871366   96006 main.go:141] libmachine: (ha-467706-m03)     <bootmenu enable='no'/>

	I0417 18:51:34.871375   96006 main.go:141] libmachine: (ha-467706-m03)   </os>

	I0417 18:51:34.871383   96006 main.go:141] libmachine: (ha-467706-m03)   <devices>

	I0417 18:51:34.871395   96006 main.go:141] libmachine: (ha-467706-m03)     <disk type='file' device='cdrom'>

	I0417 18:51:34.871411   96006 main.go:141] libmachine: (ha-467706-m03)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/boot2docker.iso'/>

	I0417 18:51:34.871424   96006 main.go:141] libmachine: (ha-467706-m03)       <target dev='hdc' bus='scsi'/>

	I0417 18:51:34.871435   96006 main.go:141] libmachine: (ha-467706-m03)       <readonly/>

	I0417 18:51:34.871442   96006 main.go:141] libmachine: (ha-467706-m03)     </disk>

	I0417 18:51:34.871452   96006 main.go:141] libmachine: (ha-467706-m03)     <disk type='file' device='disk'>

	I0417 18:51:34.871465   96006 main.go:141] libmachine: (ha-467706-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0417 18:51:34.871480   96006 main.go:141] libmachine: (ha-467706-m03)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/ha-467706-m03.rawdisk'/>

	I0417 18:51:34.871492   96006 main.go:141] libmachine: (ha-467706-m03)       <target dev='hda' bus='virtio'/>

	I0417 18:51:34.871500   96006 main.go:141] libmachine: (ha-467706-m03)     </disk>

	I0417 18:51:34.871509   96006 main.go:141] libmachine: (ha-467706-m03)     <interface type='network'>

	I0417 18:51:34.871517   96006 main.go:141] libmachine: (ha-467706-m03)       <source network='mk-ha-467706'/>

	I0417 18:51:34.871525   96006 main.go:141] libmachine: (ha-467706-m03)       <model type='virtio'/>

	I0417 18:51:34.871535   96006 main.go:141] libmachine: (ha-467706-m03)     </interface>

	I0417 18:51:34.871545   96006 main.go:141] libmachine: (ha-467706-m03)     <interface type='network'>

	I0417 18:51:34.871555   96006 main.go:141] libmachine: (ha-467706-m03)       <source network='default'/>

	I0417 18:51:34.871563   96006 main.go:141] libmachine: (ha-467706-m03)       <model type='virtio'/>

	I0417 18:51:34.871572   96006 main.go:141] libmachine: (ha-467706-m03)     </interface>

	I0417 18:51:34.871579   96006 main.go:141] libmachine: (ha-467706-m03)     <serial type='pty'>

	I0417 18:51:34.871585   96006 main.go:141] libmachine: (ha-467706-m03)       <target port='0'/>

	I0417 18:51:34.871615   96006 main.go:141] libmachine: (ha-467706-m03)     </serial>

	I0417 18:51:34.871633   96006 main.go:141] libmachine: (ha-467706-m03)     <console type='pty'>

	I0417 18:51:34.871648   96006 main.go:141] libmachine: (ha-467706-m03)       <target type='serial' port='0'/>

	I0417 18:51:34.871656   96006 main.go:141] libmachine: (ha-467706-m03)     </console>

	I0417 18:51:34.871666   96006 main.go:141] libmachine: (ha-467706-m03)     <rng model='virtio'>

	I0417 18:51:34.871693   96006 main.go:141] libmachine: (ha-467706-m03)       <backend model='random'>/dev/random</backend>

	I0417 18:51:34.871705   96006 main.go:141] libmachine: (ha-467706-m03)     </rng>

	I0417 18:51:34.871715   96006 main.go:141] libmachine: (ha-467706-m03)     

	I0417 18:51:34.871723   96006 main.go:141] libmachine: (ha-467706-m03)     

	I0417 18:51:34.871733   96006 main.go:141] libmachine: (ha-467706-m03)   </devices>

	I0417 18:51:34.871745   96006 main.go:141] libmachine: (ha-467706-m03) </domain>

	I0417 18:51:34.871751   96006 main.go:141] libmachine: (ha-467706-m03) 

	I0417 18:51:34.878872   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:20:46:22 in network default

	I0417 18:51:34.879554   96006 main.go:141] libmachine: (ha-467706-m03) Ensuring networks are active...

	I0417 18:51:34.879573   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:34.880392   96006 main.go:141] libmachine: (ha-467706-m03) Ensuring network default is active

	I0417 18:51:34.880661   96006 main.go:141] libmachine: (ha-467706-m03) Ensuring network mk-ha-467706 is active

	I0417 18:51:34.881007   96006 main.go:141] libmachine: (ha-467706-m03) Getting domain xml...

	I0417 18:51:34.881716   96006 main.go:141] libmachine: (ha-467706-m03) Creating domain...

	I0417 18:51:36.106921   96006 main.go:141] libmachine: (ha-467706-m03) Waiting to get IP...

	I0417 18:51:36.107774   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:36.108244   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:36.108290   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:36.108235   96690 retry.go:31] will retry after 259.688955ms: waiting for machine to come up

	I0417 18:51:36.369919   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:36.370449   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:36.370484   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:36.370393   96690 retry.go:31] will retry after 263.833952ms: waiting for machine to come up

	I0417 18:51:36.636049   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:36.636520   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:36.636546   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:36.636478   96690 retry.go:31] will retry after 477.100713ms: waiting for machine to come up

	I0417 18:51:37.115192   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:37.115714   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:37.115748   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:37.115659   96690 retry.go:31] will retry after 585.751769ms: waiting for machine to come up

	I0417 18:51:37.703494   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:37.704022   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:37.704046   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:37.703971   96690 retry.go:31] will retry after 480.911798ms: waiting for machine to come up

	I0417 18:51:38.186810   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:38.187304   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:38.187336   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:38.187235   96690 retry.go:31] will retry after 741.971724ms: waiting for machine to come up

	I0417 18:51:38.931059   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:38.931460   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:38.931485   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:38.931420   96690 retry.go:31] will retry after 818.006613ms: waiting for machine to come up

	I0417 18:51:39.751433   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:39.751984   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:39.752015   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:39.751936   96690 retry.go:31] will retry after 1.076985012s: waiting for machine to come up

	I0417 18:51:40.830953   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:40.831445   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:40.831485   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:40.831385   96690 retry.go:31] will retry after 1.317961563s: waiting for machine to come up

	I0417 18:51:42.150497   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:42.150927   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:42.150950   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:42.150902   96690 retry.go:31] will retry after 1.665893506s: waiting for machine to come up

	I0417 18:51:43.818870   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:43.819324   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:43.819354   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:43.819268   96690 retry.go:31] will retry after 2.909952059s: waiting for machine to come up

	I0417 18:51:46.730539   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:46.731025   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:46.731049   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:46.730987   96690 retry.go:31] will retry after 3.59067388s: waiting for machine to come up

	I0417 18:51:50.322830   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:50.323323   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:50.323355   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:50.323263   96690 retry.go:31] will retry after 3.540199243s: waiting for machine to come up

	I0417 18:51:53.866714   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:53.867100   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:53.867130   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:53.867046   96690 retry.go:31] will retry after 3.58223567s: waiting for machine to come up

	I0417 18:51:57.450494   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.450992   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has current primary IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.451015   96006 main.go:141] libmachine: (ha-467706-m03) Found IP for machine: 192.168.39.250

	I0417 18:51:57.451069   96006 main.go:141] libmachine: (ha-467706-m03) Reserving static IP address...

	I0417 18:51:57.451464   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find host DHCP lease matching {name: "ha-467706-m03", mac: "52:54:00:93:9e:a9", ip: "192.168.39.250"} in network mk-ha-467706

	I0417 18:51:57.528115   96006 main.go:141] libmachine: (ha-467706-m03) Reserved static IP address: 192.168.39.250

	I0417 18:51:57.528155   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Getting to WaitForSSH function...

	I0417 18:51:57.528164   96006 main.go:141] libmachine: (ha-467706-m03) Waiting for SSH to be available...

	I0417 18:51:57.531251   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.531739   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:minikube Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.531764   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.531909   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Using SSH client type: external

	I0417 18:51:57.531940   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa (-rw-------)

	I0417 18:51:57.531977   96006 main.go:141] libmachine: (ha-467706-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.250 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0417 18:51:57.531996   96006 main.go:141] libmachine: (ha-467706-m03) DBG | About to run SSH command:

	I0417 18:51:57.532010   96006 main.go:141] libmachine: (ha-467706-m03) DBG | exit 0

	I0417 18:51:57.660953   96006 main.go:141] libmachine: (ha-467706-m03) DBG | SSH cmd err, output: <nil>: 

	I0417 18:51:57.661254   96006 main.go:141] libmachine: (ha-467706-m03) KVM machine creation complete!

	I0417 18:51:57.661574   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetConfigRaw

	I0417 18:51:57.662186   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:57.662357   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:57.662518   96006 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0417 18:51:57.662533   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:51:57.663657   96006 main.go:141] libmachine: Detecting operating system of created instance...

	I0417 18:51:57.663671   96006 main.go:141] libmachine: Waiting for SSH to be available...

	I0417 18:51:57.663677   96006 main.go:141] libmachine: Getting to WaitForSSH function...

	I0417 18:51:57.663683   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:57.665980   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.666354   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.666381   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.666482   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:57.666701   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.666883   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.667009   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:57.667140   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:57.667390   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:57.667406   96006 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0417 18:51:57.776433   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:51:57.776460   96006 main.go:141] libmachine: Detecting the provisioner...

	I0417 18:51:57.776470   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:57.779557   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.780066   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.780108   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.780214   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:57.780447   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.780635   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.780844   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:57.781095   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:57.781318   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:57.781334   96006 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0417 18:51:57.890734   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0417 18:51:57.890841   96006 main.go:141] libmachine: found compatible host: buildroot

	I0417 18:51:57.890855   96006 main.go:141] libmachine: Provisioning with buildroot...

	I0417 18:51:57.890869   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:57.891166   96006 buildroot.go:166] provisioning hostname "ha-467706-m03"

	I0417 18:51:57.891206   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:57.891442   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:57.894112   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.894576   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.894606   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.894749   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:57.894916   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.895074   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.895260   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:57.895416   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:57.895592   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:57.895604   96006 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-467706-m03 && echo "ha-467706-m03" | sudo tee /etc/hostname

	I0417 18:51:58.022957   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-467706-m03

	I0417 18:51:58.022997   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.026141   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.026552   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.026585   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.026799   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.027009   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.027194   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.027452   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.027784   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:58.028015   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:58.028040   96006 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-467706-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-467706-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-467706-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0417 18:51:58.147117   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:51:58.147158   96006 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18665-75973/.minikube CaCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18665-75973/.minikube}

	I0417 18:51:58.147176   96006 buildroot.go:174] setting up certificates

	I0417 18:51:58.147187   96006 provision.go:84] configureAuth start

	I0417 18:51:58.147197   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:58.147514   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:51:58.150495   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.150863   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.150904   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.151108   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.153368   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.153737   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.153757   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.153954   96006 provision.go:143] copyHostCerts

	I0417 18:51:58.153999   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:51:58.154045   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem, removing ...

	I0417 18:51:58.154059   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:51:58.154141   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem (1078 bytes)

	I0417 18:51:58.154273   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:51:58.154307   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem, removing ...

	I0417 18:51:58.154318   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:51:58.154358   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem (1123 bytes)

	I0417 18:51:58.154424   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:51:58.154448   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem, removing ...

	I0417 18:51:58.154457   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:51:58.154489   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem (1679 bytes)

	I0417 18:51:58.154574   96006 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem org=jenkins.ha-467706-m03 san=[127.0.0.1 192.168.39.250 ha-467706-m03 localhost minikube]

	I0417 18:51:58.356725   96006 provision.go:177] copyRemoteCerts

	I0417 18:51:58.356820   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0417 18:51:58.356856   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.359545   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.359943   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.359981   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.360159   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.360359   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.360546   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.360688   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:58.443213   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0417 18:51:58.443311   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0417 18:51:58.471921   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0417 18:51:58.472006   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0417 18:51:58.498008   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0417 18:51:58.498081   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0417 18:51:58.524744   96006 provision.go:87] duration metric: took 377.543951ms to configureAuth

	I0417 18:51:58.524790   96006 buildroot.go:189] setting minikube options for container-runtime

	I0417 18:51:58.525095   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:51:58.525185   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.527959   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.528315   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.528338   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.528543   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.528758   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.528953   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.529129   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.529297   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:58.529463   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:58.529477   96006 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0417 18:51:58.811996   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0417 18:51:58.812039   96006 main.go:141] libmachine: Checking connection to Docker...

	I0417 18:51:58.812051   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetURL

	I0417 18:51:58.813614   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Using libvirt version 6000000

	I0417 18:51:58.815988   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.816312   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.816337   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.816495   96006 main.go:141] libmachine: Docker is up and running!

	I0417 18:51:58.816517   96006 main.go:141] libmachine: Reticulating splines...

	I0417 18:51:58.816526   96006 client.go:171] duration metric: took 24.357851209s to LocalClient.Create

	I0417 18:51:58.816556   96006 start.go:167] duration metric: took 24.357933069s to libmachine.API.Create "ha-467706"

	I0417 18:51:58.816567   96006 start.go:293] postStartSetup for "ha-467706-m03" (driver="kvm2")

	I0417 18:51:58.816579   96006 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0417 18:51:58.816597   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:58.816866   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0417 18:51:58.816890   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.819416   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.819788   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.819817   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.819908   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.820089   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.820264   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.820455   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:58.903423   96006 ssh_runner.go:195] Run: cat /etc/os-release

	I0417 18:51:58.907793   96006 info.go:137] Remote host: Buildroot 2023.02.9

	I0417 18:51:58.907829   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/addons for local assets ...

	I0417 18:51:58.907891   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/files for local assets ...

	I0417 18:51:58.907963   96006 filesync.go:149] local asset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> 832072.pem in /etc/ssl/certs

	I0417 18:51:58.907973   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /etc/ssl/certs/832072.pem

	I0417 18:51:58.908078   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0417 18:51:58.917857   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:51:58.944503   96006 start.go:296] duration metric: took 127.921184ms for postStartSetup

	I0417 18:51:58.944571   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetConfigRaw

	I0417 18:51:58.945214   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:51:58.947772   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.948095   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.948138   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.948469   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:51:58.948684   96006 start.go:128] duration metric: took 24.509091391s to createHost

	I0417 18:51:58.948711   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.951031   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.951386   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.951416   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.951598   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.951807   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.951995   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.952112   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.952234   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:58.952417   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:58.952429   96006 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0417 18:51:59.061669   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713379919.025305300

	I0417 18:51:59.061695   96006 fix.go:216] guest clock: 1713379919.025305300

	I0417 18:51:59.061704   96006 fix.go:229] Guest: 2024-04-17 18:51:59.0253053 +0000 UTC Remote: 2024-04-17 18:51:58.948697509 +0000 UTC m=+156.376044537 (delta=76.607791ms)

	I0417 18:51:59.061723   96006 fix.go:200] guest clock delta is within tolerance: 76.607791ms

	I0417 18:51:59.061730   96006 start.go:83] releasing machines lock for "ha-467706-m03", held for 24.622249744s

	I0417 18:51:59.061754   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.062041   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:51:59.064824   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.065192   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:59.065231   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.067675   96006 out.go:177] * Found network options:

	I0417 18:51:59.069081   96006 out.go:177]   - NO_PROXY=192.168.39.159,192.168.39.236

	W0417 18:51:59.070321   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	W0417 18:51:59.070343   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:51:59.070360   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.071000   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.071241   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.071364   96006 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0417 18:51:59.071410   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	W0417 18:51:59.071447   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	W0417 18:51:59.071470   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:51:59.071539   96006 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0417 18:51:59.071564   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:59.075438   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.075906   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.076399   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:59.076426   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.076632   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:59.076660   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:59.076671   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.076837   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:59.076882   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:59.076982   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:59.077030   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:59.077184   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:59.077180   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:59.077333   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:59.312868   96006 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0417 18:51:59.319779   96006 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0417 18:51:59.319848   96006 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0417 18:51:59.337213   96006 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0417 18:51:59.337240   96006 start.go:494] detecting cgroup driver to use...

	I0417 18:51:59.337303   96006 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0417 18:51:59.356790   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0417 18:51:59.371164   96006 docker.go:217] disabling cri-docker service (if available) ...

	I0417 18:51:59.371221   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0417 18:51:59.385299   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0417 18:51:59.399551   96006 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0417 18:51:59.511492   96006 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0417 18:51:59.680128   96006 docker.go:233] disabling docker service ...

	I0417 18:51:59.680200   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0417 18:51:59.695980   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0417 18:51:59.709911   96006 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0417 18:51:59.853481   96006 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0417 18:51:59.975362   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0417 18:51:59.990715   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0417 18:52:00.014556   96006 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0417 18:52:00.014646   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.026160   96006 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0417 18:52:00.026224   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.037683   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.049269   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.060422   96006 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0417 18:52:00.072142   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.083153   96006 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.103537   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.115363   96006 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0417 18:52:00.125483   96006 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0417 18:52:00.125543   96006 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0417 18:52:00.140258   96006 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0417 18:52:00.151232   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:52:00.284671   96006 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0417 18:52:00.434033   96006 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0417 18:52:00.434122   96006 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0417 18:52:00.439963   96006 start.go:562] Will wait 60s for crictl version

	I0417 18:52:00.440079   96006 ssh_runner.go:195] Run: which crictl

	I0417 18:52:00.444073   96006 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0417 18:52:00.487475   96006 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0417 18:52:00.487559   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:52:00.516105   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:52:00.546634   96006 out.go:177] * Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	I0417 18:52:00.548096   96006 out.go:177]   - env NO_PROXY=192.168.39.159

	I0417 18:52:00.549484   96006 out.go:177]   - env NO_PROXY=192.168.39.159,192.168.39.236

	I0417 18:52:00.550999   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:52:00.553930   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:52:00.554200   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:52:00.554219   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:52:00.554407   96006 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0417 18:52:00.559384   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:52:00.573146   96006 mustload.go:65] Loading cluster: ha-467706

	I0417 18:52:00.573371   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:52:00.573651   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:52:00.573700   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:52:00.588993   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43305

	I0417 18:52:00.589529   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:52:00.590035   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:52:00.590058   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:52:00.590436   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:52:00.590616   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:52:00.592317   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:52:00.592729   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:52:00.592804   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:52:00.607728   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32889

	I0417 18:52:00.608165   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:52:00.608719   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:52:00.608750   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:52:00.609117   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:52:00.609294   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:52:00.609463   96006 certs.go:68] Setting up /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706 for IP: 192.168.39.250

	I0417 18:52:00.609482   96006 certs.go:194] generating shared ca certs ...

	I0417 18:52:00.609497   96006 certs.go:226] acquiring lock for ca certs: {Name:mk03352eb76143f462405cfdf4da402444190b34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:52:00.609655   96006 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key

	I0417 18:52:00.609709   96006 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key

	I0417 18:52:00.609724   96006 certs.go:256] generating profile certs ...

	I0417 18:52:00.609820   96006 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key

	I0417 18:52:00.609850   96006 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9

	I0417 18:52:00.609869   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.159 192.168.39.236 192.168.39.250 192.168.39.254]

	I0417 18:52:00.749277   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9 ...

	I0417 18:52:00.749320   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9: {Name:mk6143d78cf42a990aa606d474f97e8b4fd0619a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:52:00.749616   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9 ...

	I0417 18:52:00.749648   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9: {Name:mk3bb67b98f87c1d920beec47452d123a46411b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:52:00.749762   96006 certs.go:381] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt

	I0417 18:52:00.749897   96006 certs.go:385] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key

	I0417 18:52:00.750025   96006 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key

	I0417 18:52:00.750042   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0417 18:52:00.750054   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0417 18:52:00.750068   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0417 18:52:00.750081   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0417 18:52:00.750098   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0417 18:52:00.750110   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0417 18:52:00.750122   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0417 18:52:00.750134   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0417 18:52:00.750185   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem (1338 bytes)

	W0417 18:52:00.750214   96006 certs.go:480] ignoring /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207_empty.pem, impossibly tiny 0 bytes

	I0417 18:52:00.750223   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem (1679 bytes)

	I0417 18:52:00.750245   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem (1078 bytes)

	I0417 18:52:00.750267   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem (1123 bytes)

	I0417 18:52:00.750290   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem (1679 bytes)

	I0417 18:52:00.750324   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:52:00.750348   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:00.750362   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem -> /usr/share/ca-certificates/83207.pem

	I0417 18:52:00.750374   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /usr/share/ca-certificates/832072.pem

	I0417 18:52:00.750409   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:52:00.753425   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:00.753882   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:52:00.753914   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:00.754091   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:52:00.754308   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:52:00.754433   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:52:00.754565   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:52:00.825222   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0417 18:52:00.830594   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0417 18:52:00.843572   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0417 18:52:00.848432   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0417 18:52:00.860990   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0417 18:52:00.868349   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0417 18:52:00.881489   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0417 18:52:00.886462   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0417 18:52:00.902096   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0417 18:52:00.907262   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0417 18:52:00.920906   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0417 18:52:00.926468   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0417 18:52:00.941097   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0417 18:52:00.969343   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0417 18:52:00.997366   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0417 18:52:01.024743   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0417 18:52:01.054703   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0417 18:52:01.082003   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0417 18:52:01.109194   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0417 18:52:01.136303   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0417 18:52:01.162022   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0417 18:52:01.187722   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem --> /usr/share/ca-certificates/83207.pem (1338 bytes)

	I0417 18:52:01.214107   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /usr/share/ca-certificates/832072.pem (1708 bytes)

	I0417 18:52:01.241348   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0417 18:52:01.261810   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0417 18:52:01.282278   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0417 18:52:01.301494   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0417 18:52:01.320460   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0417 18:52:01.339415   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0417 18:52:01.357976   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (758 bytes)

	I0417 18:52:01.375690   96006 ssh_runner.go:195] Run: openssl version

	I0417 18:52:01.381609   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0417 18:52:01.392798   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:01.397733   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 17 17:59 /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:01.397804   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:01.403864   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0417 18:52:01.415745   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/83207.pem && ln -fs /usr/share/ca-certificates/83207.pem /etc/ssl/certs/83207.pem"

	I0417 18:52:01.428109   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/83207.pem

	I0417 18:52:01.432877   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 17 18:40 /usr/share/ca-certificates/83207.pem

	I0417 18:52:01.432941   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/83207.pem

	I0417 18:52:01.439267   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/83207.pem /etc/ssl/certs/51391683.0"

	I0417 18:52:01.450923   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/832072.pem && ln -fs /usr/share/ca-certificates/832072.pem /etc/ssl/certs/832072.pem"

	I0417 18:52:01.462324   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/832072.pem

	I0417 18:52:01.467307   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 17 18:40 /usr/share/ca-certificates/832072.pem

	I0417 18:52:01.467382   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/832072.pem

	I0417 18:52:01.473331   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/832072.pem /etc/ssl/certs/3ec20f2e.0"

	I0417 18:52:01.484248   96006 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0417 18:52:01.488720   96006 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0417 18:52:01.488810   96006 kubeadm.go:928] updating node {m03 192.168.39.250 8443 v1.30.0-rc.2 crio true true} ...

	I0417 18:52:01.488925   96006 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-467706-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.250

	[Install]

	 config:

	{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0417 18:52:01.488961   96006 kube-vip.go:111] generating kube-vip config ...

	I0417 18:52:01.489005   96006 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0417 18:52:01.505434   96006 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0417 18:52:01.505511   96006 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0417 18:52:01.505571   96006 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:52:01.517039   96006 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0-rc.2': No such file or directory

	Initiating transfer...

	I0417 18:52:01.517114   96006 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:52:01.528436   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm.sha256

	I0417 18:52:01.528460   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet.sha256

	I0417 18:52:01.528473   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:52:01.528483   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl.sha256

	I0417 18:52:01.528495   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:52:01.528516   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:52:01.528548   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:52:01.528549   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:52:01.533531   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubectl': No such file or directory

	I0417 18:52:01.533565   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl (51454104 bytes)

	I0417 18:52:01.556412   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:52:01.556557   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:52:01.569927   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm': No such file or directory

	I0417 18:52:01.569973   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm (50249880 bytes)

	I0417 18:52:01.615729   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet': No such file or directory

	I0417 18:52:01.615777   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet (100100024 bytes)

	I0417 18:52:02.505814   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0417 18:52:02.516731   96006 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)

	I0417 18:52:02.537107   96006 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0417 18:52:02.555786   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0417 18:52:02.574491   96006 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0417 18:52:02.580118   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:52:02.594496   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:52:02.741413   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:52:02.761049   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:52:02.761373   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:52:02.761425   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:52:02.776757   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38773

	I0417 18:52:02.777305   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:52:02.777802   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:52:02.777823   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:52:02.778163   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:52:02.778370   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:52:02.778550   96006 start.go:316] joinCluster: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2 Cl

usterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:fals

e ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di

sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:52:02.778748   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0417 18:52:02.778783   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:52:02.781899   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:02.782379   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:52:02.782406   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:02.782580   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:52:02.782768   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:52:02.782986   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:52:02.783174   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:52:02.957773   96006 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:52:02.957846   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 1y032b.zfoaqppbodvod22o --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443"

	I0417 18:52:27.749596   96006 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 1y032b.zfoaqppbodvod22o --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443": (24.791722831s)

	I0417 18:52:27.749646   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0417 18:52:28.385191   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-467706-m03 minikube.k8s.io/updated_at=2024_04_17T18_52_28_0700 minikube.k8s.io/version=v1.33.0-beta.0 minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3 minikube.k8s.io/name=ha-467706 minikube.k8s.io/primary=false

	I0417 18:52:28.504077   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-467706-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0417 18:52:28.621348   96006 start.go:318] duration metric: took 25.842793494s to joinCluster

	I0417 18:52:28.621444   96006 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:52:28.623236   96006 out.go:177] * Verifying Kubernetes components...

	I0417 18:52:28.621761   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:52:28.624642   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:52:28.898574   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:52:28.923168   96006 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:52:28.923555   96006 kapi.go:59] client config for ha-467706: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt", KeyFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key", CAFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5e2a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0417 18:52:28.923651   96006 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.159:8443

	I0417 18:52:28.923966   96006 node_ready.go:35] waiting up to 6m0s for node "ha-467706-m03" to be "Ready" ...

	I0417 18:52:28.924090   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:28.924104   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:28.924115   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:28.924120   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:28.927651   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:29.424873   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:29.424902   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:29.424914   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:29.424921   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:29.428630   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:29.924950   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:29.924978   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:29.924989   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:29.924995   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:29.929352   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:30.424980   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:30.425005   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:30.425016   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:30.425021   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:30.433101   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:52:30.924634   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:30.924655   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:30.924663   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:30.924666   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:30.929216   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:30.930081   96006 node_ready.go:53] node "ha-467706-m03" has status "Ready":"False"

	I0417 18:52:31.424251   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:31.424276   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:31.424287   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:31.424294   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:31.427884   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:31.925119   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:31.925141   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:31.925150   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:31.925153   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:31.929439   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:32.425059   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:32.425082   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:32.425090   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:32.425095   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:32.428735   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:32.925083   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:32.925105   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:32.925113   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:32.925117   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:32.928326   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:33.424762   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:33.424797   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:33.424806   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:33.424810   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:33.428416   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:33.429153   96006 node_ready.go:53] node "ha-467706-m03" has status "Ready":"False"

	I0417 18:52:33.924533   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:33.924556   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:33.924565   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:33.924569   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:33.928140   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:34.424439   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:34.424464   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:34.424472   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:34.424476   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:34.428193   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:34.925087   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:34.925111   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:34.925120   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:34.925125   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:34.928677   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:35.425172   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:35.425200   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:35.425210   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:35.425218   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:35.429160   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:35.429880   96006 node_ready.go:53] node "ha-467706-m03" has status "Ready":"False"

	I0417 18:52:35.925045   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:35.925069   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:35.925081   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:35.925086   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:35.929103   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.424535   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:36.424572   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.424584   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.424592   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.428304   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.925072   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:36.925098   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.925107   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.925112   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.929080   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.929865   96006 node_ready.go:49] node "ha-467706-m03" has status "Ready":"True"

	I0417 18:52:36.929899   96006 node_ready.go:38] duration metric: took 8.005907796s for node "ha-467706-m03" to be "Ready" ...

	I0417 18:52:36.929921   96006 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:52:36.930010   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:36.930023   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.930035   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.930040   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.936875   96006 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0417 18:52:36.943562   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.943658   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-56dz8

	I0417 18:52:36.943671   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.943682   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.943691   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.946981   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.947848   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:36.947865   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.947874   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.947877   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.951124   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.951882   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.951909   96006 pod_ready.go:81] duration metric: took 8.318595ms for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.951922   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.952004   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-kcdqn

	I0417 18:52:36.952016   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.952025   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.952030   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.954946   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:36.956375   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:36.956391   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.956398   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.956402   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.960496   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:36.961176   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.961195   96006 pod_ready.go:81] duration metric: took 9.26631ms for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.961204   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.961424   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706

	I0417 18:52:36.961444   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.961453   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.961460   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.964198   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:36.964962   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:36.964980   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.964990   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.964996   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.968568   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.969736   96006 pod_ready.go:92] pod "etcd-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.969755   96006 pod_ready.go:81] duration metric: took 8.543441ms for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.969767   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.969836   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:52:36.969846   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.969856   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.969864   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.973322   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.974022   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:36.974039   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.974049   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.974056   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.977049   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:36.977876   96006 pod_ready.go:92] pod "etcd-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.977893   96006 pod_ready.go:81] duration metric: took 8.118952ms for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.977902   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:37.125207   96006 request.go:629] Waited for 147.237578ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.125304   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.125317   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.125327   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.125335   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.129265   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:37.325969   96006 request.go:629] Waited for 195.91734ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.326062   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.326069   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.326081   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.326087   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.329735   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:37.525979   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.526008   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.526024   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.526030   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.530532   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:37.725519   96006 request.go:629] Waited for 194.121985ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.725593   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.725601   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.725612   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.725631   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.728991   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:37.978697   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.978723   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.978732   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.978736   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.982744   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.125959   96006 request.go:629] Waited for 142.267335ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.126016   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.126020   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.126028   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.126033   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.129065   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.478351   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:38.478382   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.478393   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.478400   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.482019   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.526015   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.526040   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.526053   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.526057   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.530125   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:38.979130   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:38.979167   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.979181   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.979191   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.983274   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:38.984058   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.984074   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.984082   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.984087   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.987121   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.987824   96006 pod_ready.go:102] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"False"

	I0417 18:52:39.478744   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:39.478767   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.478776   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.478780   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.482249   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:39.482930   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:39.482947   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.482955   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.482958   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.485711   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:39.978405   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:39.978428   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.978437   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.978441   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.983307   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:39.984232   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:39.984251   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.984260   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.984265   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.987576   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:40.478611   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:40.478635   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.478649   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.478654   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.482185   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:40.482957   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:40.482974   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.482982   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.482990   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.485806   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:40.978434   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:40.978458   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.978466   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.978470   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.982366   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:40.983312   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:40.983326   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.983334   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.983337   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.986184   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:41.478160   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:41.478186   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.478195   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.478205   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.482826   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:41.483571   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:41.483587   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.483597   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.483606   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.486864   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:41.487510   96006 pod_ready.go:102] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"False"

	I0417 18:52:41.978993   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:41.979015   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.979031   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.979035   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.982762   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:41.983777   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:41.983799   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.983811   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.983817   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.987561   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:42.478573   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:42.478599   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.478609   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.478623   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.482464   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:42.483352   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:42.483371   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.483379   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.483384   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.486473   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:42.978778   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:42.978800   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.978808   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.978812   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.982956   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:42.984208   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:42.984229   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.984240   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.984245   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.987545   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:43.479123   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:43.479160   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.479173   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.479178   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.482599   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:43.483500   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:43.483519   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.483529   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.483538   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.488219   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:43.488884   96006 pod_ready.go:102] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"False"

	I0417 18:52:43.978220   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:43.978245   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.978254   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.978258   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.982430   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:43.983082   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:43.983101   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.983111   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.983117   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.986478   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.478768   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:44.478792   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.478800   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.478805   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.482390   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.482993   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:44.483009   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.483017   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.483022   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.486288   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.486885   96006 pod_ready.go:92] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.486907   96006 pod_ready.go:81] duration metric: took 7.508997494s for pod "etcd-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.486931   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.487003   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706

	I0417 18:52:44.487014   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.487024   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.487033   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.489839   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.490630   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:44.490648   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.490659   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.490666   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.493317   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.493787   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.493806   96006 pod_ready.go:81] duration metric: took 6.868213ms for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.493815   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.493866   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:52:44.493875   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.493881   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.493885   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.496618   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.497206   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:44.497221   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.497228   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.497232   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.499850   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.500328   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.500346   96006 pod_ready.go:81] duration metric: took 6.524042ms for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.500354   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.500398   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m03

	I0417 18:52:44.500406   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.500413   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.500416   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.502820   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.525635   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:44.525658   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.525668   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.525674   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.529459   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.529911   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.529931   96006 pod_ready.go:81] duration metric: took 29.571504ms for pod "kube-apiserver-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.529941   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.725298   96006 request.go:629] Waited for 195.288314ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706

	I0417 18:52:44.725379   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706

	I0417 18:52:44.725389   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.725400   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.725411   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.729804   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:44.925812   96006 request.go:629] Waited for 195.39534ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:44.925880   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:44.925888   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.925896   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.925913   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.929676   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.930553   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.930576   96006 pod_ready.go:81] duration metric: took 400.628962ms for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.930586   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.125857   96006 request.go:629] Waited for 195.191389ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m02

	I0417 18:52:45.125925   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m02

	I0417 18:52:45.125932   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.125942   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.125948   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.129306   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.325424   96006 request.go:629] Waited for 195.384898ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:45.325501   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:45.325507   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.325517   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.325525   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.329384   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.329913   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:45.329940   96006 pod_ready.go:81] duration metric: took 399.345281ms for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.329956   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.526037   96006 request.go:629] Waited for 195.983642ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m03

	I0417 18:52:45.526113   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m03

	I0417 18:52:45.526118   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.526125   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.526129   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.529953   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.725683   96006 request.go:629] Waited for 195.070685ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:45.725758   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:45.725766   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.725782   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.725790   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.729681   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.730371   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:45.730395   96006 pod_ready.go:81] duration metric: took 400.429466ms for pod "kube-controller-manager-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.730409   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.925377   96006 request.go:629] Waited for 194.888012ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-hd469

	I0417 18:52:45.925484   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-hd469

	I0417 18:52:45.925490   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.925498   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.925505   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.929973   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:46.125654   96006 request.go:629] Waited for 194.431513ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:46.125734   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:46.125743   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.125755   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.125762   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.129903   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:46.130743   96006 pod_ready.go:92] pod "kube-proxy-hd469" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:46.130767   96006 pod_ready.go:81] duration metric: took 400.350111ms for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.130779   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-jlcq7" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.325821   96006 request.go:629] Waited for 194.963898ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-jlcq7

	I0417 18:52:46.325910   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-jlcq7

	I0417 18:52:46.325921   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.325931   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.325940   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.329752   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.526022   96006 request.go:629] Waited for 195.476053ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:46.526102   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:46.526108   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.526116   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.526121   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.529860   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.530884   96006 pod_ready.go:92] pod "kube-proxy-jlcq7" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:46.530902   96006 pod_ready.go:81] duration metric: took 400.117162ms for pod "kube-proxy-jlcq7" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.530913   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.726192   96006 request.go:629] Waited for 195.191733ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:52:46.726277   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:52:46.726285   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.726295   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.726299   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.729763   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.925722   96006 request.go:629] Waited for 195.405879ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:46.925783   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:46.925788   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.925795   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.925803   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.929239   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.930056   96006 pod_ready.go:92] pod "kube-proxy-qxtf4" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:46.930085   96006 pod_ready.go:81] duration metric: took 399.165332ms for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.930101   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.126140   96006 request.go:629] Waited for 195.938622ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:52:47.126218   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:52:47.126224   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.126232   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.126237   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.129831   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:47.325630   96006 request.go:629] Waited for 195.196456ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:47.325703   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:47.325716   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.325735   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.325746   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.329278   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:47.330132   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:47.330153   96006 pod_ready.go:81] duration metric: took 400.03338ms for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.330165   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.525201   96006 request.go:629] Waited for 194.96066ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:52:47.525294   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:52:47.525304   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.525312   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.525316   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.528656   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:47.725569   96006 request.go:629] Waited for 196.155088ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:47.725626   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:47.725631   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.725639   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.725643   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.730074   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:47.730804   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:47.730829   96006 pod_ready.go:81] duration metric: took 400.655349ms for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.730843   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.925724   96006 request.go:629] Waited for 194.787766ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m03

	I0417 18:52:47.925810   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m03

	I0417 18:52:47.925822   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.925829   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.925834   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.929948   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:48.125180   96006 request.go:629] Waited for 194.303544ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:48.125265   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:48.125271   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.125280   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.125285   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.128743   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:48.129451   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:48.129480   96006 pod_ready.go:81] duration metric: took 398.623814ms for pod "kube-scheduler-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:48.129495   96006 pod_ready.go:38] duration metric: took 11.199554563s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:52:48.129516   96006 api_server.go:52] waiting for apiserver process to appear ...

	I0417 18:52:48.129583   96006 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:52:48.146310   96006 api_server.go:72] duration metric: took 19.524820593s to wait for apiserver process to appear ...

	I0417 18:52:48.146344   96006 api_server.go:88] waiting for apiserver healthz status ...

	I0417 18:52:48.146377   96006 api_server.go:253] Checking apiserver healthz at https://192.168.39.159:8443/healthz ...

	I0417 18:52:48.153650   96006 api_server.go:279] https://192.168.39.159:8443/healthz returned 200:

	ok

	I0417 18:52:48.153862   96006 round_trippers.go:463] GET https://192.168.39.159:8443/version

	I0417 18:52:48.153876   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.153888   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.153894   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.154829   96006 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0417 18:52:48.154892   96006 api_server.go:141] control plane version: v1.30.0-rc.2

	I0417 18:52:48.154905   96006 api_server.go:131] duration metric: took 8.55388ms to wait for apiserver health ...

	I0417 18:52:48.154914   96006 system_pods.go:43] waiting for kube-system pods to appear ...

	I0417 18:52:48.325249   96006 request.go:629] Waited for 170.263186ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.325330   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.325336   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.325353   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.325361   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.332685   96006 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0417 18:52:48.339789   96006 system_pods.go:59] 24 kube-system pods found

	I0417 18:52:48.339819   96006 system_pods.go:61] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:52:48.339823   96006 system_pods.go:61] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:52:48.339827   96006 system_pods.go:61] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:52:48.339830   96006 system_pods.go:61] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:52:48.339833   96006 system_pods.go:61] "etcd-ha-467706-m03" [a79f9120-9c62-465e-8e06-97337c1eecd9] Running

	I0417 18:52:48.339836   96006 system_pods.go:61] "kindnet-5mvhn" [1d1c6ddb-22cf-489e-8958-41434cbf8b0c] Running

	I0417 18:52:48.339839   96006 system_pods.go:61] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:52:48.339842   96006 system_pods.go:61] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:52:48.339844   96006 system_pods.go:61] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:52:48.339848   96006 system_pods.go:61] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:52:48.339850   96006 system_pods.go:61] "kube-apiserver-ha-467706-m03" [69a7a929-d717-4c2f-9cca-c067dcc7610d] Running

	I0417 18:52:48.339853   96006 system_pods.go:61] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:52:48.339856   96006 system_pods.go:61] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:52:48.339860   96006 system_pods.go:61] "kube-controller-manager-ha-467706-m03" [ae6eeeac-1ab7-4b22-8691-69d534d6d73e] Running

	I0417 18:52:48.339862   96006 system_pods.go:61] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:52:48.339865   96006 system_pods.go:61] "kube-proxy-jlcq7" [05590f74-8ea6-42ef-9d72-33e15cfd3a32] Running

	I0417 18:52:48.339868   96006 system_pods.go:61] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:52:48.339870   96006 system_pods.go:61] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:52:48.339873   96006 system_pods.go:61] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:52:48.339876   96006 system_pods.go:61] "kube-scheduler-ha-467706-m03" [94c0d749-a1da-468b-baee-25f5177376e5] Running

	I0417 18:52:48.339878   96006 system_pods.go:61] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:52:48.339881   96006 system_pods.go:61] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:52:48.339884   96006 system_pods.go:61] "kube-vip-ha-467706-m03" [75d15d4b-ed49-4d98-aecd-713bead1e281] Running

	I0417 18:52:48.339887   96006 system_pods.go:61] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:52:48.339894   96006 system_pods.go:74] duration metric: took 184.973208ms to wait for pod list to return data ...

	I0417 18:52:48.339904   96006 default_sa.go:34] waiting for default service account to be created ...

	I0417 18:52:48.525253   96006 request.go:629] Waited for 185.260041ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:52:48.525328   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:52:48.525334   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.525343   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.525347   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.529005   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:48.529165   96006 default_sa.go:45] found service account: "default"

	I0417 18:52:48.529185   96006 default_sa.go:55] duration metric: took 189.273406ms for default service account to be created ...

	I0417 18:52:48.529198   96006 system_pods.go:116] waiting for k8s-apps to be running ...

	I0417 18:52:48.725658   96006 request.go:629] Waited for 196.383891ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.725738   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.725744   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.725752   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.725757   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.732978   96006 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0417 18:52:48.738859   96006 system_pods.go:86] 24 kube-system pods found

	I0417 18:52:48.738891   96006 system_pods.go:89] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:52:48.738897   96006 system_pods.go:89] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:52:48.738902   96006 system_pods.go:89] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:52:48.738906   96006 system_pods.go:89] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:52:48.738910   96006 system_pods.go:89] "etcd-ha-467706-m03" [a79f9120-9c62-465e-8e06-97337c1eecd9] Running

	I0417 18:52:48.738914   96006 system_pods.go:89] "kindnet-5mvhn" [1d1c6ddb-22cf-489e-8958-41434cbf8b0c] Running

	I0417 18:52:48.738918   96006 system_pods.go:89] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:52:48.738922   96006 system_pods.go:89] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:52:48.738927   96006 system_pods.go:89] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:52:48.738931   96006 system_pods.go:89] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:52:48.738935   96006 system_pods.go:89] "kube-apiserver-ha-467706-m03" [69a7a929-d717-4c2f-9cca-c067dcc7610d] Running

	I0417 18:52:48.738939   96006 system_pods.go:89] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:52:48.738943   96006 system_pods.go:89] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:52:48.738948   96006 system_pods.go:89] "kube-controller-manager-ha-467706-m03" [ae6eeeac-1ab7-4b22-8691-69d534d6d73e] Running

	I0417 18:52:48.738954   96006 system_pods.go:89] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:52:48.738958   96006 system_pods.go:89] "kube-proxy-jlcq7" [05590f74-8ea6-42ef-9d72-33e15cfd3a32] Running

	I0417 18:52:48.738965   96006 system_pods.go:89] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:52:48.738969   96006 system_pods.go:89] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:52:48.738975   96006 system_pods.go:89] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:52:48.738980   96006 system_pods.go:89] "kube-scheduler-ha-467706-m03" [94c0d749-a1da-468b-baee-25f5177376e5] Running

	I0417 18:52:48.738992   96006 system_pods.go:89] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:52:48.738995   96006 system_pods.go:89] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:52:48.738999   96006 system_pods.go:89] "kube-vip-ha-467706-m03" [75d15d4b-ed49-4d98-aecd-713bead1e281] Running

	I0417 18:52:48.739002   96006 system_pods.go:89] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:52:48.739011   96006 system_pods.go:126] duration metric: took 209.807818ms to wait for k8s-apps to be running ...

	I0417 18:52:48.739021   96006 system_svc.go:44] waiting for kubelet service to be running ....

	I0417 18:52:48.739068   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:52:48.758130   96006 system_svc.go:56] duration metric: took 19.098207ms WaitForService to wait for kubelet

	I0417 18:52:48.758166   96006 kubeadm.go:576] duration metric: took 20.136683772s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0417 18:52:48.758192   96006 node_conditions.go:102] verifying NodePressure condition ...

	I0417 18:52:48.925633   96006 request.go:629] Waited for 167.350815ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes

	I0417 18:52:48.925711   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes

	I0417 18:52:48.925717   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.925740   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.925762   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.930050   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:48.931223   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:52:48.931267   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:52:48.931278   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:52:48.931282   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:52:48.931285   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:52:48.931288   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:52:48.931292   96006 node_conditions.go:105] duration metric: took 173.095338ms to run NodePressure ...

	I0417 18:52:48.931304   96006 start.go:240] waiting for startup goroutines ...

	I0417 18:52:48.931341   96006 start.go:254] writing updated cluster config ...

	I0417 18:52:48.931624   96006 ssh_runner.go:195] Run: rm -f paused

	I0417 18:52:48.985138   96006 start.go:600] kubectl: 1.29.4, cluster: 1.30.0-rc.2 (minor skew: 1)

	I0417 18:52:48.987244   96006 out.go:177] * Done! kubectl is now configured to use "ha-467706" cluster and "default" namespace by default

	==> CRI-O <==

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.673846708Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380176673821265,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=e9bb6f29-c51c-4b70-a9ae-c8e653df8622 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.674691058Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=c0a3bbd6-77a9-461f-9b14-2ffd56539b2f name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.674865823Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=c0a3bbd6-77a9-461f-9b14-2ffd56539b2f name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.675258580Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=c0a3bbd6-77a9-461f-9b14-2ffd56539b2f name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.721348127Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=5b68067d-9614-4d83-a3b2-5c91c65a1579 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.721425182Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=5b68067d-9614-4d83-a3b2-5c91c65a1579 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.723580976Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=b4794c32-f0e5-4347-b67b-aaed19e20956 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.723998012Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380176723973392,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=b4794c32-f0e5-4347-b67b-aaed19e20956 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.724569381Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=3a078ee1-0044-4e4c-b0d5-e949db3d03fa name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.724653239Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=3a078ee1-0044-4e4c-b0d5-e949db3d03fa name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.724989321Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=3a078ee1-0044-4e4c-b0d5-e949db3d03fa name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.766160136Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=7d09b5f8-9a4e-4037-8d7f-1510e4272294 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.766257313Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=7d09b5f8-9a4e-4037-8d7f-1510e4272294 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.767797327Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=d23c1a00-ea9c-409b-ba22-fbbd64cfcc44 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.768325545Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380176768298977,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=d23c1a00-ea9c-409b-ba22-fbbd64cfcc44 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.768860808Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=511545cb-050e-4f55-b9e7-5962f1067e2a name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.768941691Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=511545cb-050e-4f55-b9e7-5962f1067e2a name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.769211735Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=511545cb-050e-4f55-b9e7-5962f1067e2a name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.811781828Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=ece06ace-7a11-4039-b8ef-5e43d65977eb name=/runtime.v1.RuntimeService/Version

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.811882355Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=ece06ace-7a11-4039-b8ef-5e43d65977eb name=/runtime.v1.RuntimeService/Version

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.812965652Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=cc6ebb06-28e6-44a7-a714-46cb945fdaa2 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.813643861Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380176813450605,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=cc6ebb06-28e6-44a7-a714-46cb945fdaa2 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.814305240Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=e0c72d74-3592-4b10-9c0b-8f378e77f496 name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.814356566Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=e0c72d74-3592-4b10-9c0b-8f378e77f496 name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:56:16 ha-467706 crio[683]: time="2024-04-17 18:56:16.814654850Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=e0c72d74-3592-4b10-9c0b-8f378e77f496 name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	93e18e5085cb7       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   3 minutes ago       Running             busybox                   0                   1b57101a3681c       busybox-fc5497c4f-r65s7

	23e69dba1da3a       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      5 minutes ago       Running             storage-provisioner       0                   b3b3a885a73fc       storage-provisioner

	143bf06c19825       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      5 minutes ago       Running             coredns                   0                   0836a6cd9f827       coredns-7db6d8ff4d-kcdqn

	56dd0755cda79       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      5 minutes ago       Running             coredns                   0                   2887673f339d8       coredns-7db6d8ff4d-56dz8

	2f2ed526ef2f9       4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5                                      5 minutes ago       Running             kindnet-cni               0                   a4a14e5274f05       kindnet-hspjv

	fe8aab67cc372       35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e                                      5 minutes ago       Running             kube-proxy                0                   269ac099b43b4       kube-proxy-hd469

	c2e7dc14e0398       ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a     6 minutes ago       Running             kube-vip                  0                   209f90ed9f3f5       kube-vip-ha-467706

	0b4b6b19cdcea       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      6 minutes ago       Running             etcd                      0                   167b41d6ec7a7       etcd-ha-467706

	d1e96d91894cf       65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1                                      6 minutes ago       Running             kube-apiserver            0                   2d8b6f55b0eab       kube-apiserver-ha-467706

	644754e2725b2       ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b                                      6 minutes ago       Running             kube-controller-manager   0                   844fdf54706b9       kube-controller-manager-ha-467706

	7f539c70ed4df       461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6                                      6 minutes ago       Running             kube-scheduler            0                   18f84a94ee364       kube-scheduler-ha-467706

	==> coredns [143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0] <==

	[INFO] 10.244.2.2:44486 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000369814s

	[INFO] 10.244.2.2:33799 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000190447s

	[INFO] 10.244.0.4:52709 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000115254s

	[INFO] 10.244.0.4:45280 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00018129s

	[INFO] 10.244.0.4:55894 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001481686s

	[INFO] 10.244.0.4:41971 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000086394s

	[INFO] 10.244.1.2:45052 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000204533s

	[INFO] 10.244.1.2:56976 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00191173s

	[INFO] 10.244.1.2:48269 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000205618s

	[INFO] 10.244.1.2:41050 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000145556s

	[INFO] 10.244.1.2:40399 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001367129s

	[INFO] 10.244.1.2:34908 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00024876s

	[INFO] 10.244.1.2:33490 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000115098s

	[INFO] 10.244.1.2:43721 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000162828s

	[INFO] 10.244.2.2:52076 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000338786s

	[INFO] 10.244.0.4:58146 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000084273s

	[INFO] 10.244.0.4:46620 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00011163s

	[INFO] 10.244.1.2:55749 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000161622s

	[INFO] 10.244.1.2:50475 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000112723s

	[INFO] 10.244.2.2:58296 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000123831s

	[INFO] 10.244.2.2:42756 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000149112s

	[INFO] 10.244.2.2:44779 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000135979s

	[INFO] 10.244.0.4:32859 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000254227s

	[INFO] 10.244.0.4:39694 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000091483s

	[INFO] 10.244.1.2:48582 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000162571s

	==> coredns [56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230] <==

	[INFO] 10.244.1.2:40690 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000216989s

	[INFO] 10.244.1.2:51761 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001998901s

	[INFO] 10.244.2.2:55936 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000277709s

	[INFO] 10.244.2.2:59321 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.021403442s

	[INFO] 10.244.2.2:33112 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000361777s

	[INFO] 10.244.2.2:44063 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.012356307s

	[INFO] 10.244.2.2:52058 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000226126s

	[INFO] 10.244.2.2:45346 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000192986s

	[INFO] 10.244.0.4:42980 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001884522s

	[INFO] 10.244.0.4:33643 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000177169s

	[INFO] 10.244.0.4:55640 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000105826s

	[INFO] 10.244.0.4:54019 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000112453s

	[INFO] 10.244.2.2:41133 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144651s

	[INFO] 10.244.2.2:59362 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000099749s

	[INFO] 10.244.2.2:32859 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000102166s

	[INFO] 10.244.0.4:33356 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000105006s

	[INFO] 10.244.0.4:56803 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000133644s

	[INFO] 10.244.1.2:34244 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000104241s

	[INFO] 10.244.1.2:43628 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000148576s

	[INFO] 10.244.2.2:50718 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000190649s

	[INFO] 10.244.0.4:44677 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00013354s

	[INFO] 10.244.0.4:45227 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000159231s

	[INFO] 10.244.1.2:46121 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135561s

	[INFO] 10.244.1.2:43459 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000116038s

	[INFO] 10.244.1.2:34953 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000088316s

	==> describe nodes <==

	Name:               ha-467706

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_04_17T18_50_05_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:50:01 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:56:11 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:00 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:00 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:00 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:19 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.159

	  Hostname:    ha-467706

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 3208cc9eadd3453fab86398575c87f4f

	  System UUID:                3208cc9e-add3-453f-ab86-398575c87f4f

	  Boot ID:                    142d9103-8e77-48a0-a260-5d3c6e2e5842

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-r65s7              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m28s

	  kube-system                 coredns-7db6d8ff4d-56dz8             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m

	  kube-system                 coredns-7db6d8ff4d-kcdqn             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m

	  kube-system                 etcd-ha-467706                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         6m13s

	  kube-system                 kindnet-hspjv                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m1s

	  kube-system                 kube-apiserver-ha-467706             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m13s

	  kube-system                 kube-controller-manager-ha-467706    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m13s

	  kube-system                 kube-proxy-hd469                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m1s

	  kube-system                 kube-scheduler-ha-467706             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m14s

	  kube-system                 kube-vip-ha-467706                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m15s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m59s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 5m59s  kube-proxy       

	  Normal  Starting                 6m13s  kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  6m13s  kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  6m13s  kubelet          Node ha-467706 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m13s  kubelet          Node ha-467706 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m13s  kubelet          Node ha-467706 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m1s   node-controller  Node ha-467706 event: Registered Node ha-467706 in Controller

	  Normal  NodeReady                5m58s  kubelet          Node ha-467706 status is now: NodeReady

	  Normal  RegisteredNode           4m48s  node-controller  Node ha-467706 event: Registered Node ha-467706 in Controller

	  Normal  RegisteredNode           3m34s  node-controller  Node ha-467706 event: Registered Node ha-467706 in Controller

	Name:               ha-467706-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_17T18_51_14_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:51:11 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706-m02

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:53:56 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.236

	  Hostname:    ha-467706-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 f49a89e0b0d7432fa507fd1ad108778d

	  System UUID:                f49a89e0-b0d7-432f-a507-fd1ad108778d

	  Boot ID:                    a312ddbf-6416-4cd3-b83f-4a865cbb9daf

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-xg855                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m28s

	  kube-system                 etcd-ha-467706-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         5m4s

	  kube-system                 kindnet-k6b9s                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      5m6s

	  kube-system                 kube-apiserver-ha-467706-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m4s

	  kube-system                 kube-controller-manager-ha-467706-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m

	  kube-system                 kube-proxy-qxtf4                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m6s

	  kube-system                 kube-scheduler-ha-467706-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m4s

	  kube-system                 kube-vip-ha-467706-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m1s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 5m1s                 kube-proxy       

	  Normal  NodeHasSufficientMemory  5m6s (x8 over 5m6s)  kubelet          Node ha-467706-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    5m6s (x8 over 5m6s)  kubelet          Node ha-467706-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     5m6s (x7 over 5m6s)  kubelet          Node ha-467706-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  5m6s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           5m1s                 node-controller  Node ha-467706-m02 event: Registered Node ha-467706-m02 in Controller

	  Normal  RegisteredNode           4m48s                node-controller  Node ha-467706-m02 event: Registered Node ha-467706-m02 in Controller

	  Normal  RegisteredNode           3m34s                node-controller  Node ha-467706-m02 event: Registered Node ha-467706-m02 in Controller

	  Normal  NodeNotReady             98s                  node-controller  Node ha-467706-m02 status is now: NodeNotReady

	Name:               ha-467706-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_17T18_52_28_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:52:25 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706-m03

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:56:10 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:25 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:25 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:25 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:36 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.250

	  Hostname:    ha-467706-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 6f9c357ef5b24ca6b2e9c8c989ff32f8

	  System UUID:                6f9c357e-f5b2-4ca6-b2e9-c8c989ff32f8

	  Boot ID:                    920b7140-01bb-49d7-ab98-44319db0cc1f

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-gzsn2                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m28s

	  kube-system                 etcd-ha-467706-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         3m50s

	  kube-system                 kindnet-5mvhn                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m52s

	  kube-system                 kube-apiserver-ha-467706-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m50s

	  kube-system                 kube-controller-manager-ha-467706-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m44s

	  kube-system                 kube-proxy-jlcq7                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m52s

	  kube-system                 kube-scheduler-ha-467706-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m50s

	  kube-system                 kube-vip-ha-467706-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m47s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m47s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  3m52s (x8 over 3m52s)  kubelet          Node ha-467706-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m52s (x8 over 3m52s)  kubelet          Node ha-467706-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m52s (x7 over 3m52s)  kubelet          Node ha-467706-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m52s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m51s                  node-controller  Node ha-467706-m03 event: Registered Node ha-467706-m03 in Controller

	  Normal  RegisteredNode           3m48s                  node-controller  Node ha-467706-m03 event: Registered Node ha-467706-m03 in Controller

	  Normal  RegisteredNode           3m34s                  node-controller  Node ha-467706-m03 event: Registered Node ha-467706-m03 in Controller

	Name:               ha-467706-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_17T18_53_25_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:53:24 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706-m04

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:56:07 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:24 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:24 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:24 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:34 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.203

	  Hostname:    ha-467706-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 dd00fe12f3b54ed0af7c6ee4cc75cc20

	  System UUID:                dd00fe12-f3b5-4ed0-af7c-6ee4cc75cc20

	  Boot ID:                    af4f4186-bd72-4c86-9e7c-b804dc030414

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-v8r5k       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      2m53s

	  kube-system                 kube-proxy-c7znr    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m53s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 2m47s                  kube-proxy       

	  Normal  RegisteredNode           2m53s                  node-controller  Node ha-467706-m04 event: Registered Node ha-467706-m04 in Controller

	  Normal  NodeHasSufficientMemory  2m53s (x2 over 2m53s)  kubelet          Node ha-467706-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    2m53s (x2 over 2m53s)  kubelet          Node ha-467706-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     2m53s (x2 over 2m53s)  kubelet          Node ha-467706-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  2m53s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m51s                  node-controller  Node ha-467706-m04 event: Registered Node ha-467706-m04 in Controller

	  Normal  RegisteredNode           2m49s                  node-controller  Node ha-467706-m04 event: Registered Node ha-467706-m04 in Controller

	  Normal  NodeReady                2m43s                  kubelet          Node ha-467706-m04 status is now: NodeReady

	==> dmesg <==

	[Apr17 18:49] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.053092] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.041003] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.561690] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.796176] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.989146] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +8.404684] systemd-fstab-generator[599]: Ignoring "noauto" option for root device

	[  +0.063801] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.068254] systemd-fstab-generator[612]: Ignoring "noauto" option for root device

	[  +0.163928] systemd-fstab-generator[626]: Ignoring "noauto" option for root device

	[  +0.151596] systemd-fstab-generator[638]: Ignoring "noauto" option for root device

	[  +0.299739] systemd-fstab-generator[668]: Ignoring "noauto" option for root device

	[  +4.466528] systemd-fstab-generator[768]: Ignoring "noauto" option for root device

	[  +0.062588] kauditd_printk_skb: 130 callbacks suppressed

	[  +4.060993] systemd-fstab-generator[950]: Ignoring "noauto" option for root device

	[  +0.990848] kauditd_printk_skb: 62 callbacks suppressed

	[Apr17 18:50] systemd-fstab-generator[1370]: Ignoring "noauto" option for root device

	[  +0.084981] kauditd_printk_skb: 35 callbacks suppressed

	[ +13.627165] kauditd_printk_skb: 21 callbacks suppressed

	[Apr17 18:51] kauditd_printk_skb: 72 callbacks suppressed

	==> etcd [0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04] <==

	{"level":"warn","ts":"2024-04-17T18:56:17.152416Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.16902Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.180267Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.180681Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.18571Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.190394Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.202172Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.219472Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.226704Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.230359Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.23359Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.234409Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.246851Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.249002Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.251621Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.257322Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.26452Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.268942Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.272368Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.278862Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.280563Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.286274Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.293376Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.328161Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:56:17.330184Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 18:56:17 up 6 min,  0 users,  load average: 0.26, 0.14, 0.06

	Linux ha-467706 5.10.207 #1 SMP Tue Apr 16 07:56:03 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d] <==

	I0417 18:55:39.560812       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	I0417 18:55:49.570846       1 main.go:223] Handling node with IPs: map[192.168.39.159:{}]

	I0417 18:55:49.570893       1 main.go:227] handling current node

	I0417 18:55:49.570903       1 main.go:223] Handling node with IPs: map[192.168.39.236:{}]

	I0417 18:55:49.570909       1 main.go:250] Node ha-467706-m02 has CIDR [10.244.1.0/24] 

	I0417 18:55:49.571009       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0417 18:55:49.571039       1 main.go:250] Node ha-467706-m03 has CIDR [10.244.2.0/24] 

	I0417 18:55:49.571144       1 main.go:223] Handling node with IPs: map[192.168.39.203:{}]

	I0417 18:55:49.571170       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	I0417 18:55:59.577627       1 main.go:223] Handling node with IPs: map[192.168.39.159:{}]

	I0417 18:55:59.577729       1 main.go:227] handling current node

	I0417 18:55:59.577753       1 main.go:223] Handling node with IPs: map[192.168.39.236:{}]

	I0417 18:55:59.577771       1 main.go:250] Node ha-467706-m02 has CIDR [10.244.1.0/24] 

	I0417 18:55:59.577892       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0417 18:55:59.577912       1 main.go:250] Node ha-467706-m03 has CIDR [10.244.2.0/24] 

	I0417 18:55:59.577977       1 main.go:223] Handling node with IPs: map[192.168.39.203:{}]

	I0417 18:55:59.577995       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	I0417 18:56:09.594417       1 main.go:223] Handling node with IPs: map[192.168.39.159:{}]

	I0417 18:56:09.594460       1 main.go:227] handling current node

	I0417 18:56:09.594471       1 main.go:223] Handling node with IPs: map[192.168.39.236:{}]

	I0417 18:56:09.594477       1 main.go:250] Node ha-467706-m02 has CIDR [10.244.1.0/24] 

	I0417 18:56:09.594574       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0417 18:56:09.594579       1 main.go:250] Node ha-467706-m03 has CIDR [10.244.2.0/24] 

	I0417 18:56:09.594623       1 main.go:223] Handling node with IPs: map[192.168.39.203:{}]

	I0417 18:56:09.594661       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f] <==

	I0417 18:50:04.318202       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0417 18:50:04.355194       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0417 18:50:04.378610       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0417 18:50:16.846627       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0417 18:50:16.894909       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	E0417 18:52:26.096584       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout

	E0417 18:52:26.096677       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0417 18:52:26.096707       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.196µs, panicked: false, err: context canceled, panic-reason: <nil>

	E0417 18:52:26.098071       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0417 18:52:26.098305       1 timeout.go:142] post-timeout activity - time-elapsed: 1.438942ms, POST "/api/v1/namespaces/kube-system/events" result: <nil>

	E0417 18:52:53.633381       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:32846: use of closed network connection

	E0417 18:52:53.851620       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55360: use of closed network connection

	E0417 18:52:54.066049       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55380: use of closed network connection

	E0417 18:52:54.312073       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55394: use of closed network connection

	E0417 18:52:54.530310       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55398: use of closed network connection

	E0417 18:52:54.749321       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55418: use of closed network connection

	E0417 18:52:54.970072       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55426: use of closed network connection

	E0417 18:52:55.170376       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55456: use of closed network connection

	E0417 18:52:55.363232       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55474: use of closed network connection

	E0417 18:52:55.704964       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55496: use of closed network connection

	E0417 18:52:55.917674       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55522: use of closed network connection

	E0417 18:52:56.149324       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55548: use of closed network connection

	E0417 18:52:56.358780       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55554: use of closed network connection

	E0417 18:52:56.573732       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55562: use of closed network connection

	W0417 18:54:12.608672       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.159 192.168.39.250]

	==> kube-controller-manager [644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e] <==

	I0417 18:51:16.104067       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-467706-m02"

	I0417 18:52:25.246945       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-467706-m03\" does not exist"

	I0417 18:52:25.263499       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-467706-m03" podCIDRs=["10.244.2.0/24"]

	I0417 18:52:26.133648       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-467706-m03"

	I0417 18:52:49.983995       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="111.444635ms"

	I0417 18:52:50.033279       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="49.02233ms"

	I0417 18:52:50.161420       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="128.074688ms"

	I0417 18:52:50.383994       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="222.50029ms"

	I0417 18:52:50.433875       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="49.821909ms"

	I0417 18:52:50.434037       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="104.115µs"

	I0417 18:52:51.508597       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="65.721µs"

	I0417 18:52:52.536956       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="17.409602ms"

	I0417 18:52:52.537269       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="205.901µs"

	I0417 18:52:53.029529       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="45.842838ms"

	I0417 18:52:53.029630       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="64.918µs"

	I0417 18:52:53.104812       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="14.029182ms"

	I0417 18:52:53.105468       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="56.414µs"

	E0417 18:53:24.007584       1 certificate_controller.go:146] Sync csr-gt8sv failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-gt8sv": the object has been modified; please apply your changes to the latest version and try again

	I0417 18:53:24.279715       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-467706-m04\" does not exist"

	I0417 18:53:24.315391       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-467706-m04" podCIDRs=["10.244.3.0/24"]

	I0417 18:53:26.172529       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-467706-m04"

	I0417 18:53:34.662934       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-467706-m04"

	I0417 18:54:39.012020       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-467706-m04"

	I0417 18:54:39.148264       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.816388ms"

	I0417 18:54:39.148404       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="57.341µs"

	==> kube-proxy [fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1] <==

	I0417 18:50:18.091985       1 server_linux.go:69] "Using iptables proxy"

	I0417 18:50:18.123753       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.159"]

	I0417 18:50:18.174594       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0417 18:50:18.174693       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0417 18:50:18.174745       1 server_linux.go:165] "Using iptables Proxier"

	I0417 18:50:18.177785       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0417 18:50:18.178232       1 server.go:872] "Version info" version="v1.30.0-rc.2"

	I0417 18:50:18.178431       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0417 18:50:18.179602       1 config.go:192] "Starting service config controller"

	I0417 18:50:18.179652       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0417 18:50:18.179690       1 config.go:101] "Starting endpoint slice config controller"

	I0417 18:50:18.179706       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0417 18:50:18.180692       1 config.go:319] "Starting node config controller"

	I0417 18:50:18.180731       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0417 18:50:18.279797       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0417 18:50:18.279873       1 shared_informer.go:320] Caches are synced for service config

	I0417 18:50:18.281317       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c] <==

	W0417 18:50:01.055262       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0417 18:50:01.058446       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0417 18:50:01.902822       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0417 18:50:01.902927       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0417 18:50:01.966916       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0417 18:50:01.967036       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0417 18:50:01.967229       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0417 18:50:01.967646       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0417 18:50:02.044397       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0417 18:50:02.045012       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0417 18:50:02.094905       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0417 18:50:02.096485       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0417 18:50:02.376262       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0417 18:50:02.376346       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0417 18:50:04.574514       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0417 18:52:25.323167       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-5mvhn\": pod kindnet-5mvhn is already assigned to node \"ha-467706-m03\"" plugin="DefaultBinder" pod="kube-system/kindnet-5mvhn" node="ha-467706-m03"

	E0417 18:52:25.323308       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 1d1c6ddb-22cf-489e-8958-41434cbf8b0c(kube-system/kindnet-5mvhn) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-5mvhn"

	E0417 18:52:25.323334       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-5mvhn\": pod kindnet-5mvhn is already assigned to node \"ha-467706-m03\"" pod="kube-system/kindnet-5mvhn"

	I0417 18:52:25.323383       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-5mvhn" node="ha-467706-m03"

	E0417 18:52:25.324325       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-jlcq7\": pod kube-proxy-jlcq7 is already assigned to node \"ha-467706-m03\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-jlcq7" node="ha-467706-m03"

	E0417 18:52:25.324409       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 05590f74-8ea6-42ef-9d72-33e15cfd3a32(kube-system/kube-proxy-jlcq7) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-jlcq7"

	E0417 18:52:25.324432       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-jlcq7\": pod kube-proxy-jlcq7 is already assigned to node \"ha-467706-m03\"" pod="kube-system/kube-proxy-jlcq7"

	I0417 18:52:25.324451       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-jlcq7" node="ha-467706-m03"

	E0417 18:53:24.402687       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-wth9x\": pod kindnet-wth9x is already assigned to node \"ha-467706-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-wth9x" node="ha-467706-m04"

	E0417 18:53:24.402914       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-wth9x\": pod kindnet-wth9x is already assigned to node \"ha-467706-m04\"" pod="kube-system/kindnet-wth9x"

	==> kubelet <==

	Apr 17 18:52:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:52:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:52:49 ha-467706 kubelet[1377]: I0417 18:52:49.986563    1377 topology_manager.go:215] "Topology Admit Handler" podUID="a14d0b32-aa41-4396-a2f7-643e8e32d96d" podNamespace="default" podName="busybox-fc5497c4f-r65s7"

	Apr 17 18:52:50 ha-467706 kubelet[1377]: I0417 18:52:50.107964    1377 reconciler_common.go:247] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92zvl\" (UniqueName: \"kubernetes.io/projected/a14d0b32-aa41-4396-a2f7-643e8e32d96d-kube-api-access-92zvl\") pod \"busybox-fc5497c4f-r65s7\" (UID: \"a14d0b32-aa41-4396-a2f7-643e8e32d96d\") " pod="default/busybox-fc5497c4f-r65s7"

	Apr 17 18:52:56 ha-467706 kubelet[1377]: E0417 18:52:56.359400    1377 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 127.0.0.1:47598->127.0.0.1:33177: write tcp 127.0.0.1:47598->127.0.0.1:33177: write: broken pipe

	Apr 17 18:53:04 ha-467706 kubelet[1377]: E0417 18:53:04.307805    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:53:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:53:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:53:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:53:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:54:04 ha-467706 kubelet[1377]: E0417 18:54:04.306427    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:54:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:54:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:54:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:54:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:55:04 ha-467706 kubelet[1377]: E0417 18:55:04.305151    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:55:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:55:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:55:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:55:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:56:04 ha-467706 kubelet[1377]: E0417 18:56:04.307844    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:56:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:56:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:56:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:56:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-467706 -n ha-467706

helpers_test.go:261: (dbg) Run:  kubectl --context ha-467706 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/StopSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/StopSecondaryNode (142.21s)

=== RUN   TestMultiControlPlane/serial/RestartSecondaryNode

ha_test.go:420: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 node start m02 -v=7 --alsologtostderr

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 3 (3.188529512s)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:56:22.049338  100401 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:56:22.049570  100401 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:22.049578  100401 out.go:304] Setting ErrFile to fd 2...

	I0417 18:56:22.049582  100401 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:22.049770  100401 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:56:22.049952  100401 out.go:298] Setting JSON to false

	I0417 18:56:22.049984  100401 mustload.go:65] Loading cluster: ha-467706

	I0417 18:56:22.050090  100401 notify.go:220] Checking for updates...

	I0417 18:56:22.050333  100401 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:56:22.050348  100401 status.go:255] checking status of ha-467706 ...

	I0417 18:56:22.050747  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:22.050801  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:22.066048  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34749

	I0417 18:56:22.066601  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:22.067286  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:22.067332  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:22.067757  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:22.067995  100401 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:56:22.069712  100401 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:56:22.069739  100401 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:22.070078  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:22.070133  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:22.085702  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39495

	I0417 18:56:22.086255  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:22.086842  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:22.086872  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:22.087194  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:22.087364  100401 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:56:22.090274  100401 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:22.090725  100401 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:22.090755  100401 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:22.090840  100401 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:22.091246  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:22.091307  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:22.106195  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39605

	I0417 18:56:22.106649  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:22.107257  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:22.107285  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:22.107632  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:22.107874  100401 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:56:22.108089  100401 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:22.108115  100401 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:56:22.111120  100401 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:22.111585  100401 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:22.111610  100401 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:22.111770  100401 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:56:22.111964  100401 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:56:22.112126  100401 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:56:22.112258  100401 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:56:22.189864  100401 ssh_runner.go:195] Run: systemctl --version

	I0417 18:56:22.196713  100401 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:22.216230  100401 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:22.216270  100401 api_server.go:166] Checking apiserver status ...

	I0417 18:56:22.216305  100401 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:22.234490  100401 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:56:22.247045  100401 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:22.247123  100401 ssh_runner.go:195] Run: ls

	I0417 18:56:22.252873  100401 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:22.259517  100401 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:22.259544  100401 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:56:22.259554  100401 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:22.259598  100401 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:56:22.259928  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:22.259977  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:22.274909  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38507

	I0417 18:56:22.275332  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:22.275876  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:22.275905  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:22.276245  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:22.276437  100401 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:56:22.278037  100401 status.go:330] ha-467706-m02 host status = "Running" (err=<nil>)

	I0417 18:56:22.278057  100401 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:22.278345  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:22.278380  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:22.292881  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37079

	I0417 18:56:22.293810  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:22.295170  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:22.295195  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:22.295544  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:22.295768  100401 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:56:22.298721  100401 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:22.299121  100401 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:22.299147  100401 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:22.299343  100401 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:22.299654  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:22.299697  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:22.316382  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36015

	I0417 18:56:22.316891  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:22.317384  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:22.317406  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:22.317720  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:22.317920  100401 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:56:22.318128  100401 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:22.318163  100401 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:56:22.320729  100401 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:22.321149  100401 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:22.321175  100401 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:22.321364  100401 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:56:22.321545  100401 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:56:22.321700  100401 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:56:22.321856  100401 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	W0417 18:56:24.817079  100401 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:24.817213  100401 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	E0417 18:56:24.817234  100401 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:24.817247  100401 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0417 18:56:24.817305  100401 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:24.817318  100401 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:56:24.817658  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:24.817717  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:24.833447  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36077

	I0417 18:56:24.833910  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:24.834409  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:24.834434  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:24.834820  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:24.835036  100401 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:56:24.836735  100401 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:56:24.836752  100401 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:24.837145  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:24.837197  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:24.852433  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41901

	I0417 18:56:24.852898  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:24.853384  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:24.853410  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:24.853771  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:24.853962  100401 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:56:24.857031  100401 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:24.857534  100401 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:24.857564  100401 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:24.857735  100401 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:24.858076  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:24.858121  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:24.873567  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40409

	I0417 18:56:24.874064  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:24.874659  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:24.874678  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:24.875014  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:24.875215  100401 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:56:24.875435  100401 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:24.875454  100401 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:56:24.878616  100401 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:24.879117  100401 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:24.879152  100401 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:24.879361  100401 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:56:24.879553  100401 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:56:24.879702  100401 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:56:24.879844  100401 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:56:24.965570  100401 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:24.982983  100401 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:24.983012  100401 api_server.go:166] Checking apiserver status ...

	I0417 18:56:24.983051  100401 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:24.998528  100401 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:56:25.011664  100401 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:25.011725  100401 ssh_runner.go:195] Run: ls

	I0417 18:56:25.017166  100401 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:25.023385  100401 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:25.023416  100401 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:56:25.023424  100401 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:25.023440  100401 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:56:25.023722  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:25.023770  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:25.038802  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38451

	I0417 18:56:25.039279  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:25.039790  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:25.039815  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:25.040188  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:25.040397  100401 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:56:25.041953  100401 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:56:25.041975  100401 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:25.042258  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:25.042292  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:25.057361  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33299

	I0417 18:56:25.057845  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:25.058409  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:25.058460  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:25.058794  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:25.059032  100401 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:56:25.062008  100401 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:25.062549  100401 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:25.062592  100401 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:25.062686  100401 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:25.063020  100401 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:25.063068  100401 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:25.078482  100401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46803

	I0417 18:56:25.078979  100401 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:25.079531  100401 main.go:141] libmachine: Using API Version  1

	I0417 18:56:25.079558  100401 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:25.079895  100401 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:25.080095  100401 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:56:25.080322  100401 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:25.080350  100401 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:56:25.083504  100401 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:25.084008  100401 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:25.084043  100401 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:25.084202  100401 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:56:25.084390  100401 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:56:25.084554  100401 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:56:25.084703  100401 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:56:25.164927  100401 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:25.180685  100401 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 3 (5.395670672s)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:56:25.983846  100496 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:56:25.983970  100496 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:25.983980  100496 out.go:304] Setting ErrFile to fd 2...

	I0417 18:56:25.983984  100496 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:25.984179  100496 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:56:25.984365  100496 out.go:298] Setting JSON to false

	I0417 18:56:25.984393  100496 mustload.go:65] Loading cluster: ha-467706

	I0417 18:56:25.984543  100496 notify.go:220] Checking for updates...

	I0417 18:56:25.984816  100496 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:56:25.984836  100496 status.go:255] checking status of ha-467706 ...

	I0417 18:56:25.985999  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:25.986078  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:26.001867  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35359

	I0417 18:56:26.002318  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:26.002933  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:26.002957  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:26.003387  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:26.003681  100496 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:56:26.005564  100496 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:56:26.005586  100496 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:26.005881  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:26.005930  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:26.021918  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37095

	I0417 18:56:26.022336  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:26.022862  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:26.022889  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:26.023202  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:26.023445  100496 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:56:26.026366  100496 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:26.026859  100496 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:26.026902  100496 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:26.027040  100496 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:26.027366  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:26.027396  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:26.042908  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45161

	I0417 18:56:26.043385  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:26.043923  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:26.043945  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:26.044306  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:26.044488  100496 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:56:26.044731  100496 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:26.044759  100496 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:56:26.047799  100496 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:26.048232  100496 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:26.048256  100496 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:26.048501  100496 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:56:26.048690  100496 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:56:26.048875  100496 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:56:26.049010  100496 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:56:26.129225  100496 ssh_runner.go:195] Run: systemctl --version

	I0417 18:56:26.136441  100496 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:26.153099  100496 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:26.153142  100496 api_server.go:166] Checking apiserver status ...

	I0417 18:56:26.153189  100496 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:26.168449  100496 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:56:26.180426  100496 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:26.180496  100496 ssh_runner.go:195] Run: ls

	I0417 18:56:26.185401  100496 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:26.191668  100496 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:26.191699  100496 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:56:26.191720  100496 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:26.191743  100496 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:56:26.192064  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:26.192122  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:26.208040  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32857

	I0417 18:56:26.208492  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:26.209073  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:26.209103  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:26.209461  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:26.209708  100496 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:56:26.211498  100496 status.go:330] ha-467706-m02 host status = "Running" (err=<nil>)

	I0417 18:56:26.211518  100496 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:26.211841  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:26.211889  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:26.228910  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37183

	I0417 18:56:26.229337  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:26.229848  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:26.229892  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:26.230232  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:26.230437  100496 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:56:26.233934  100496 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:26.234378  100496 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:26.234411  100496 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:26.234526  100496 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:26.234849  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:26.234918  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:26.250154  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41993

	I0417 18:56:26.250599  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:26.251098  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:26.251122  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:26.251442  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:26.251676  100496 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:56:26.251900  100496 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:26.251923  100496 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:56:26.254493  100496 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:26.254865  100496 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:26.254897  100496 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:26.255006  100496 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:56:26.255190  100496 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:56:26.255343  100496 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:56:26.255455  100496 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	W0417 18:56:27.885078  100496 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:27.885136  100496 retry.go:31] will retry after 208.959764ms: dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:30.957149  100496 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:30.957307  100496 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	E0417 18:56:30.957335  100496 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:30.957342  100496 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0417 18:56:30.957368  100496 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:30.957377  100496 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:56:30.957683  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:30.957721  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:30.972860  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37381

	I0417 18:56:30.973343  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:30.973816  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:30.973836  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:30.974234  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:30.974445  100496 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:56:30.976048  100496 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:56:30.976065  100496 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:30.976469  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:30.976517  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:30.992861  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41223

	I0417 18:56:30.993342  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:30.993833  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:30.993855  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:30.994137  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:30.994342  100496 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:56:30.996748  100496 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:30.997321  100496 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:30.997366  100496 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:30.997434  100496 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:30.997738  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:30.997784  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:31.013304  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37913

	I0417 18:56:31.013800  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:31.014311  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:31.014331  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:31.014641  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:31.014883  100496 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:56:31.015099  100496 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:31.015137  100496 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:56:31.017828  100496 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:31.018246  100496 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:31.018273  100496 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:31.018442  100496 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:56:31.018603  100496 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:56:31.018754  100496 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:56:31.018892  100496 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:56:31.100587  100496 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:31.118619  100496 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:31.118654  100496 api_server.go:166] Checking apiserver status ...

	I0417 18:56:31.118696  100496 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:31.135872  100496 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:56:31.147061  100496 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:31.147134  100496 ssh_runner.go:195] Run: ls

	I0417 18:56:31.152347  100496 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:31.159055  100496 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:31.159084  100496 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:56:31.159093  100496 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:31.159122  100496 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:56:31.159490  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:31.159531  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:31.175242  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35913

	I0417 18:56:31.175833  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:31.176365  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:31.176380  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:31.176658  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:31.176932  100496 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:56:31.178513  100496 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:56:31.178530  100496 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:31.178821  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:31.178847  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:31.194943  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33619

	I0417 18:56:31.195438  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:31.196004  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:31.196026  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:31.196356  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:31.196564  100496 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:56:31.199502  100496 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:31.199905  100496 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:31.199934  100496 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:31.200114  100496 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:31.200452  100496 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:31.200504  100496 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:31.216882  100496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32769

	I0417 18:56:31.217291  100496 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:31.217864  100496 main.go:141] libmachine: Using API Version  1

	I0417 18:56:31.217889  100496 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:31.218200  100496 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:31.218408  100496 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:56:31.218588  100496 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:31.218611  100496 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:56:31.221062  100496 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:31.221479  100496 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:31.221508  100496 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:31.221699  100496 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:56:31.221917  100496 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:56:31.222076  100496 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:56:31.222297  100496 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:56:31.304578  100496 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:31.320323  100496 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 3 (4.166409031s)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:56:33.495095  100602 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:56:33.495263  100602 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:33.495279  100602 out.go:304] Setting ErrFile to fd 2...

	I0417 18:56:33.495298  100602 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:33.495513  100602 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:56:33.495721  100602 out.go:298] Setting JSON to false

	I0417 18:56:33.495756  100602 mustload.go:65] Loading cluster: ha-467706

	I0417 18:56:33.495883  100602 notify.go:220] Checking for updates...

	I0417 18:56:33.496217  100602 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:56:33.496235  100602 status.go:255] checking status of ha-467706 ...

	I0417 18:56:33.496709  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:33.496812  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:33.517508  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42457

	I0417 18:56:33.517959  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:33.518616  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:33.518652  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:33.519018  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:33.519238  100602 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:56:33.520739  100602 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:56:33.520760  100602 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:33.521208  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:33.521287  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:33.537704  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37357

	I0417 18:56:33.538282  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:33.538825  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:33.538846  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:33.539176  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:33.539405  100602 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:56:33.542392  100602 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:33.542881  100602 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:33.542910  100602 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:33.543044  100602 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:33.543342  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:33.543385  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:33.559907  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35217

	I0417 18:56:33.560509  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:33.561076  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:33.561102  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:33.561446  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:33.561657  100602 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:56:33.561875  100602 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:33.561915  100602 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:56:33.564712  100602 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:33.565177  100602 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:33.565214  100602 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:33.565390  100602 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:56:33.565557  100602 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:56:33.565750  100602 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:56:33.565919  100602 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:56:33.645358  100602 ssh_runner.go:195] Run: systemctl --version

	I0417 18:56:33.651692  100602 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:33.667754  100602 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:33.667798  100602 api_server.go:166] Checking apiserver status ...

	I0417 18:56:33.667845  100602 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:33.682922  100602 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:56:33.693781  100602 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:33.693842  100602 ssh_runner.go:195] Run: ls

	I0417 18:56:33.698535  100602 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:33.703358  100602 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:33.703388  100602 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:56:33.703401  100602 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:33.703423  100602 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:56:33.703860  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:33.703913  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:33.719399  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46743

	I0417 18:56:33.719886  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:33.720588  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:33.720614  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:33.721008  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:33.721226  100602 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:56:33.722820  100602 status.go:330] ha-467706-m02 host status = "Running" (err=<nil>)

	I0417 18:56:33.722839  100602 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:33.723182  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:33.723221  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:33.739106  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36767

	I0417 18:56:33.739545  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:33.739998  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:33.740029  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:33.740317  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:33.740534  100602 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:56:33.743442  100602 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:33.743861  100602 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:33.743897  100602 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:33.744069  100602 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:33.744382  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:33.744421  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:33.759611  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44907

	I0417 18:56:33.760074  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:33.760634  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:33.760853  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:33.762471  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:33.762696  100602 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:56:33.762951  100602 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:33.762985  100602 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:56:33.765850  100602 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:33.766270  100602 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:33.766315  100602 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:33.766350  100602 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:56:33.766543  100602 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:56:33.766705  100602 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:56:33.766847  100602 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	W0417 18:56:34.029000  100602 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:34.029066  100602 retry.go:31] will retry after 143.479411ms: dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:37.233171  100602 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:37.233306  100602 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	E0417 18:56:37.233330  100602 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:37.233352  100602 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0417 18:56:37.233388  100602 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:37.233401  100602 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:56:37.233765  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:37.233839  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:37.249402  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34371

	I0417 18:56:37.249877  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:37.250381  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:37.250406  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:37.250767  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:37.250977  100602 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:56:37.252717  100602 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:56:37.252735  100602 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:37.253052  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:37.253103  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:37.268238  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34429

	I0417 18:56:37.268727  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:37.269339  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:37.269370  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:37.269701  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:37.269929  100602 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:56:37.272865  100602 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:37.273340  100602 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:37.273360  100602 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:37.273511  100602 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:37.273794  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:37.273830  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:37.290852  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34431

	I0417 18:56:37.291245  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:37.291717  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:37.291746  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:37.292085  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:37.292271  100602 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:56:37.292471  100602 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:37.292493  100602 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:56:37.295158  100602 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:37.295567  100602 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:37.295609  100602 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:37.295763  100602 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:56:37.295950  100602 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:56:37.296096  100602 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:56:37.296259  100602 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:56:37.377143  100602 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:37.395599  100602 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:37.395632  100602 api_server.go:166] Checking apiserver status ...

	I0417 18:56:37.395675  100602 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:37.414041  100602 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:56:37.427682  100602 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:37.427738  100602 ssh_runner.go:195] Run: ls

	I0417 18:56:37.433066  100602 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:37.439961  100602 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:37.439999  100602 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:56:37.440012  100602 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:37.440037  100602 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:56:37.440494  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:37.440552  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:37.456148  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37515

	I0417 18:56:37.456592  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:37.457130  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:37.457156  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:37.457477  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:37.457662  100602 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:56:37.459271  100602 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:56:37.459284  100602 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:37.459559  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:37.459598  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:37.475140  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34661

	I0417 18:56:37.475588  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:37.476039  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:37.476062  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:37.476409  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:37.476610  100602 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:56:37.479500  100602 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:37.479941  100602 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:37.479974  100602 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:37.480085  100602 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:37.480397  100602 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:37.480441  100602 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:37.496368  100602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45273

	I0417 18:56:37.496925  100602 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:37.497415  100602 main.go:141] libmachine: Using API Version  1

	I0417 18:56:37.497438  100602 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:37.497812  100602 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:37.498016  100602 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:56:37.498199  100602 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:37.498225  100602 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:56:37.501180  100602 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:37.501664  100602 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:37.501689  100602 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:37.501909  100602 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:56:37.502097  100602 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:56:37.502230  100602 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:56:37.502344  100602 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:56:37.584144  100602 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:37.599085  100602 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 3 (4.119121066s)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:56:40.029889  100697 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:56:40.030042  100697 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:40.030054  100697 out.go:304] Setting ErrFile to fd 2...

	I0417 18:56:40.030060  100697 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:40.030308  100697 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:56:40.030531  100697 out.go:298] Setting JSON to false

	I0417 18:56:40.030562  100697 mustload.go:65] Loading cluster: ha-467706

	I0417 18:56:40.030735  100697 notify.go:220] Checking for updates...

	I0417 18:56:40.030938  100697 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:56:40.030953  100697 status.go:255] checking status of ha-467706 ...

	I0417 18:56:40.031344  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:40.031407  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:40.053211  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46581

	I0417 18:56:40.053721  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:40.054377  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:40.054436  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:40.054790  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:40.054997  100697 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:56:40.056690  100697 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:56:40.056710  100697 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:40.057058  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:40.057096  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:40.074520  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39613

	I0417 18:56:40.075017  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:40.075512  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:40.075535  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:40.075964  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:40.076251  100697 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:56:40.079250  100697 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:40.079771  100697 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:40.079797  100697 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:40.079991  100697 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:40.080306  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:40.080342  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:40.096344  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33649

	I0417 18:56:40.096847  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:40.097391  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:40.097414  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:40.097798  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:40.098050  100697 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:56:40.098250  100697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:40.098277  100697 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:56:40.101544  100697 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:40.101963  100697 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:40.101991  100697 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:40.102170  100697 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:56:40.102337  100697 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:56:40.102510  100697 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:56:40.102678  100697 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:56:40.180696  100697 ssh_runner.go:195] Run: systemctl --version

	I0417 18:56:40.187430  100697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:40.202838  100697 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:40.202881  100697 api_server.go:166] Checking apiserver status ...

	I0417 18:56:40.202915  100697 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:40.218496  100697 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:56:40.228824  100697 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:40.228904  100697 ssh_runner.go:195] Run: ls

	I0417 18:56:40.234363  100697 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:40.239014  100697 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:40.239046  100697 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:56:40.239061  100697 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:40.239082  100697 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:56:40.239499  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:40.239551  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:40.255774  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36463

	I0417 18:56:40.256208  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:40.256701  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:40.256732  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:40.257072  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:40.257264  100697 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:56:40.258785  100697 status.go:330] ha-467706-m02 host status = "Running" (err=<nil>)

	I0417 18:56:40.258803  100697 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:40.259624  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:40.259675  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:40.276817  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34629

	I0417 18:56:40.277340  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:40.277868  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:40.277899  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:40.278221  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:40.278400  100697 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:56:40.281460  100697 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:40.281842  100697 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:40.281870  100697 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:40.281993  100697 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:40.282310  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:40.282366  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:40.297877  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39781

	I0417 18:56:40.298317  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:40.298943  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:40.298975  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:40.299348  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:40.299559  100697 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:56:40.299799  100697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:40.299823  100697 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:56:40.303067  100697 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:40.303487  100697 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:40.303523  100697 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:40.303738  100697 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:56:40.303923  100697 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:56:40.304129  100697 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:56:40.304353  100697 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	W0417 18:56:40.304960  100697 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:40.305019  100697 retry.go:31] will retry after 362.070071ms: dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:43.725031  100697 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:43.725129  100697 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	E0417 18:56:43.725158  100697 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:43.725165  100697 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0417 18:56:43.725190  100697 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:43.725197  100697 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:56:43.725636  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:43.725687  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:43.741261  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44927

	I0417 18:56:43.741684  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:43.742149  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:43.742175  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:43.742531  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:43.742764  100697 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:56:43.744446  100697 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:56:43.744471  100697 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:43.744797  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:43.744847  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:43.759788  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37799

	I0417 18:56:43.760315  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:43.760836  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:43.760861  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:43.761223  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:43.761472  100697 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:56:43.764317  100697 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:43.764808  100697 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:43.764840  100697 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:43.764963  100697 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:43.765355  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:43.765394  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:43.782027  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39089

	I0417 18:56:43.782445  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:43.782920  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:43.782942  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:43.783284  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:43.783469  100697 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:56:43.783678  100697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:43.783699  100697 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:56:43.786381  100697 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:43.786849  100697 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:43.786888  100697 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:43.787085  100697 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:56:43.787275  100697 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:56:43.787439  100697 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:56:43.787582  100697 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:56:43.868821  100697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:43.884490  100697 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:43.884523  100697 api_server.go:166] Checking apiserver status ...

	I0417 18:56:43.884566  100697 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:43.899688  100697 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:56:43.917745  100697 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:43.917813  100697 ssh_runner.go:195] Run: ls

	I0417 18:56:43.923048  100697 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:43.927498  100697 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:43.927525  100697 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:56:43.927534  100697 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:43.927552  100697 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:56:43.927836  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:43.927873  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:43.943347  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35425

	I0417 18:56:43.943819  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:43.944294  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:43.944318  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:43.944630  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:43.944847  100697 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:56:43.946710  100697 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:56:43.946739  100697 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:43.947018  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:43.947054  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:43.962537  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46085

	I0417 18:56:43.963051  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:43.963657  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:43.963680  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:43.964030  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:43.964246  100697 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:56:43.967669  100697 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:43.968075  100697 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:43.968118  100697 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:43.968298  100697 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:43.968616  100697 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:43.968667  100697 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:43.985402  100697 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44499

	I0417 18:56:43.985825  100697 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:43.986320  100697 main.go:141] libmachine: Using API Version  1

	I0417 18:56:43.986343  100697 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:43.986691  100697 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:43.986883  100697 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:56:43.987053  100697 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:43.987070  100697 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:56:43.989784  100697 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:43.990186  100697 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:43.990207  100697 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:43.990404  100697 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:56:43.990589  100697 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:56:43.990779  100697 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:56:43.990976  100697 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:56:44.073168  100697 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:44.089314  100697 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 3 (4.514418429s)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:56:45.935988  100793 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:56:45.936265  100793 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:45.936275  100793 out.go:304] Setting ErrFile to fd 2...

	I0417 18:56:45.936279  100793 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:45.936522  100793 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:56:45.936752  100793 out.go:298] Setting JSON to false

	I0417 18:56:45.936818  100793 mustload.go:65] Loading cluster: ha-467706

	I0417 18:56:45.936933  100793 notify.go:220] Checking for updates...

	I0417 18:56:45.937297  100793 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:56:45.937314  100793 status.go:255] checking status of ha-467706 ...

	I0417 18:56:45.937735  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:45.937804  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:45.954203  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46153

	I0417 18:56:45.954658  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:45.955353  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:45.955382  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:45.955748  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:45.955959  100793 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:56:45.957837  100793 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:56:45.957857  100793 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:45.958270  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:45.958318  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:45.973672  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38613

	I0417 18:56:45.974072  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:45.974563  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:45.974580  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:45.974960  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:45.975208  100793 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:56:45.978101  100793 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:45.978441  100793 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:45.978467  100793 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:45.978630  100793 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:45.978943  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:45.978999  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:45.994716  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44777

	I0417 18:56:45.995136  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:45.995589  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:45.995609  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:45.995917  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:45.996128  100793 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:56:45.996359  100793 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:45.996401  100793 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:56:45.999429  100793 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:45.999890  100793 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:45.999922  100793 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:46.000059  100793 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:56:46.000261  100793 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:56:46.000496  100793 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:56:46.000745  100793 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:56:46.077093  100793 ssh_runner.go:195] Run: systemctl --version

	I0417 18:56:46.083751  100793 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:46.103301  100793 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:46.103338  100793 api_server.go:166] Checking apiserver status ...

	I0417 18:56:46.103376  100793 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:46.118794  100793 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:56:46.129426  100793 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:46.129532  100793 ssh_runner.go:195] Run: ls

	I0417 18:56:46.134874  100793 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:46.139102  100793 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:46.139127  100793 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:56:46.139136  100793 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:46.139151  100793 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:56:46.139456  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:46.139507  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:46.155317  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44993

	I0417 18:56:46.155816  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:46.156398  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:46.156425  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:46.156783  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:46.156970  100793 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:56:46.158666  100793 status.go:330] ha-467706-m02 host status = "Running" (err=<nil>)

	I0417 18:56:46.158685  100793 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:46.158994  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:46.159044  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:46.173961  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43991

	I0417 18:56:46.174412  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:46.174888  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:46.174914  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:46.175276  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:46.175477  100793 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:56:46.178406  100793 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:46.178859  100793 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:46.178900  100793 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:46.179186  100793 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:46.179573  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:46.179630  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:46.194962  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37257

	I0417 18:56:46.195372  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:46.195864  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:46.195891  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:46.196206  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:46.196394  100793 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:56:46.196618  100793 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:46.196640  100793 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:56:46.199318  100793 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:46.199771  100793 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:46.199802  100793 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:46.199983  100793 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:56:46.200159  100793 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:56:46.200340  100793 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:56:46.200472  100793 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	W0417 18:56:46.797000  100793 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:46.797062  100793 retry.go:31] will retry after 160.233772ms: dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:50.029037  100793 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:50.029135  100793 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	E0417 18:56:50.029155  100793 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:50.029189  100793 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0417 18:56:50.029226  100793 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:50.029234  100793 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:56:50.029682  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:50.029745  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:50.044840  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34487

	I0417 18:56:50.045322  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:50.045802  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:50.045832  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:50.046182  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:50.046395  100793 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:56:50.048049  100793 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:56:50.048065  100793 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:50.048365  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:50.048418  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:50.063861  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38465

	I0417 18:56:50.064348  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:50.064927  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:50.064956  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:50.065346  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:50.065565  100793 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:56:50.068592  100793 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:50.069080  100793 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:50.069100  100793 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:50.069257  100793 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:50.069574  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:50.069637  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:50.084358  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40313

	I0417 18:56:50.084870  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:50.085379  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:50.085404  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:50.085756  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:50.085975  100793 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:56:50.086173  100793 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:50.086198  100793 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:56:50.089160  100793 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:50.089600  100793 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:50.089625  100793 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:50.089822  100793 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:56:50.089998  100793 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:56:50.090170  100793 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:56:50.090290  100793 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:56:50.176677  100793 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:50.194936  100793 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:50.194966  100793 api_server.go:166] Checking apiserver status ...

	I0417 18:56:50.194995  100793 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:50.212070  100793 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:56:50.224648  100793 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:50.224706  100793 ssh_runner.go:195] Run: ls

	I0417 18:56:50.229759  100793 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:50.234982  100793 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:50.235013  100793 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:56:50.235026  100793 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:50.235047  100793 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:56:50.235387  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:50.235424  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:50.250652  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42407

	I0417 18:56:50.251241  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:50.251762  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:50.251797  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:50.252141  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:50.252341  100793 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:56:50.254023  100793 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:56:50.254045  100793 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:50.254430  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:50.254471  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:50.269302  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43283

	I0417 18:56:50.269713  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:50.270268  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:50.270298  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:50.270694  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:50.270926  100793 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:56:50.274161  100793 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:50.274623  100793 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:50.274667  100793 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:50.274779  100793 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:50.275133  100793 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:50.275197  100793 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:50.290601  100793 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43763

	I0417 18:56:50.291186  100793 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:50.291690  100793 main.go:141] libmachine: Using API Version  1

	I0417 18:56:50.291720  100793 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:50.292064  100793 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:50.292287  100793 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:56:50.292527  100793 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:50.292558  100793 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:56:50.295551  100793 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:50.295997  100793 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:50.296022  100793 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:50.296174  100793 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:56:50.296377  100793 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:56:50.296520  100793 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:56:50.296681  100793 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:56:50.376276  100793 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:50.391896  100793 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 3 (3.769389394s)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Error

	kubelet: Nonexistent

	apiserver: Nonexistent

	kubeconfig: Configured

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:56:55.313284  100900 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:56:55.313427  100900 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:55.313441  100900 out.go:304] Setting ErrFile to fd 2...

	I0417 18:56:55.313447  100900 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:56:55.313706  100900 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:56:55.313886  100900 out.go:298] Setting JSON to false

	I0417 18:56:55.313914  100900 mustload.go:65] Loading cluster: ha-467706

	I0417 18:56:55.313954  100900 notify.go:220] Checking for updates...

	I0417 18:56:55.314294  100900 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:56:55.314311  100900 status.go:255] checking status of ha-467706 ...

	I0417 18:56:55.314798  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:55.314879  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:55.335372  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40821

	I0417 18:56:55.335882  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:55.336442  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:55.336477  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:55.337001  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:55.337182  100900 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:56:55.338934  100900 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:56:55.338949  100900 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:55.339226  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:55.339262  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:55.354965  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38187

	I0417 18:56:55.355444  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:55.355995  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:55.356034  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:55.356474  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:55.356730  100900 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:56:55.359792  100900 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:55.360198  100900 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:55.360224  100900 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:55.360376  100900 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:56:55.360664  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:55.360700  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:55.375632  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33495

	I0417 18:56:55.376073  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:55.376563  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:55.376587  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:55.376951  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:55.377165  100900 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:56:55.377380  100900 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:55.377406  100900 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:56:55.380159  100900 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:55.380753  100900 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:56:55.380794  100900 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:56:55.380975  100900 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:56:55.381153  100900 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:56:55.381331  100900 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:56:55.381511  100900 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:56:55.460806  100900 ssh_runner.go:195] Run: systemctl --version

	I0417 18:56:55.467430  100900 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:55.483673  100900 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:55.483719  100900 api_server.go:166] Checking apiserver status ...

	I0417 18:56:55.483753  100900 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:55.500195  100900 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:56:55.513786  100900 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:55.513872  100900 ssh_runner.go:195] Run: ls

	I0417 18:56:55.519464  100900 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:55.525768  100900 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:55.525808  100900 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:56:55.525823  100900 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:55.525850  100900 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:56:55.526179  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:55.526216  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:55.541925  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46041

	I0417 18:56:55.542544  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:55.543194  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:55.543233  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:55.543653  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:55.543924  100900 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:56:55.545596  100900 status.go:330] ha-467706-m02 host status = "Running" (err=<nil>)

	I0417 18:56:55.545615  100900 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:55.545933  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:55.545980  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:55.561298  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34855

	I0417 18:56:55.561796  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:55.562287  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:55.562317  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:55.562635  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:55.562912  100900 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:56:55.566028  100900 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:55.566465  100900 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:55.566490  100900 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:55.566643  100900 host.go:66] Checking if "ha-467706-m02" exists ...

	I0417 18:56:55.566942  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:55.566983  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:55.583580  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44635

	I0417 18:56:55.584067  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:55.584515  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:55.584536  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:55.584910  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:55.585098  100900 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:56:55.585271  100900 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:55.585288  100900 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:56:55.588000  100900 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:55.588424  100900 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:56:55.588454  100900 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:56:55.588717  100900 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:56:55.588946  100900 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:56:55.589121  100900 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:56:55.589284  100900 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	W0417 18:56:58.669036  100900 sshutil.go:64] dial failure (will retry): dial tcp 192.168.39.236:22: connect: no route to host

	W0417 18:56:58.669143  100900 start.go:268] error running df -h /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	E0417 18:56:58.669164  100900 status.go:376] failed to get storage capacity of /var: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:58.669173  100900 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Error Kubelet:Nonexistent APIServer:Nonexistent Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	E0417 18:56:58.669193  100900 status.go:260] status error: NewSession: new client: new client: dial tcp 192.168.39.236:22: connect: no route to host

	I0417 18:56:58.669205  100900 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:56:58.669531  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:58.669595  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:58.685005  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44107

	I0417 18:56:58.685524  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:58.686079  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:58.686106  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:58.686525  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:58.686742  100900 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:56:58.688858  100900 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:56:58.688877  100900 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:58.689172  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:58.689208  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:58.704174  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40419

	I0417 18:56:58.704669  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:58.705319  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:58.705356  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:58.705774  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:58.706019  100900 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:56:58.708834  100900 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:58.709326  100900 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:58.709354  100900 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:58.709500  100900 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:56:58.709789  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:58.709825  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:58.725546  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39837

	I0417 18:56:58.725985  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:58.726455  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:58.726477  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:58.726801  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:58.726987  100900 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:56:58.727211  100900 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:58.727232  100900 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:56:58.729878  100900 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:58.730309  100900 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:56:58.730337  100900 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:56:58.730468  100900 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:56:58.730642  100900 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:56:58.730807  100900 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:56:58.730954  100900 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:56:58.812605  100900 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:58.827691  100900 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:56:58.827725  100900 api_server.go:166] Checking apiserver status ...

	I0417 18:56:58.827761  100900 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:56:58.843407  100900 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:56:58.854035  100900 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:56:58.854101  100900 ssh_runner.go:195] Run: ls

	I0417 18:56:58.858993  100900 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:56:58.863399  100900 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:56:58.863423  100900 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:56:58.863432  100900 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:56:58.863449  100900 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:56:58.863773  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:58.863810  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:58.879375  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42557

	I0417 18:56:58.879932  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:58.880449  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:58.880475  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:58.880818  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:58.881006  100900 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:56:58.882612  100900 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:56:58.882631  100900 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:58.882990  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:58.883039  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:58.898779  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46329

	I0417 18:56:58.899226  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:58.899798  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:58.899826  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:58.900242  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:58.900429  100900 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:56:58.903195  100900 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:58.903601  100900 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:58.903639  100900 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:58.903776  100900 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:56:58.904083  100900 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:56:58.904120  100900 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:56:58.919354  100900 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44201

	I0417 18:56:58.919841  100900 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:56:58.920353  100900 main.go:141] libmachine: Using API Version  1

	I0417 18:56:58.920376  100900 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:56:58.920709  100900 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:56:58.920915  100900 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:56:58.921148  100900 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:56:58.921172  100900 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:56:58.924373  100900 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:58.924962  100900 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:56:58.924992  100900 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:56:58.925176  100900 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:56:58.925383  100900 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:56:58.925642  100900 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:56:58.925836  100900 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:56:59.005333  100900 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:56:59.020968  100900 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:428: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr

ha_test.go:428: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr: exit status 7 (669.218243ms)

-- stdout --

	ha-467706

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-467706-m03

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Running

	kubeconfig: Configured

	ha-467706-m04

	type: Worker

	host: Running

	kubelet: Running

-- /stdout --

** stderr ** 

	I0417 18:57:10.422162  101037 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:57:10.422333  101037 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:57:10.422347  101037 out.go:304] Setting ErrFile to fd 2...

	I0417 18:57:10.422351  101037 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:57:10.422564  101037 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:57:10.422781  101037 out.go:298] Setting JSON to false

	I0417 18:57:10.422817  101037 mustload.go:65] Loading cluster: ha-467706

	I0417 18:57:10.422890  101037 notify.go:220] Checking for updates...

	I0417 18:57:10.423287  101037 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:57:10.423305  101037 status.go:255] checking status of ha-467706 ...

	I0417 18:57:10.423766  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.423844  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.442967  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39093

	I0417 18:57:10.443432  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.444032  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.444062  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.444538  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.444800  101037 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:57:10.446488  101037 status.go:330] ha-467706 host status = "Running" (err=<nil>)

	I0417 18:57:10.446507  101037 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:57:10.446941  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.446994  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.462312  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35073

	I0417 18:57:10.462760  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.463320  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.463344  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.463693  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.463917  101037 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:57:10.466669  101037 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:57:10.467100  101037 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:57:10.467126  101037 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:57:10.467325  101037 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:57:10.467663  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.467703  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.483063  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34369

	I0417 18:57:10.483528  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.484021  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.484045  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.484354  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.484563  101037 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:57:10.484791  101037 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:57:10.484818  101037 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:57:10.487735  101037 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:57:10.488229  101037 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:57:10.488255  101037 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:57:10.488405  101037 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:57:10.488634  101037 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:57:10.488803  101037 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:57:10.488961  101037 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:57:10.572069  101037 ssh_runner.go:195] Run: systemctl --version

	I0417 18:57:10.580304  101037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:57:10.598244  101037 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:57:10.598287  101037 api_server.go:166] Checking apiserver status ...

	I0417 18:57:10.598345  101037 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:57:10.618993  101037 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup

	W0417 18:57:10.630727  101037 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1211/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:57:10.630792  101037 ssh_runner.go:195] Run: ls

	I0417 18:57:10.636140  101037 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:57:10.640727  101037 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:57:10.640753  101037 status.go:422] ha-467706 apiserver status = Running (err=<nil>)

	I0417 18:57:10.640764  101037 status.go:257] ha-467706 status: &{Name:ha-467706 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:57:10.640798  101037 status.go:255] checking status of ha-467706-m02 ...

	I0417 18:57:10.641094  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.641136  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.656248  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43041

	I0417 18:57:10.656698  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.657348  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.657373  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.657699  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.657914  101037 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:57:10.659472  101037 status.go:330] ha-467706-m02 host status = "Stopped" (err=<nil>)

	I0417 18:57:10.659490  101037 status.go:343] host is not running, skipping remaining checks

	I0417 18:57:10.659498  101037 status.go:257] ha-467706-m02 status: &{Name:ha-467706-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:57:10.659521  101037 status.go:255] checking status of ha-467706-m03 ...

	I0417 18:57:10.659857  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.659897  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.674696  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40751

	I0417 18:57:10.675178  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.677312  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.677343  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.677723  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.677945  101037 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:57:10.679497  101037 status.go:330] ha-467706-m03 host status = "Running" (err=<nil>)

	I0417 18:57:10.679513  101037 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:57:10.679798  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.679843  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.694567  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33811

	I0417 18:57:10.694975  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.695454  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.695480  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.695870  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.696056  101037 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:57:10.698761  101037 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:57:10.699293  101037 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:57:10.699321  101037 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:57:10.699476  101037 host.go:66] Checking if "ha-467706-m03" exists ...

	I0417 18:57:10.699759  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.699793  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.715392  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33497

	I0417 18:57:10.715862  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.716466  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.716504  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.716872  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.717095  101037 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:57:10.717303  101037 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:57:10.717326  101037 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:57:10.720608  101037 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:57:10.721176  101037 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:57:10.721200  101037 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:57:10.721260  101037 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:57:10.721468  101037 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:57:10.721633  101037 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:57:10.721855  101037 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:57:10.812110  101037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:57:10.829399  101037 kubeconfig.go:125] found "ha-467706" server: "https://192.168.39.254:8443"

	I0417 18:57:10.829438  101037 api_server.go:166] Checking apiserver status ...

	I0417 18:57:10.829483  101037 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:57:10.845128  101037 ssh_runner.go:195] Run: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup

	W0417 18:57:10.855764  101037 api_server.go:177] unable to find freezer cgroup: sudo egrep ^[0-9]+:freezer: /proc/1582/cgroup: Process exited with status 1

	stdout:

	stderr:

	I0417 18:57:10.855832  101037 ssh_runner.go:195] Run: ls

	I0417 18:57:10.861069  101037 api_server.go:253] Checking apiserver healthz at https://192.168.39.254:8443/healthz ...

	I0417 18:57:10.865554  101037 api_server.go:279] https://192.168.39.254:8443/healthz returned 200:

	ok

	I0417 18:57:10.865583  101037 status.go:422] ha-467706-m03 apiserver status = Running (err=<nil>)

	I0417 18:57:10.865593  101037 status.go:257] ha-467706-m03 status: &{Name:ha-467706-m03 Host:Running Kubelet:Running APIServer:Running Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0417 18:57:10.865646  101037 status.go:255] checking status of ha-467706-m04 ...

	I0417 18:57:10.865956  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.866005  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.882520  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46407

	I0417 18:57:10.882985  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.883522  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.883544  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.883941  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.884130  101037 main.go:141] libmachine: (ha-467706-m04) Calling .GetState

	I0417 18:57:10.885814  101037 status.go:330] ha-467706-m04 host status = "Running" (err=<nil>)

	I0417 18:57:10.885831  101037 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:57:10.886210  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.886257  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.901669  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33773

	I0417 18:57:10.902173  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.902732  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.902761  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.903070  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.903244  101037 main.go:141] libmachine: (ha-467706-m04) Calling .GetIP

	I0417 18:57:10.906276  101037 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:57:10.906593  101037 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:57:10.906645  101037 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:57:10.906741  101037 host.go:66] Checking if "ha-467706-m04" exists ...

	I0417 18:57:10.907055  101037 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:57:10.907096  101037 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:57:10.923525  101037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46861

	I0417 18:57:10.924068  101037 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:57:10.924664  101037 main.go:141] libmachine: Using API Version  1

	I0417 18:57:10.924695  101037 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:57:10.925069  101037 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:57:10.925280  101037 main.go:141] libmachine: (ha-467706-m04) Calling .DriverName

	I0417 18:57:10.925483  101037 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0417 18:57:10.925512  101037 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHHostname

	I0417 18:57:10.929441  101037 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:57:10.929852  101037 main.go:141] libmachine: (ha-467706-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:33:5b:7b", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:53:12 +0000 UTC Type:0 Mac:52:54:00:33:5b:7b Iaid: IPaddr:192.168.39.203 Prefix:24 Hostname:ha-467706-m04 Clientid:01:52:54:00:33:5b:7b}

	I0417 18:57:10.929879  101037 main.go:141] libmachine: (ha-467706-m04) DBG | domain ha-467706-m04 has defined IP address 192.168.39.203 and MAC address 52:54:00:33:5b:7b in network mk-ha-467706

	I0417 18:57:10.930037  101037 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHPort

	I0417 18:57:10.930236  101037 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHKeyPath

	I0417 18:57:10.930469  101037 main.go:141] libmachine: (ha-467706-m04) Calling .GetSSHUsername

	I0417 18:57:10.930610  101037 sshutil.go:53] new ssh client: &{IP:192.168.39.203 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m04/id_rsa Username:docker}

	I0417 18:57:11.014207  101037 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:57:11.032057  101037 status.go:257] ha-467706-m04 status: &{Name:ha-467706-m04 Host:Running Kubelet:Running APIServer:Irrelevant Kubeconfig:Irrelevant Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:432: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-467706 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-467706 -n ha-467706

helpers_test.go:244: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/RestartSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-467706 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-467706 logs -n 25: (1.579508796s)

helpers_test.go:252: TestMultiControlPlane/serial/RestartSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|----------------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   |    Version     |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|----------------|---------------------|---------------------|

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m03:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706:/home/docker/cp-test_ha-467706-m03_ha-467706.txt                       |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706 sudo cat                                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m03_ha-467706.txt                                 |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m03:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m02:/home/docker/cp-test_ha-467706-m03_ha-467706-m02.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m02 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m03_ha-467706-m02.txt                             |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m03:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04:/home/docker/cp-test_ha-467706-m03_ha-467706-m04.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m04 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m03_ha-467706-m04.txt                             |           |         |                |                     |                     |

	| cp      | ha-467706 cp testdata/cp-test.txt                                                | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04:/home/docker/cp-test.txt                                           |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile2860960912/001/cp-test_ha-467706-m04.txt |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706:/home/docker/cp-test_ha-467706-m04_ha-467706.txt                       |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706 sudo cat                                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m04_ha-467706.txt                                 |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m02:/home/docker/cp-test_ha-467706-m04_ha-467706-m02.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m02 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m04_ha-467706-m02.txt                             |           |         |                |                     |                     |

	| cp      | ha-467706 cp ha-467706-m04:/home/docker/cp-test.txt                              | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m03:/home/docker/cp-test_ha-467706-m04_ha-467706-m03.txt               |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n                                                                 | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | ha-467706-m04 sudo cat                                                           |           |         |                |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |                |                     |                     |

	| ssh     | ha-467706 ssh -n ha-467706-m03 sudo cat                                          | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC | 17 Apr 24 18:53 UTC |

	|         | /home/docker/cp-test_ha-467706-m04_ha-467706-m03.txt                             |           |         |                |                     |                     |

	| node    | ha-467706 node stop m02 -v=7                                                     | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:53 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |                |                     |                     |

	| node    | ha-467706 node start m02 -v=7                                                    | ha-467706 | jenkins | v1.33.0-beta.0 | 17 Apr 24 18:56 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |                |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|----------------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/04/17 18:49:22

	Running on machine: ubuntu-20-agent-7

	Binary: Built with gc go1.22.1 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0417 18:49:22.621343   96006 out.go:291] Setting OutFile to fd 1 ...

	I0417 18:49:22.621632   96006 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:49:22.621642   96006 out.go:304] Setting ErrFile to fd 2...

	I0417 18:49:22.621647   96006 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0417 18:49:22.621840   96006 root.go:338] Updating PATH: /home/jenkins/minikube-integration/18665-75973/.minikube/bin

	I0417 18:49:22.622485   96006 out.go:298] Setting JSON to false

	I0417 18:49:22.623337   96006 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":9111,"bootTime":1713370652,"procs":173,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1055-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0417 18:49:22.623412   96006 start.go:139] virtualization: kvm guest

	I0417 18:49:22.625735   96006 out.go:177] * [ha-467706] minikube v1.33.0-beta.0 on Ubuntu 20.04 (kvm/amd64)

	I0417 18:49:22.627418   96006 out.go:177]   - MINIKUBE_LOCATION=18665

	I0417 18:49:22.629062   96006 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0417 18:49:22.627413   96006 notify.go:220] Checking for updates...

	I0417 18:49:22.630766   96006 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:49:22.632309   96006 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:49:22.633783   96006 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0417 18:49:22.635377   96006 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0417 18:49:22.636911   96006 driver.go:392] Setting default libvirt URI to qemu:///system

	I0417 18:49:22.672838   96006 out.go:177] * Using the kvm2 driver based on user configuration

	I0417 18:49:22.674139   96006 start.go:297] selected driver: kvm2

	I0417 18:49:22.674151   96006 start.go:901] validating driver "kvm2" against <nil>

	I0417 18:49:22.674166   96006 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0417 18:49:22.674857   96006 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0417 18:49:22.674927   96006 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/18665-75973/.minikube/bin:/home/jenkins/workspace/KVM_Linux_crio_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0417 18:49:22.690558   96006 install.go:137] /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2 version is 1.33.0-beta.0

	I0417 18:49:22.690619   96006 start_flags.go:310] no existing cluster config was found, will generate one from the flags 

	I0417 18:49:22.690882   96006 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0417 18:49:22.691013   96006 cni.go:84] Creating CNI manager for ""

	I0417 18:49:22.691030   96006 cni.go:136] multinode detected (0 nodes found), recommending kindnet

	I0417 18:49:22.691039   96006 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni

	I0417 18:49:22.691121   96006 start.go:340] cluster config:

	{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio

CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHA

gentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:49:22.691296   96006 iso.go:125] acquiring lock: {Name:mkb4c46d9d11025607234f0b50f29e48600415ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0417 18:49:22.693487   96006 out.go:177] * Starting "ha-467706" primary control-plane node in "ha-467706" cluster

	I0417 18:49:22.694987   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:49:22.695039   96006 preload.go:147] Found local preload: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4

	I0417 18:49:22.695047   96006 cache.go:56] Caching tarball of preloaded images

	I0417 18:49:22.695149   96006 preload.go:173] Found /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0417 18:49:22.695174   96006 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0-rc.2 on crio

	I0417 18:49:22.695683   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:49:22.695728   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json: {Name:mk22dabb72a30759b87fd992aca98de3628495f4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:22.695916   96006 start.go:360] acquireMachinesLock for ha-467706: {Name:mk477aec4c276e4d91f705836ed4842912dfe2c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0417 18:49:22.695957   96006 start.go:364] duration metric: took 24.804µs to acquireMachinesLock for "ha-467706"

	I0417 18:49:22.695978   96006 start.go:93] Provisioning new machine with config: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0

MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:49:22.696064   96006 start.go:125] createHost starting for "" (driver="kvm2")

	I0417 18:49:22.697982   96006 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0417 18:49:22.698141   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:49:22.698192   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:49:22.713521   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42335

	I0417 18:49:22.714905   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:49:22.715477   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:49:22.715503   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:49:22.715863   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:49:22.716093   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:22.716258   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:22.716442   96006 start.go:159] libmachine.API.Create for "ha-467706" (driver="kvm2")

	I0417 18:49:22.716465   96006 client.go:168] LocalClient.Create starting

	I0417 18:49:22.716497   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem

	I0417 18:49:22.716531   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:49:22.716546   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:49:22.716601   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem

	I0417 18:49:22.716619   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:49:22.716649   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:49:22.716665   96006 main.go:141] libmachine: Running pre-create checks...

	I0417 18:49:22.716674   96006 main.go:141] libmachine: (ha-467706) Calling .PreCreateCheck

	I0417 18:49:22.717100   96006 main.go:141] libmachine: (ha-467706) Calling .GetConfigRaw

	I0417 18:49:22.717515   96006 main.go:141] libmachine: Creating machine...

	I0417 18:49:22.717530   96006 main.go:141] libmachine: (ha-467706) Calling .Create

	I0417 18:49:22.717669   96006 main.go:141] libmachine: (ha-467706) Creating KVM machine...

	I0417 18:49:22.719151   96006 main.go:141] libmachine: (ha-467706) DBG | found existing default KVM network

	I0417 18:49:22.719847   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:22.719679   96029 network.go:206] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 IsPrivate:true Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:} reservation:0xc000015ac0}

	I0417 18:49:22.719880   96006 main.go:141] libmachine: (ha-467706) DBG | created network xml: 

	I0417 18:49:22.719893   96006 main.go:141] libmachine: (ha-467706) DBG | <network>

	I0417 18:49:22.719903   96006 main.go:141] libmachine: (ha-467706) DBG |   <name>mk-ha-467706</name>

	I0417 18:49:22.719910   96006 main.go:141] libmachine: (ha-467706) DBG |   <dns enable='no'/>

	I0417 18:49:22.719918   96006 main.go:141] libmachine: (ha-467706) DBG |   

	I0417 18:49:22.719930   96006 main.go:141] libmachine: (ha-467706) DBG |   <ip address='192.168.39.1' netmask='255.255.255.0'>

	I0417 18:49:22.719948   96006 main.go:141] libmachine: (ha-467706) DBG |     <dhcp>

	I0417 18:49:22.719957   96006 main.go:141] libmachine: (ha-467706) DBG |       <range start='192.168.39.2' end='192.168.39.253'/>

	I0417 18:49:22.719970   96006 main.go:141] libmachine: (ha-467706) DBG |     </dhcp>

	I0417 18:49:22.719982   96006 main.go:141] libmachine: (ha-467706) DBG |   </ip>

	I0417 18:49:22.719991   96006 main.go:141] libmachine: (ha-467706) DBG |   

	I0417 18:49:22.719999   96006 main.go:141] libmachine: (ha-467706) DBG | </network>

	I0417 18:49:22.720008   96006 main.go:141] libmachine: (ha-467706) DBG | 

	I0417 18:49:22.725332   96006 main.go:141] libmachine: (ha-467706) DBG | trying to create private KVM network mk-ha-467706 192.168.39.0/24...

	I0417 18:49:22.793280   96006 main.go:141] libmachine: (ha-467706) DBG | private KVM network mk-ha-467706 192.168.39.0/24 created

	I0417 18:49:22.793320   96006 main.go:141] libmachine: (ha-467706) Setting up store path in /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706 ...

	I0417 18:49:22.793340   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:22.793255   96029 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:49:22.793359   96006 main.go:141] libmachine: (ha-467706) Building disk image from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso

	I0417 18:49:22.793504   96006 main.go:141] libmachine: (ha-467706) Downloading /home/jenkins/minikube-integration/18665-75973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...

	I0417 18:49:23.035075   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:23.034912   96029 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa...

	I0417 18:49:23.188428   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:23.188292   96029 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/ha-467706.rawdisk...

	I0417 18:49:23.188457   96006 main.go:141] libmachine: (ha-467706) DBG | Writing magic tar header

	I0417 18:49:23.188493   96006 main.go:141] libmachine: (ha-467706) DBG | Writing SSH key tar header

	I0417 18:49:23.188535   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:23.188433   96029 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706 ...

	I0417 18:49:23.188563   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706

	I0417 18:49:23.188608   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706 (perms=drwx------)

	I0417 18:49:23.188626   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines (perms=drwxr-xr-x)

	I0417 18:49:23.188635   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube (perms=drwxr-xr-x)

	I0417 18:49:23.188645   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973 (perms=drwxrwxr-x)

	I0417 18:49:23.188657   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0417 18:49:23.188664   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines

	I0417 18:49:23.188698   96006 main.go:141] libmachine: (ha-467706) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0417 18:49:23.188716   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:49:23.188722   96006 main.go:141] libmachine: (ha-467706) Creating domain...

	I0417 18:49:23.188733   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973

	I0417 18:49:23.188744   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0417 18:49:23.188761   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home/jenkins

	I0417 18:49:23.188787   96006 main.go:141] libmachine: (ha-467706) DBG | Checking permissions on dir: /home

	I0417 18:49:23.188798   96006 main.go:141] libmachine: (ha-467706) DBG | Skipping /home - not owner

	I0417 18:49:23.190017   96006 main.go:141] libmachine: (ha-467706) define libvirt domain using xml: 

	I0417 18:49:23.190033   96006 main.go:141] libmachine: (ha-467706) <domain type='kvm'>

	I0417 18:49:23.190039   96006 main.go:141] libmachine: (ha-467706)   <name>ha-467706</name>

	I0417 18:49:23.190044   96006 main.go:141] libmachine: (ha-467706)   <memory unit='MiB'>2200</memory>

	I0417 18:49:23.190049   96006 main.go:141] libmachine: (ha-467706)   <vcpu>2</vcpu>

	I0417 18:49:23.190054   96006 main.go:141] libmachine: (ha-467706)   <features>

	I0417 18:49:23.190059   96006 main.go:141] libmachine: (ha-467706)     <acpi/>

	I0417 18:49:23.190067   96006 main.go:141] libmachine: (ha-467706)     <apic/>

	I0417 18:49:23.190072   96006 main.go:141] libmachine: (ha-467706)     <pae/>

	I0417 18:49:23.190086   96006 main.go:141] libmachine: (ha-467706)     

	I0417 18:49:23.190091   96006 main.go:141] libmachine: (ha-467706)   </features>

	I0417 18:49:23.190098   96006 main.go:141] libmachine: (ha-467706)   <cpu mode='host-passthrough'>

	I0417 18:49:23.190103   96006 main.go:141] libmachine: (ha-467706)   

	I0417 18:49:23.190110   96006 main.go:141] libmachine: (ha-467706)   </cpu>

	I0417 18:49:23.190115   96006 main.go:141] libmachine: (ha-467706)   <os>

	I0417 18:49:23.190136   96006 main.go:141] libmachine: (ha-467706)     <type>hvm</type>

	I0417 18:49:23.190145   96006 main.go:141] libmachine: (ha-467706)     <boot dev='cdrom'/>

	I0417 18:49:23.190149   96006 main.go:141] libmachine: (ha-467706)     <boot dev='hd'/>

	I0417 18:49:23.190154   96006 main.go:141] libmachine: (ha-467706)     <bootmenu enable='no'/>

	I0417 18:49:23.190161   96006 main.go:141] libmachine: (ha-467706)   </os>

	I0417 18:49:23.190166   96006 main.go:141] libmachine: (ha-467706)   <devices>

	I0417 18:49:23.190182   96006 main.go:141] libmachine: (ha-467706)     <disk type='file' device='cdrom'>

	I0417 18:49:23.190196   96006 main.go:141] libmachine: (ha-467706)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/boot2docker.iso'/>

	I0417 18:49:23.190209   96006 main.go:141] libmachine: (ha-467706)       <target dev='hdc' bus='scsi'/>

	I0417 18:49:23.190242   96006 main.go:141] libmachine: (ha-467706)       <readonly/>

	I0417 18:49:23.190268   96006 main.go:141] libmachine: (ha-467706)     </disk>

	I0417 18:49:23.190284   96006 main.go:141] libmachine: (ha-467706)     <disk type='file' device='disk'>

	I0417 18:49:23.190297   96006 main.go:141] libmachine: (ha-467706)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0417 18:49:23.190312   96006 main.go:141] libmachine: (ha-467706)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/ha-467706.rawdisk'/>

	I0417 18:49:23.190324   96006 main.go:141] libmachine: (ha-467706)       <target dev='hda' bus='virtio'/>

	I0417 18:49:23.190351   96006 main.go:141] libmachine: (ha-467706)     </disk>

	I0417 18:49:23.190371   96006 main.go:141] libmachine: (ha-467706)     <interface type='network'>

	I0417 18:49:23.190381   96006 main.go:141] libmachine: (ha-467706)       <source network='mk-ha-467706'/>

	I0417 18:49:23.190392   96006 main.go:141] libmachine: (ha-467706)       <model type='virtio'/>

	I0417 18:49:23.190400   96006 main.go:141] libmachine: (ha-467706)     </interface>

	I0417 18:49:23.190409   96006 main.go:141] libmachine: (ha-467706)     <interface type='network'>

	I0417 18:49:23.190418   96006 main.go:141] libmachine: (ha-467706)       <source network='default'/>

	I0417 18:49:23.190423   96006 main.go:141] libmachine: (ha-467706)       <model type='virtio'/>

	I0417 18:49:23.190430   96006 main.go:141] libmachine: (ha-467706)     </interface>

	I0417 18:49:23.190435   96006 main.go:141] libmachine: (ha-467706)     <serial type='pty'>

	I0417 18:49:23.190444   96006 main.go:141] libmachine: (ha-467706)       <target port='0'/>

	I0417 18:49:23.190450   96006 main.go:141] libmachine: (ha-467706)     </serial>

	I0417 18:49:23.190455   96006 main.go:141] libmachine: (ha-467706)     <console type='pty'>

	I0417 18:49:23.190463   96006 main.go:141] libmachine: (ha-467706)       <target type='serial' port='0'/>

	I0417 18:49:23.190468   96006 main.go:141] libmachine: (ha-467706)     </console>

	I0417 18:49:23.190475   96006 main.go:141] libmachine: (ha-467706)     <rng model='virtio'>

	I0417 18:49:23.190481   96006 main.go:141] libmachine: (ha-467706)       <backend model='random'>/dev/random</backend>

	I0417 18:49:23.190488   96006 main.go:141] libmachine: (ha-467706)     </rng>

	I0417 18:49:23.190493   96006 main.go:141] libmachine: (ha-467706)     

	I0417 18:49:23.190503   96006 main.go:141] libmachine: (ha-467706)     

	I0417 18:49:23.190512   96006 main.go:141] libmachine: (ha-467706)   </devices>

	I0417 18:49:23.190527   96006 main.go:141] libmachine: (ha-467706) </domain>

	I0417 18:49:23.190535   96006 main.go:141] libmachine: (ha-467706) 

	I0417 18:49:23.194869   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:02:89:fa in network default

	I0417 18:49:23.195525   96006 main.go:141] libmachine: (ha-467706) Ensuring networks are active...

	I0417 18:49:23.195544   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:23.196256   96006 main.go:141] libmachine: (ha-467706) Ensuring network default is active

	I0417 18:49:23.196508   96006 main.go:141] libmachine: (ha-467706) Ensuring network mk-ha-467706 is active

	I0417 18:49:23.196986   96006 main.go:141] libmachine: (ha-467706) Getting domain xml...

	I0417 18:49:23.197668   96006 main.go:141] libmachine: (ha-467706) Creating domain...

	I0417 18:49:24.377122   96006 main.go:141] libmachine: (ha-467706) Waiting to get IP...

	I0417 18:49:24.378185   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:24.378610   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:24.378673   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:24.378570   96029 retry.go:31] will retry after 187.650817ms: waiting for machine to come up

	I0417 18:49:24.568112   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:24.568585   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:24.568610   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:24.568519   96029 retry.go:31] will retry after 263.565831ms: waiting for machine to come up

	I0417 18:49:24.834051   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:24.834456   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:24.834493   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:24.834423   96029 retry.go:31] will retry after 431.588458ms: waiting for machine to come up

	I0417 18:49:25.268032   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:25.268496   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:25.268516   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:25.268462   96029 retry.go:31] will retry after 586.894254ms: waiting for machine to come up

	I0417 18:49:25.857433   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:25.857951   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:25.857983   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:25.857879   96029 retry.go:31] will retry after 478.597863ms: waiting for machine to come up

	I0417 18:49:26.337567   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:26.337946   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:26.337971   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:26.337906   96029 retry.go:31] will retry after 722.019817ms: waiting for machine to come up

	I0417 18:49:27.061866   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:27.062146   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:27.062192   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:27.062092   96029 retry.go:31] will retry after 901.648194ms: waiting for machine to come up

	I0417 18:49:27.965748   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:27.966079   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:27.966102   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:27.966048   96029 retry.go:31] will retry after 954.18526ms: waiting for machine to come up

	I0417 18:49:28.921955   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:28.922298   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:28.922330   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:28.922239   96029 retry.go:31] will retry after 1.478334758s: waiting for machine to come up

	I0417 18:49:30.401822   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:30.402348   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:30.402377   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:30.402273   96029 retry.go:31] will retry after 2.24649483s: waiting for machine to come up

	I0417 18:49:32.651659   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:32.652032   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:32.652060   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:32.651979   96029 retry.go:31] will retry after 2.647468116s: waiting for machine to come up

	I0417 18:49:35.302402   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:35.302798   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:35.302829   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:35.302749   96029 retry.go:31] will retry after 2.438483753s: waiting for machine to come up

	I0417 18:49:37.743278   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:37.743704   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:37.743739   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:37.743648   96029 retry.go:31] will retry after 3.206013787s: waiting for machine to come up

	I0417 18:49:40.953078   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:40.953481   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find current IP address of domain ha-467706 in network mk-ha-467706

	I0417 18:49:40.953510   96006 main.go:141] libmachine: (ha-467706) DBG | I0417 18:49:40.953465   96029 retry.go:31] will retry after 4.754103915s: waiting for machine to come up

	I0417 18:49:45.711373   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.711801   96006 main.go:141] libmachine: (ha-467706) Found IP for machine: 192.168.39.159

	I0417 18:49:45.711825   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has current primary IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.711832   96006 main.go:141] libmachine: (ha-467706) Reserving static IP address...

	I0417 18:49:45.712231   96006 main.go:141] libmachine: (ha-467706) DBG | unable to find host DHCP lease matching {name: "ha-467706", mac: "52:54:00:3b:c1:55", ip: "192.168.39.159"} in network mk-ha-467706

	I0417 18:49:45.790706   96006 main.go:141] libmachine: (ha-467706) Reserved static IP address: 192.168.39.159

	I0417 18:49:45.790759   96006 main.go:141] libmachine: (ha-467706) Waiting for SSH to be available...

	I0417 18:49:45.790772   96006 main.go:141] libmachine: (ha-467706) DBG | Getting to WaitForSSH function...

	I0417 18:49:45.793775   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.794200   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:minikube Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:45.794236   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.794395   96006 main.go:141] libmachine: (ha-467706) DBG | Using SSH client type: external

	I0417 18:49:45.794422   96006 main.go:141] libmachine: (ha-467706) DBG | Using SSH private key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa (-rw-------)

	I0417 18:49:45.794455   96006 main.go:141] libmachine: (ha-467706) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.159 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0417 18:49:45.794471   96006 main.go:141] libmachine: (ha-467706) DBG | About to run SSH command:

	I0417 18:49:45.794484   96006 main.go:141] libmachine: (ha-467706) DBG | exit 0

	I0417 18:49:45.917151   96006 main.go:141] libmachine: (ha-467706) DBG | SSH cmd err, output: <nil>: 

	I0417 18:49:45.917423   96006 main.go:141] libmachine: (ha-467706) KVM machine creation complete!

	I0417 18:49:45.917783   96006 main.go:141] libmachine: (ha-467706) Calling .GetConfigRaw

	I0417 18:49:45.918347   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:45.918561   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:45.918782   96006 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0417 18:49:45.918799   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:49:45.920179   96006 main.go:141] libmachine: Detecting operating system of created instance...

	I0417 18:49:45.920196   96006 main.go:141] libmachine: Waiting for SSH to be available...

	I0417 18:49:45.920204   96006 main.go:141] libmachine: Getting to WaitForSSH function...

	I0417 18:49:45.920218   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:45.922787   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.923202   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:45.923230   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:45.923388   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:45.923626   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:45.923791   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:45.923975   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:45.924120   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:45.924416   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:45.924434   96006 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0417 18:49:46.020232   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:49:46.020256   96006 main.go:141] libmachine: Detecting the provisioner...

	I0417 18:49:46.020267   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.023222   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.023614   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.023642   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.023856   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.024087   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.024295   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.024474   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.024674   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.024895   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.024909   96006 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0417 18:49:46.122008   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0417 18:49:46.122077   96006 main.go:141] libmachine: found compatible host: buildroot

	I0417 18:49:46.122084   96006 main.go:141] libmachine: Provisioning with buildroot...

	I0417 18:49:46.122093   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:46.122346   96006 buildroot.go:166] provisioning hostname "ha-467706"

	I0417 18:49:46.122366   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:46.122583   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.125229   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.125668   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.125696   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.125858   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.126051   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.126223   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.126403   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.126575   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.126745   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.126758   96006 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-467706 && echo "ha-467706" | sudo tee /etc/hostname

	I0417 18:49:46.241359   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-467706

	I0417 18:49:46.241388   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.244126   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.244567   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.244610   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.244867   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.245076   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.245277   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.245428   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.245620   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.245841   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.245860   96006 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-467706' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-467706/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-467706' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0417 18:49:46.356754   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:49:46.356807   96006 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18665-75973/.minikube CaCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18665-75973/.minikube}

	I0417 18:49:46.356900   96006 buildroot.go:174] setting up certificates

	I0417 18:49:46.356915   96006 provision.go:84] configureAuth start

	I0417 18:49:46.356931   96006 main.go:141] libmachine: (ha-467706) Calling .GetMachineName

	I0417 18:49:46.357220   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:46.359879   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.360284   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.360311   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.360453   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.362942   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.363300   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.363331   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.363469   96006 provision.go:143] copyHostCerts

	I0417 18:49:46.363499   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:49:46.363558   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem, removing ...

	I0417 18:49:46.363584   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:49:46.363675   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem (1078 bytes)

	I0417 18:49:46.363791   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:49:46.363813   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem, removing ...

	I0417 18:49:46.363818   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:49:46.363848   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem (1123 bytes)

	I0417 18:49:46.363901   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:49:46.363917   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem, removing ...

	I0417 18:49:46.363923   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:49:46.363943   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem (1679 bytes)

	I0417 18:49:46.364003   96006 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem org=jenkins.ha-467706 san=[127.0.0.1 192.168.39.159 ha-467706 localhost minikube]

	I0417 18:49:46.547992   96006 provision.go:177] copyRemoteCerts

	I0417 18:49:46.548058   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0417 18:49:46.548085   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.550923   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.551238   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.551272   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.551446   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.551662   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.551812   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.551945   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:46.631629   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0417 18:49:46.631706   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0417 18:49:46.660510   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0417 18:49:46.660601   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0417 18:49:46.686435   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0417 18:49:46.686519   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0417 18:49:46.712855   96006 provision.go:87] duration metric: took 355.924441ms to configureAuth

	I0417 18:49:46.712892   96006 buildroot.go:189] setting minikube options for container-runtime

	I0417 18:49:46.713118   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:49:46.713214   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.715807   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.716194   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.716214   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.716475   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.716658   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.716844   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.717015   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.717222   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:46.717455   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:46.717479   96006 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0417 18:49:46.986253   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0417 18:49:46.986294   96006 main.go:141] libmachine: Checking connection to Docker...

	I0417 18:49:46.986306   96006 main.go:141] libmachine: (ha-467706) Calling .GetURL

	I0417 18:49:46.987867   96006 main.go:141] libmachine: (ha-467706) DBG | Using libvirt version 6000000

	I0417 18:49:46.990607   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.991025   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.991057   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.991208   96006 main.go:141] libmachine: Docker is up and running!

	I0417 18:49:46.991225   96006 main.go:141] libmachine: Reticulating splines...

	I0417 18:49:46.991235   96006 client.go:171] duration metric: took 24.274758262s to LocalClient.Create

	I0417 18:49:46.991267   96006 start.go:167] duration metric: took 24.274825568s to libmachine.API.Create "ha-467706"

	I0417 18:49:46.991278   96006 start.go:293] postStartSetup for "ha-467706" (driver="kvm2")

	I0417 18:49:46.991298   96006 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0417 18:49:46.991317   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:46.991606   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0417 18:49:46.991639   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:46.994027   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.994408   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:46.994434   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:46.994582   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:46.994815   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:46.994988   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:46.995160   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:47.075556   96006 ssh_runner.go:195] Run: cat /etc/os-release

	I0417 18:49:47.080124   96006 info.go:137] Remote host: Buildroot 2023.02.9

	I0417 18:49:47.080157   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/addons for local assets ...

	I0417 18:49:47.080240   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/files for local assets ...

	I0417 18:49:47.080378   96006 filesync.go:149] local asset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> 832072.pem in /etc/ssl/certs

	I0417 18:49:47.080395   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /etc/ssl/certs/832072.pem

	I0417 18:49:47.080509   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0417 18:49:47.090584   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:49:47.116825   96006 start.go:296] duration metric: took 125.527222ms for postStartSetup

	I0417 18:49:47.116884   96006 main.go:141] libmachine: (ha-467706) Calling .GetConfigRaw

	I0417 18:49:47.117502   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:47.120183   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.120522   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.120553   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.120862   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:49:47.121043   96006 start.go:128] duration metric: took 24.424966199s to createHost

	I0417 18:49:47.121067   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:47.123333   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.123641   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.123669   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.123762   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:47.123939   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.124163   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.124296   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:47.124473   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:49:47.124691   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.159 22 <nil> <nil>}

	I0417 18:49:47.124711   96006 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0417 18:49:47.226058   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713379787.196532675

	I0417 18:49:47.226085   96006 fix.go:216] guest clock: 1713379787.196532675

	I0417 18:49:47.226096   96006 fix.go:229] Guest: 2024-04-17 18:49:47.196532675 +0000 UTC Remote: 2024-04-17 18:49:47.12105477 +0000 UTC m=+24.548401797 (delta=75.477905ms)

	I0417 18:49:47.226122   96006 fix.go:200] guest clock delta is within tolerance: 75.477905ms

	I0417 18:49:47.226132   96006 start.go:83] releasing machines lock for "ha-467706", held for 24.530164s

	I0417 18:49:47.226159   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.226466   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:47.229254   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.229610   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.229641   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.229826   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.230365   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.230563   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:49:47.230659   96006 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0417 18:49:47.230708   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:47.230824   96006 ssh_runner.go:195] Run: cat /version.json

	I0417 18:49:47.230857   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:49:47.233295   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.233738   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.233769   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.233789   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.234080   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:47.234254   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.234319   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:47.234371   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:47.234459   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:49:47.234461   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:47.234625   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:49:47.234712   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:47.234758   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:49:47.234859   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:49:47.332201   96006 ssh_runner.go:195] Run: systemctl --version

	I0417 18:49:47.338467   96006 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0417 18:49:47.503987   96006 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0417 18:49:47.510271   96006 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0417 18:49:47.510357   96006 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0417 18:49:47.526939   96006 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0417 18:49:47.526969   96006 start.go:494] detecting cgroup driver to use...

	I0417 18:49:47.527048   96006 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0417 18:49:47.544808   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0417 18:49:47.560276   96006 docker.go:217] disabling cri-docker service (if available) ...

	I0417 18:49:47.560342   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0417 18:49:47.575493   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0417 18:49:47.590305   96006 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0417 18:49:47.703106   96006 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0417 18:49:47.847924   96006 docker.go:233] disabling docker service ...

	I0417 18:49:47.848005   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0417 18:49:47.863461   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0417 18:49:47.877676   96006 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0417 18:49:48.022562   96006 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0417 18:49:48.151007   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0417 18:49:48.166077   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0417 18:49:48.186073   96006 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0417 18:49:48.186142   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.197296   96006 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0417 18:49:48.197367   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.209670   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.221372   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.233508   96006 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0417 18:49:48.245432   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.257212   96006 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.276089   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:49:48.288509   96006 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0417 18:49:48.299360   96006 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0417 18:49:48.299433   96006 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0417 18:49:48.313454   96006 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0417 18:49:48.324328   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:49:48.450531   96006 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0417 18:49:48.594212   96006 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0417 18:49:48.594298   96006 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0417 18:49:48.599281   96006 start.go:562] Will wait 60s for crictl version

	I0417 18:49:48.599344   96006 ssh_runner.go:195] Run: which crictl

	I0417 18:49:48.603340   96006 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0417 18:49:48.642689   96006 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0417 18:49:48.642799   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:49:48.671577   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:49:48.702661   96006 out.go:177] * Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	I0417 18:49:48.704026   96006 main.go:141] libmachine: (ha-467706) Calling .GetIP

	I0417 18:49:48.706752   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:48.707106   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:49:48.707135   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:49:48.707492   96006 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0417 18:49:48.712013   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:49:48.726914   96006 kubeadm.go:877] updating cluster {Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc

.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou

ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0417 18:49:48.727027   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:49:48.727072   96006 ssh_runner.go:195] Run: sudo crictl images --output json

	I0417 18:49:48.763371   96006 crio.go:510] couldn't find preloaded image for "registry.k8s.io/kube-apiserver:v1.30.0-rc.2". assuming images are not preloaded.

	I0417 18:49:48.763447   96006 ssh_runner.go:195] Run: which lz4

	I0417 18:49:48.767730   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 -> /preloaded.tar.lz4

	I0417 18:49:48.767859   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4

	I0417 18:49:48.772298   96006 ssh_runner.go:352] existence check for /preloaded.tar.lz4: stat -c "%!s(MISSING) %!y(MISSING)" /preloaded.tar.lz4: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/preloaded.tar.lz4': No such file or directory

	I0417 18:49:48.772335   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 --> /preloaded.tar.lz4 (394547972 bytes)

	I0417 18:49:50.300197   96006 crio.go:462] duration metric: took 1.532382815s to copy over tarball

	I0417 18:49:50.300268   96006 ssh_runner.go:195] Run: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4

	I0417 18:49:52.542643   96006 ssh_runner.go:235] Completed: sudo tar --xattrs --xattrs-include security.capability -I lz4 -C /var -xf /preloaded.tar.lz4: (2.242348458s)

	I0417 18:49:52.542670   96006 crio.go:469] duration metric: took 2.242444327s to extract the tarball

	I0417 18:49:52.542679   96006 ssh_runner.go:146] rm: /preloaded.tar.lz4

	I0417 18:49:52.580669   96006 ssh_runner.go:195] Run: sudo crictl images --output json

	I0417 18:49:52.627109   96006 crio.go:514] all images are preloaded for cri-o runtime.

	I0417 18:49:52.627137   96006 cache_images.go:84] Images are preloaded, skipping loading

	I0417 18:49:52.627146   96006 kubeadm.go:928] updating node { 192.168.39.159 8443 v1.30.0-rc.2 crio true true} ...

	I0417 18:49:52.627259   96006 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-467706 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.159

	[Install]

	 config:

	{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0417 18:49:52.627324   96006 ssh_runner.go:195] Run: crio config

	I0417 18:49:52.672604   96006 cni.go:84] Creating CNI manager for ""

	I0417 18:49:52.672627   96006 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0417 18:49:52.672640   96006 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0417 18:49:52.672667   96006 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.159 APIServerPort:8443 KubernetesVersion:v1.30.0-rc.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-467706 NodeName:ha-467706 DNSDomain:cluster.local CRISocket:/var/run/crio/crio.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.159"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.159 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kube

rnetes/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/crio/crio.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0417 18:49:52.672846   96006 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.159

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/crio/crio.sock

	  name: "ha-467706"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.159

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.159"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.0-rc.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/crio/crio.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0417 18:49:52.672877   96006 kube-vip.go:111] generating kube-vip config ...

	I0417 18:49:52.672919   96006 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0417 18:49:52.690262   96006 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0417 18:49:52.690373   96006 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/super-admin.conf"

	    name: kubeconfig

	status: {}

	I0417 18:49:52.690446   96006 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:49:52.701509   96006 binaries.go:44] Found k8s binaries, skipping transfer

	I0417 18:49:52.701583   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0417 18:49:52.711831   96006 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (314 bytes)

	I0417 18:49:52.729846   96006 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0417 18:49:52.747405   96006 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2158 bytes)

	I0417 18:49:52.764754   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1352 bytes)

	I0417 18:49:52.782535   96006 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0417 18:49:52.786592   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:49:52.799666   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:49:52.916690   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:49:52.934217   96006 certs.go:68] Setting up /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706 for IP: 192.168.39.159

	I0417 18:49:52.934251   96006 certs.go:194] generating shared ca certs ...

	I0417 18:49:52.934274   96006 certs.go:226] acquiring lock for ca certs: {Name:mk03352eb76143f462405cfdf4da402444190b34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:52.934431   96006 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key

	I0417 18:49:52.934472   96006 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key

	I0417 18:49:52.934483   96006 certs.go:256] generating profile certs ...

	I0417 18:49:52.934530   96006 certs.go:363] generating signed profile cert for "minikube-user": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key

	I0417 18:49:52.934544   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt with IP's: []

	I0417 18:49:53.244202   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt ...

	I0417 18:49:53.244236   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt: {Name:mk260beaef924a663e20e604d910222418991c1e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.244413   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key ...

	I0417 18:49:53.244425   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key: {Name:mka6e83ab53b9a78e8580ba26a408c6fe0aa4108 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.244500   96006 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce

	I0417 18:49:53.244516   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.159 192.168.39.254]

	I0417 18:49:53.351159   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce ...

	I0417 18:49:53.351195   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce: {Name:mk0d007a3059514906a38e3c48ad705a629ef9c0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.351349   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce ...

	I0417 18:49:53.351371   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce: {Name:mkb0a296faba2ad3992fca03f9ce3ee187f67de6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.351441   96006 certs.go:381] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.7257f6ce -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt

	I0417 18:49:53.351513   96006 certs.go:385] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.7257f6ce -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key

	I0417 18:49:53.351566   96006 certs.go:363] generating signed profile cert for "aggregator": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key

	I0417 18:49:53.351580   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt with IP's: []

	I0417 18:49:53.481387   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt ...

	I0417 18:49:53.481422   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt: {Name:mk08465b193680de7d272e691e702536866d5179 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.481583   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key ...

	I0417 18:49:53.481594   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key: {Name:mkb793bc73b35b3c9b394526c75bb288dee06af9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:49:53.481657   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0417 18:49:53.481675   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0417 18:49:53.481685   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0417 18:49:53.481696   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0417 18:49:53.481714   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0417 18:49:53.481727   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0417 18:49:53.481739   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0417 18:49:53.481760   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0417 18:49:53.481808   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem (1338 bytes)

	W0417 18:49:53.481843   96006 certs.go:480] ignoring /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207_empty.pem, impossibly tiny 0 bytes

	I0417 18:49:53.481853   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem (1679 bytes)

	I0417 18:49:53.481877   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem (1078 bytes)

	I0417 18:49:53.481899   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem (1123 bytes)

	I0417 18:49:53.481925   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem (1679 bytes)

	I0417 18:49:53.481960   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:49:53.481987   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem -> /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.482001   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.482013   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.482612   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0417 18:49:53.509306   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0417 18:49:53.537445   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0417 18:49:53.565313   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0417 18:49:53.592648   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1424 bytes)

	I0417 18:49:53.619996   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0417 18:49:53.649884   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0417 18:49:53.679489   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0417 18:49:53.718882   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem --> /usr/share/ca-certificates/83207.pem (1338 bytes)

	I0417 18:49:53.756459   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /usr/share/ca-certificates/832072.pem (1708 bytes)

	I0417 18:49:53.791680   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0417 18:49:53.818386   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (752 bytes)

	I0417 18:49:53.836408   96006 ssh_runner.go:195] Run: openssl version

	I0417 18:49:53.842201   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0417 18:49:53.854077   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.858810   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 17 17:59 /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.858878   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:49:53.864686   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0417 18:49:53.876271   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/83207.pem && ln -fs /usr/share/ca-certificates/83207.pem /etc/ssl/certs/83207.pem"

	I0417 18:49:53.888608   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.893582   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 17 18:40 /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.893662   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/83207.pem

	I0417 18:49:53.899643   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/83207.pem /etc/ssl/certs/51391683.0"

	I0417 18:49:53.912156   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/832072.pem && ln -fs /usr/share/ca-certificates/832072.pem /etc/ssl/certs/832072.pem"

	I0417 18:49:53.924518   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.929666   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 17 18:40 /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.929743   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/832072.pem

	I0417 18:49:53.935925   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/832072.pem /etc/ssl/certs/3ec20f2e.0"

	I0417 18:49:53.948824   96006 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0417 18:49:53.953491   96006 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0417 18:49:53.953551   96006 kubeadm.go:391] StartCluster: {Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2

ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountP

ort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:49:53.953647   96006 cri.go:54] listing CRI containers in root : {State:paused Name: Namespaces:[kube-system]}

	I0417 18:49:53.953694   96006 ssh_runner.go:195] Run: sudo -s eval "crictl ps -a --quiet --label io.kubernetes.pod.namespace=kube-system"

	I0417 18:49:53.994421   96006 cri.go:89] found id: ""

	I0417 18:49:53.994501   96006 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	I0417 18:49:54.006024   96006 ssh_runner.go:195] Run: sudo cp /var/tmp/minikube/kubeadm.yaml.new /var/tmp/minikube/kubeadm.yaml

	I0417 18:49:54.017184   96006 ssh_runner.go:195] Run: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf

	I0417 18:49:54.027791   96006 kubeadm.go:154] config check failed, skipping stale config cleanup: sudo ls -la /etc/kubernetes/admin.conf /etc/kubernetes/kubelet.conf /etc/kubernetes/controller-manager.conf /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/etc/kubernetes/admin.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/kubelet.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/controller-manager.conf': No such file or directory

	ls: cannot access '/etc/kubernetes/scheduler.conf': No such file or directory

	I0417 18:49:54.027814   96006 kubeadm.go:156] found existing configuration files:

	I0417 18:49:54.027869   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf

	I0417 18:49:54.037957   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/admin.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/admin.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/admin.conf: No such file or directory

	I0417 18:49:54.038021   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/admin.conf

	I0417 18:49:54.048431   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf

	I0417 18:49:54.058368   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/kubelet.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/kubelet.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/kubelet.conf: No such file or directory

	I0417 18:49:54.058435   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/kubelet.conf

	I0417 18:49:54.069360   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf

	I0417 18:49:54.080326   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/controller-manager.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/controller-manager.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/controller-manager.conf: No such file or directory

	I0417 18:49:54.080383   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/controller-manager.conf

	I0417 18:49:54.091346   96006 ssh_runner.go:195] Run: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf

	I0417 18:49:54.101536   96006 kubeadm.go:162] "https://control-plane.minikube.internal:8443" may not be in /etc/kubernetes/scheduler.conf - will remove: sudo grep https://control-plane.minikube.internal:8443 /etc/kubernetes/scheduler.conf: Process exited with status 2

	stdout:

	stderr:

	grep: /etc/kubernetes/scheduler.conf: No such file or directory

	I0417 18:49:54.101611   96006 ssh_runner.go:195] Run: sudo rm -f /etc/kubernetes/scheduler.conf

	I0417 18:49:54.112092   96006 ssh_runner.go:286] Start: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm init --config /var/tmp/minikube/kubeadm.yaml  --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,DirAvailable--var-lib-minikube-etcd,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap,NumCPU,Mem"

	I0417 18:49:54.221173   96006 kubeadm.go:309] [init] Using Kubernetes version: v1.30.0-rc.2

	I0417 18:49:54.221276   96006 kubeadm.go:309] [preflight] Running pre-flight checks

	I0417 18:49:54.345642   96006 kubeadm.go:309] [preflight] Pulling images required for setting up a Kubernetes cluster

	I0417 18:49:54.345788   96006 kubeadm.go:309] [preflight] This might take a minute or two, depending on the speed of your internet connection

	I0417 18:49:54.345991   96006 kubeadm.go:309] [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'

	I0417 18:49:54.586516   96006 kubeadm.go:309] [certs] Using certificateDir folder "/var/lib/minikube/certs"

	I0417 18:49:54.750772   96006 out.go:204]   - Generating certificates and keys ...

	I0417 18:49:54.750922   96006 kubeadm.go:309] [certs] Using existing ca certificate authority

	I0417 18:49:54.751062   96006 kubeadm.go:309] [certs] Using existing apiserver certificate and key on disk

	I0417 18:49:54.751194   96006 kubeadm.go:309] [certs] Generating "apiserver-kubelet-client" certificate and key

	I0417 18:49:54.903367   96006 kubeadm.go:309] [certs] Generating "front-proxy-ca" certificate and key

	I0417 18:49:54.954630   96006 kubeadm.go:309] [certs] Generating "front-proxy-client" certificate and key

	I0417 18:49:55.127672   96006 kubeadm.go:309] [certs] Generating "etcd/ca" certificate and key

	I0417 18:49:55.391718   96006 kubeadm.go:309] [certs] Generating "etcd/server" certificate and key

	I0417 18:49:55.391885   96006 kubeadm.go:309] [certs] etcd/server serving cert is signed for DNS names [ha-467706 localhost] and IPs [192.168.39.159 127.0.0.1 ::1]

	I0417 18:49:55.502336   96006 kubeadm.go:309] [certs] Generating "etcd/peer" certificate and key

	I0417 18:49:55.502504   96006 kubeadm.go:309] [certs] etcd/peer serving cert is signed for DNS names [ha-467706 localhost] and IPs [192.168.39.159 127.0.0.1 ::1]

	I0417 18:49:55.698045   96006 kubeadm.go:309] [certs] Generating "etcd/healthcheck-client" certificate and key

	I0417 18:49:55.867661   96006 kubeadm.go:309] [certs] Generating "apiserver-etcd-client" certificate and key

	I0417 18:49:56.226068   96006 kubeadm.go:309] [certs] Generating "sa" key and public key

	I0417 18:49:56.226276   96006 kubeadm.go:309] [kubeconfig] Using kubeconfig folder "/etc/kubernetes"

	I0417 18:49:56.336532   96006 kubeadm.go:309] [kubeconfig] Writing "admin.conf" kubeconfig file

	I0417 18:49:56.482956   96006 kubeadm.go:309] [kubeconfig] Writing "super-admin.conf" kubeconfig file

	I0417 18:49:56.554416   96006 kubeadm.go:309] [kubeconfig] Writing "kubelet.conf" kubeconfig file

	I0417 18:49:56.815239   96006 kubeadm.go:309] [kubeconfig] Writing "controller-manager.conf" kubeconfig file

	I0417 18:49:56.902120   96006 kubeadm.go:309] [kubeconfig] Writing "scheduler.conf" kubeconfig file

	I0417 18:49:56.902695   96006 kubeadm.go:309] [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"

	I0417 18:49:56.906066   96006 kubeadm.go:309] [control-plane] Using manifest folder "/etc/kubernetes/manifests"

	I0417 18:49:56.908270   96006 out.go:204]   - Booting up control plane ...

	I0417 18:49:56.908379   96006 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-apiserver"

	I0417 18:49:56.908500   96006 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-controller-manager"

	I0417 18:49:56.908588   96006 kubeadm.go:309] [control-plane] Creating static Pod manifest for "kube-scheduler"

	I0417 18:49:56.925089   96006 kubeadm.go:309] [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"

	I0417 18:49:56.925875   96006 kubeadm.go:309] [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"

	I0417 18:49:56.925950   96006 kubeadm.go:309] [kubelet-start] Starting the kubelet

	I0417 18:49:57.077441   96006 kubeadm.go:309] [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests"

	I0417 18:49:57.077590   96006 kubeadm.go:309] [kubelet-check] Waiting for a healthy kubelet. This can take up to 4m0s

	I0417 18:49:57.579007   96006 kubeadm.go:309] [kubelet-check] The kubelet is healthy after 501.961199ms

	I0417 18:49:57.579109   96006 kubeadm.go:309] [api-check] Waiting for a healthy API server. This can take up to 4m0s

	I0417 18:50:03.508397   96006 kubeadm.go:309] [api-check] The API server is healthy after 5.933545161s

	I0417 18:50:03.524830   96006 kubeadm.go:309] [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace

	I0417 18:50:03.541796   96006 kubeadm.go:309] [kubelet] Creating a ConfigMap "kubelet-config" in namespace kube-system with the configuration for the kubelets in the cluster

	I0417 18:50:03.571323   96006 kubeadm.go:309] [upload-certs] Skipping phase. Please see --upload-certs

	I0417 18:50:03.571530   96006 kubeadm.go:309] [mark-control-plane] Marking the node ha-467706 as control-plane by adding the labels: [node-role.kubernetes.io/control-plane node.kubernetes.io/exclude-from-external-load-balancers]

	I0417 18:50:03.583854   96006 kubeadm.go:309] [bootstrap-token] Using token: hjpiw8.6t8szkhj41h84dis

	I0417 18:50:03.585429   96006 out.go:204]   - Configuring RBAC rules ...

	I0417 18:50:03.585594   96006 kubeadm.go:309] [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles

	I0417 18:50:03.600099   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to get nodes

	I0417 18:50:03.615453   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials

	I0417 18:50:03.619726   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token

	I0417 18:50:03.624618   96006 kubeadm.go:309] [bootstrap-token] Configured RBAC rules to allow certificate rotation for all node client certificates in the cluster

	I0417 18:50:03.628356   96006 kubeadm.go:309] [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace

	I0417 18:50:03.917165   96006 kubeadm.go:309] [kubelet-finalize] Updating "/etc/kubernetes/kubelet.conf" to point to a rotatable kubelet client certificate and key

	I0417 18:50:04.368237   96006 kubeadm.go:309] [addons] Applied essential addon: CoreDNS

	I0417 18:50:04.916872   96006 kubeadm.go:309] [addons] Applied essential addon: kube-proxy

	I0417 18:50:04.918021   96006 kubeadm.go:309] 

	I0417 18:50:04.918113   96006 kubeadm.go:309] Your Kubernetes control-plane has initialized successfully!

	I0417 18:50:04.918127   96006 kubeadm.go:309] 

	I0417 18:50:04.918209   96006 kubeadm.go:309] To start using your cluster, you need to run the following as a regular user:

	I0417 18:50:04.918220   96006 kubeadm.go:309] 

	I0417 18:50:04.918272   96006 kubeadm.go:309]   mkdir -p $HOME/.kube

	I0417 18:50:04.918340   96006 kubeadm.go:309]   sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config

	I0417 18:50:04.918418   96006 kubeadm.go:309]   sudo chown $(id -u):$(id -g) $HOME/.kube/config

	I0417 18:50:04.918429   96006 kubeadm.go:309] 

	I0417 18:50:04.918492   96006 kubeadm.go:309] Alternatively, if you are the root user, you can run:

	I0417 18:50:04.918511   96006 kubeadm.go:309] 

	I0417 18:50:04.918573   96006 kubeadm.go:309]   export KUBECONFIG=/etc/kubernetes/admin.conf

	I0417 18:50:04.918588   96006 kubeadm.go:309] 

	I0417 18:50:04.918691   96006 kubeadm.go:309] You should now deploy a pod network to the cluster.

	I0417 18:50:04.918802   96006 kubeadm.go:309] Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:

	I0417 18:50:04.918901   96006 kubeadm.go:309]   https://kubernetes.io/docs/concepts/cluster-administration/addons/

	I0417 18:50:04.918912   96006 kubeadm.go:309] 

	I0417 18:50:04.919032   96006 kubeadm.go:309] You can now join any number of control-plane nodes by copying certificate authorities

	I0417 18:50:04.919142   96006 kubeadm.go:309] and service account keys on each node and then running the following as root:

	I0417 18:50:04.919153   96006 kubeadm.go:309] 

	I0417 18:50:04.919262   96006 kubeadm.go:309]   kubeadm join control-plane.minikube.internal:8443 --token hjpiw8.6t8szkhj41h84dis \

	I0417 18:50:04.919431   96006 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 \

	I0417 18:50:04.919479   96006 kubeadm.go:309] 	--control-plane 

	I0417 18:50:04.919489   96006 kubeadm.go:309] 

	I0417 18:50:04.919599   96006 kubeadm.go:309] Then you can join any number of worker nodes by running the following on each as root:

	I0417 18:50:04.919614   96006 kubeadm.go:309] 

	I0417 18:50:04.919715   96006 kubeadm.go:309] kubeadm join control-plane.minikube.internal:8443 --token hjpiw8.6t8szkhj41h84dis \

	I0417 18:50:04.919854   96006 kubeadm.go:309] 	--discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 

	I0417 18:50:04.920711   96006 kubeadm.go:309] 	[WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'

	I0417 18:50:04.920755   96006 cni.go:84] Creating CNI manager for ""

	I0417 18:50:04.920765   96006 cni.go:136] multinode detected (1 nodes found), recommending kindnet

	I0417 18:50:04.922745   96006 out.go:177] * Configuring CNI (Container Networking Interface) ...

	I0417 18:50:04.924119   96006 ssh_runner.go:195] Run: stat /opt/cni/bin/portmap

	I0417 18:50:04.932915   96006 cni.go:182] applying CNI manifest using /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl ...

	I0417 18:50:04.932940   96006 ssh_runner.go:362] scp memory --> /var/tmp/minikube/cni.yaml (2438 bytes)

	I0417 18:50:04.958687   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply --kubeconfig=/var/lib/minikube/kubeconfig -f /var/tmp/minikube/cni.yaml

	I0417 18:50:05.317320   96006 ssh_runner.go:195] Run: /bin/bash -c "cat /proc/$(pgrep kube-apiserver)/oom_adj"

	I0417 18:50:05.317440   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl create clusterrolebinding minikube-rbac --clusterrole=cluster-admin --serviceaccount=kube-system:default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:05.317469   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-467706 minikube.k8s.io/updated_at=2024_04_17T18_50_05_0700 minikube.k8s.io/version=v1.33.0-beta.0 minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3 minikube.k8s.io/name=ha-467706 minikube.k8s.io/primary=true

	I0417 18:50:05.374278   96006 ops.go:34] apiserver oom_adj: -16

	I0417 18:50:05.507845   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:06.008879   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:06.508139   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:07.008349   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:07.507966   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:08.008041   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:08.508561   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:09.008903   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:09.508146   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:10.007855   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:10.508919   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:11.008695   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:11.508789   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:12.008689   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:12.508392   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:13.008145   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:13.508071   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:14.008218   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:14.508449   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:15.008880   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:15.508603   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:16.008586   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:16.508154   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:17.008458   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl get sa default --kubeconfig=/var/lib/minikube/kubeconfig

	I0417 18:50:17.152345   96006 kubeadm.go:1107] duration metric: took 11.83496435s to wait for elevateKubeSystemPrivileges

	W0417 18:50:17.152395   96006 kubeadm.go:286] apiserver tunnel failed: apiserver port not set

	I0417 18:50:17.152405   96006 kubeadm.go:393] duration metric: took 23.198862653s to StartCluster

	I0417 18:50:17.152426   96006 settings.go:142] acquiring lock: {Name:mk5d952127253ee5e60e06b072b3460ff4f86e9f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:17.152501   96006 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:50:17.153264   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/kubeconfig: {Name:mkca968a5a2538f9f961af0f359c1b9923864131 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:17.153473   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml"

	I0417 18:50:17.153481   96006 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:50:17.153503   96006 start.go:240] waiting for startup goroutines ...

	I0417 18:50:17.153521   96006 addons.go:502] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:true efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:true storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false]

	I0417 18:50:17.153623   96006 addons.go:69] Setting storage-provisioner=true in profile "ha-467706"

	I0417 18:50:17.153655   96006 addons.go:234] Setting addon storage-provisioner=true in "ha-467706"

	I0417 18:50:17.153681   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:17.153624   96006 addons.go:69] Setting default-storageclass=true in profile "ha-467706"

	I0417 18:50:17.153746   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:17.153771   96006 addons_storage_classes.go:33] enableOrDisableStorageClasses default-storageclass=true on "ha-467706"

	I0417 18:50:17.154085   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.154124   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.154162   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.154197   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.169960   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35067

	I0417 18:50:17.170015   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41635

	I0417 18:50:17.170413   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.170442   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.170930   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.170951   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.171058   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.171079   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.171343   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.171539   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.171702   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:17.171975   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.172010   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.174031   96006 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:50:17.174414   96006 kapi.go:59] client config for ha-467706: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt", KeyFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key", CAFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5e2a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0417 18:50:17.175002   96006 cert_rotation.go:137] Starting client certificate rotation controller

	I0417 18:50:17.175289   96006 addons.go:234] Setting addon default-storageclass=true in "ha-467706"

	I0417 18:50:17.175344   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:17.175731   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.175781   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.187657   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42907

	I0417 18:50:17.188199   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.188829   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.188857   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.189272   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.189618   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:17.190208   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35787

	I0417 18:50:17.190573   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.191100   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.191124   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.191523   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.191659   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:17.193826   96006 out.go:177]   - Using image gcr.io/k8s-minikube/storage-provisioner:v5

	I0417 18:50:17.192154   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:17.195104   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:17.195281   96006 addons.go:426] installing /etc/kubernetes/addons/storage-provisioner.yaml

	I0417 18:50:17.195305   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storage-provisioner.yaml (2676 bytes)

	I0417 18:50:17.195330   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:17.198235   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.198524   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:17.198546   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.198731   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:17.198949   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:17.199120   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:17.199263   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:17.210463   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34261

	I0417 18:50:17.210875   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:17.211399   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:17.211424   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:17.211846   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:17.212069   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:17.213887   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:17.214200   96006 addons.go:426] installing /etc/kubernetes/addons/storageclass.yaml

	I0417 18:50:17.214223   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/addons/storageclass.yaml (271 bytes)

	I0417 18:50:17.214245   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:17.216977   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.217385   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:17.217430   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:17.217612   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:17.217792   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:17.217935   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:17.218076   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:17.317822   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig -n kube-system get configmap coredns -o yaml | sed -e '/^        forward . \/etc\/resolv.conf.*/i \        hosts {\n           192.168.39.1 host.minikube.internal\n           fallthrough\n        }' -e '/^        errors *$/i \        log' | sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig replace -f -"

	I0417 18:50:17.367713   96006 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storage-provisioner.yaml

	I0417 18:50:17.380094   96006 ssh_runner.go:195] Run: sudo KUBECONFIG=/var/lib/minikube/kubeconfig /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl apply -f /etc/kubernetes/addons/storageclass.yaml

	I0417 18:50:17.756247   96006 start.go:946] {"host.minikube.internal": 192.168.39.1} host record injected into CoreDNS's ConfigMap

	I0417 18:50:18.075807   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.075832   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.075894   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.075922   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.076153   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076172   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.076183   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.076191   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.076270   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076290   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.076295   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.076315   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.076329   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.076399   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076410   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.076440   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.076507   96006 round_trippers.go:463] GET https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses

	I0417 18:50:18.076528   96006 round_trippers.go:469] Request Headers:

	I0417 18:50:18.076539   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:50:18.076543   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:50:18.076684   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.076729   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.076748   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.090116   96006 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0417 18:50:18.091273   96006 round_trippers.go:463] PUT https://192.168.39.254:8443/apis/storage.k8s.io/v1/storageclasses/standard

	I0417 18:50:18.091296   96006 round_trippers.go:469] Request Headers:

	I0417 18:50:18.091315   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:50:18.091320   96006 round_trippers.go:473]     Content-Type: application/json

	I0417 18:50:18.091328   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:50:18.094312   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:50:18.094536   96006 main.go:141] libmachine: Making call to close driver server

	I0417 18:50:18.094557   96006 main.go:141] libmachine: (ha-467706) Calling .Close

	I0417 18:50:18.094830   96006 main.go:141] libmachine: Successfully made call to close driver server

	I0417 18:50:18.094851   96006 main.go:141] libmachine: Making call to close connection to plugin binary

	I0417 18:50:18.094873   96006 main.go:141] libmachine: (ha-467706) DBG | Closing plugin on server side

	I0417 18:50:18.096565   96006 out.go:177] * Enabled addons: storage-provisioner, default-storageclass

	I0417 18:50:18.098207   96006 addons.go:505] duration metric: took 944.687777ms for enable addons: enabled=[storage-provisioner default-storageclass]

	I0417 18:50:18.098255   96006 start.go:245] waiting for cluster config update ...

	I0417 18:50:18.098273   96006 start.go:254] writing updated cluster config ...

	I0417 18:50:18.099861   96006 out.go:177] 

	I0417 18:50:18.101568   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:18.101676   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:50:18.103543   96006 out.go:177] * Starting "ha-467706-m02" control-plane node in "ha-467706" cluster

	I0417 18:50:18.104867   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:50:18.104900   96006 cache.go:56] Caching tarball of preloaded images

	I0417 18:50:18.105008   96006 preload.go:173] Found /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0417 18:50:18.105026   96006 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0-rc.2 on crio

	I0417 18:50:18.105143   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:50:18.105367   96006 start.go:360] acquireMachinesLock for ha-467706-m02: {Name:mk477aec4c276e4d91f705836ed4842912dfe2c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0417 18:50:18.105445   96006 start.go:364] duration metric: took 47.307µs to acquireMachinesLock for "ha-467706-m02"

	I0417 18:50:18.105473   96006 start.go:93] Provisioning new machine with config: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true E

xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m02 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:50:18.105578   96006 start.go:125] createHost starting for "m02" (driver="kvm2")

	I0417 18:50:18.107330   96006 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0417 18:50:18.107431   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:18.107460   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:18.122242   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42417

	I0417 18:50:18.122702   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:18.123187   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:18.123210   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:18.123536   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:18.123731   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:18.123878   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:18.124060   96006 start.go:159] libmachine.API.Create for "ha-467706" (driver="kvm2")

	I0417 18:50:18.124089   96006 client.go:168] LocalClient.Create starting

	I0417 18:50:18.124126   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem

	I0417 18:50:18.124174   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:50:18.124193   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:50:18.124264   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem

	I0417 18:50:18.124291   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:50:18.124571   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:50:18.124658   96006 main.go:141] libmachine: Running pre-create checks...

	I0417 18:50:18.124674   96006 main.go:141] libmachine: (ha-467706-m02) Calling .PreCreateCheck

	I0417 18:50:18.125072   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetConfigRaw

	I0417 18:50:18.126362   96006 main.go:141] libmachine: Creating machine...

	I0417 18:50:18.126386   96006 main.go:141] libmachine: (ha-467706-m02) Calling .Create

	I0417 18:50:18.126923   96006 main.go:141] libmachine: (ha-467706-m02) Creating KVM machine...

	I0417 18:50:18.128081   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found existing default KVM network

	I0417 18:50:18.128226   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found existing private KVM network mk-ha-467706

	I0417 18:50:18.128361   96006 main.go:141] libmachine: (ha-467706-m02) Setting up store path in /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02 ...

	I0417 18:50:18.128389   96006 main.go:141] libmachine: (ha-467706-m02) Building disk image from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso

	I0417 18:50:18.128482   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.128356   96351 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:50:18.128617   96006 main.go:141] libmachine: (ha-467706-m02) Downloading /home/jenkins/minikube-integration/18665-75973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...

	I0417 18:50:18.367880   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.367714   96351 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa...

	I0417 18:50:18.531251   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.531111   96351 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/ha-467706-m02.rawdisk...

	I0417 18:50:18.531282   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Writing magic tar header

	I0417 18:50:18.531293   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Writing SSH key tar header

	I0417 18:50:18.531301   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:18.531231   96351 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02 ...

	I0417 18:50:18.531380   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02

	I0417 18:50:18.531401   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines

	I0417 18:50:18.531413   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02 (perms=drwx------)

	I0417 18:50:18.531434   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines (perms=drwxr-xr-x)

	I0417 18:50:18.531449   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube (perms=drwxr-xr-x)

	I0417 18:50:18.531462   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:50:18.531475   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973

	I0417 18:50:18.531484   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0417 18:50:18.531493   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973 (perms=drwxrwxr-x)

	I0417 18:50:18.531501   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0417 18:50:18.531510   96006 main.go:141] libmachine: (ha-467706-m02) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0417 18:50:18.531524   96006 main.go:141] libmachine: (ha-467706-m02) Creating domain...

	I0417 18:50:18.531537   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home/jenkins

	I0417 18:50:18.531549   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Checking permissions on dir: /home

	I0417 18:50:18.531561   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Skipping /home - not owner

	I0417 18:50:18.532389   96006 main.go:141] libmachine: (ha-467706-m02) define libvirt domain using xml: 

	I0417 18:50:18.532412   96006 main.go:141] libmachine: (ha-467706-m02) <domain type='kvm'>

	I0417 18:50:18.532440   96006 main.go:141] libmachine: (ha-467706-m02)   <name>ha-467706-m02</name>

	I0417 18:50:18.532464   96006 main.go:141] libmachine: (ha-467706-m02)   <memory unit='MiB'>2200</memory>

	I0417 18:50:18.532474   96006 main.go:141] libmachine: (ha-467706-m02)   <vcpu>2</vcpu>

	I0417 18:50:18.532484   96006 main.go:141] libmachine: (ha-467706-m02)   <features>

	I0417 18:50:18.532495   96006 main.go:141] libmachine: (ha-467706-m02)     <acpi/>

	I0417 18:50:18.532508   96006 main.go:141] libmachine: (ha-467706-m02)     <apic/>

	I0417 18:50:18.532574   96006 main.go:141] libmachine: (ha-467706-m02)     <pae/>

	I0417 18:50:18.532610   96006 main.go:141] libmachine: (ha-467706-m02)     

	I0417 18:50:18.532633   96006 main.go:141] libmachine: (ha-467706-m02)   </features>

	I0417 18:50:18.532649   96006 main.go:141] libmachine: (ha-467706-m02)   <cpu mode='host-passthrough'>

	I0417 18:50:18.532666   96006 main.go:141] libmachine: (ha-467706-m02)   

	I0417 18:50:18.532678   96006 main.go:141] libmachine: (ha-467706-m02)   </cpu>

	I0417 18:50:18.532690   96006 main.go:141] libmachine: (ha-467706-m02)   <os>

	I0417 18:50:18.532702   96006 main.go:141] libmachine: (ha-467706-m02)     <type>hvm</type>

	I0417 18:50:18.532716   96006 main.go:141] libmachine: (ha-467706-m02)     <boot dev='cdrom'/>

	I0417 18:50:18.532738   96006 main.go:141] libmachine: (ha-467706-m02)     <boot dev='hd'/>

	I0417 18:50:18.532751   96006 main.go:141] libmachine: (ha-467706-m02)     <bootmenu enable='no'/>

	I0417 18:50:18.532766   96006 main.go:141] libmachine: (ha-467706-m02)   </os>

	I0417 18:50:18.532791   96006 main.go:141] libmachine: (ha-467706-m02)   <devices>

	I0417 18:50:18.532809   96006 main.go:141] libmachine: (ha-467706-m02)     <disk type='file' device='cdrom'>

	I0417 18:50:18.532826   96006 main.go:141] libmachine: (ha-467706-m02)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/boot2docker.iso'/>

	I0417 18:50:18.532838   96006 main.go:141] libmachine: (ha-467706-m02)       <target dev='hdc' bus='scsi'/>

	I0417 18:50:18.532850   96006 main.go:141] libmachine: (ha-467706-m02)       <readonly/>

	I0417 18:50:18.532869   96006 main.go:141] libmachine: (ha-467706-m02)     </disk>

	I0417 18:50:18.532879   96006 main.go:141] libmachine: (ha-467706-m02)     <disk type='file' device='disk'>

	I0417 18:50:18.532897   96006 main.go:141] libmachine: (ha-467706-m02)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0417 18:50:18.532914   96006 main.go:141] libmachine: (ha-467706-m02)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/ha-467706-m02.rawdisk'/>

	I0417 18:50:18.532926   96006 main.go:141] libmachine: (ha-467706-m02)       <target dev='hda' bus='virtio'/>

	I0417 18:50:18.532938   96006 main.go:141] libmachine: (ha-467706-m02)     </disk>

	I0417 18:50:18.532949   96006 main.go:141] libmachine: (ha-467706-m02)     <interface type='network'>

	I0417 18:50:18.532961   96006 main.go:141] libmachine: (ha-467706-m02)       <source network='mk-ha-467706'/>

	I0417 18:50:18.532975   96006 main.go:141] libmachine: (ha-467706-m02)       <model type='virtio'/>

	I0417 18:50:18.532994   96006 main.go:141] libmachine: (ha-467706-m02)     </interface>

	I0417 18:50:18.533013   96006 main.go:141] libmachine: (ha-467706-m02)     <interface type='network'>

	I0417 18:50:18.533026   96006 main.go:141] libmachine: (ha-467706-m02)       <source network='default'/>

	I0417 18:50:18.533043   96006 main.go:141] libmachine: (ha-467706-m02)       <model type='virtio'/>

	I0417 18:50:18.533056   96006 main.go:141] libmachine: (ha-467706-m02)     </interface>

	I0417 18:50:18.533067   96006 main.go:141] libmachine: (ha-467706-m02)     <serial type='pty'>

	I0417 18:50:18.533079   96006 main.go:141] libmachine: (ha-467706-m02)       <target port='0'/>

	I0417 18:50:18.533089   96006 main.go:141] libmachine: (ha-467706-m02)     </serial>

	I0417 18:50:18.533105   96006 main.go:141] libmachine: (ha-467706-m02)     <console type='pty'>

	I0417 18:50:18.533116   96006 main.go:141] libmachine: (ha-467706-m02)       <target type='serial' port='0'/>

	I0417 18:50:18.533138   96006 main.go:141] libmachine: (ha-467706-m02)     </console>

	I0417 18:50:18.533161   96006 main.go:141] libmachine: (ha-467706-m02)     <rng model='virtio'>

	I0417 18:50:18.533179   96006 main.go:141] libmachine: (ha-467706-m02)       <backend model='random'>/dev/random</backend>

	I0417 18:50:18.533191   96006 main.go:141] libmachine: (ha-467706-m02)     </rng>

	I0417 18:50:18.533202   96006 main.go:141] libmachine: (ha-467706-m02)     

	I0417 18:50:18.533212   96006 main.go:141] libmachine: (ha-467706-m02)     

	I0417 18:50:18.533224   96006 main.go:141] libmachine: (ha-467706-m02)   </devices>

	I0417 18:50:18.533238   96006 main.go:141] libmachine: (ha-467706-m02) </domain>

	I0417 18:50:18.533255   96006 main.go:141] libmachine: (ha-467706-m02) 

	I0417 18:50:18.540094   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:22:42:74 in network default

	I0417 18:50:18.540741   96006 main.go:141] libmachine: (ha-467706-m02) Ensuring networks are active...

	I0417 18:50:18.540791   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:18.541484   96006 main.go:141] libmachine: (ha-467706-m02) Ensuring network default is active

	I0417 18:50:18.541781   96006 main.go:141] libmachine: (ha-467706-m02) Ensuring network mk-ha-467706 is active

	I0417 18:50:18.542114   96006 main.go:141] libmachine: (ha-467706-m02) Getting domain xml...

	I0417 18:50:18.542779   96006 main.go:141] libmachine: (ha-467706-m02) Creating domain...

	I0417 18:50:19.758274   96006 main.go:141] libmachine: (ha-467706-m02) Waiting to get IP...

	I0417 18:50:19.759295   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:19.759776   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:19.759831   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:19.759753   96351 retry.go:31] will retry after 297.823603ms: waiting for machine to come up

	I0417 18:50:20.059605   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:20.060162   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:20.060192   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:20.060099   96351 retry.go:31] will retry after 378.130105ms: waiting for machine to come up

	I0417 18:50:20.439850   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:20.440396   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:20.440423   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:20.440349   96351 retry.go:31] will retry after 309.850338ms: waiting for machine to come up

	I0417 18:50:20.751969   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:20.752504   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:20.752529   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:20.752447   96351 retry.go:31] will retry after 484.021081ms: waiting for machine to come up

	I0417 18:50:21.238166   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:21.238627   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:21.238653   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:21.238571   96351 retry.go:31] will retry after 723.470091ms: waiting for machine to come up

	I0417 18:50:21.963754   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:21.964274   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:21.964316   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:21.964185   96351 retry.go:31] will retry after 820.645081ms: waiting for machine to come up

	I0417 18:50:22.786393   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:22.786856   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:22.786885   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:22.786809   96351 retry.go:31] will retry after 997.774765ms: waiting for machine to come up

	I0417 18:50:23.786284   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:23.786664   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:23.786685   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:23.786639   96351 retry.go:31] will retry after 1.38947065s: waiting for machine to come up

	I0417 18:50:25.177959   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:25.178412   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:25.178445   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:25.178346   96351 retry.go:31] will retry after 1.352777892s: waiting for machine to come up

	I0417 18:50:26.532959   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:26.533453   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:26.533485   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:26.533400   96351 retry.go:31] will retry after 2.218994741s: waiting for machine to come up

	I0417 18:50:28.754002   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:28.754519   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:28.754555   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:28.754456   96351 retry.go:31] will retry after 1.815056829s: waiting for machine to come up

	I0417 18:50:30.572601   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:30.573175   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:30.573208   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:30.573099   96351 retry.go:31] will retry after 2.735191697s: waiting for machine to come up

	I0417 18:50:33.309522   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:33.309997   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:33.310028   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:33.309953   96351 retry.go:31] will retry after 3.13218678s: waiting for machine to come up

	I0417 18:50:36.446318   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:36.446793   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find current IP address of domain ha-467706-m02 in network mk-ha-467706

	I0417 18:50:36.446824   96006 main.go:141] libmachine: (ha-467706-m02) DBG | I0417 18:50:36.446734   96351 retry.go:31] will retry after 5.302006713s: waiting for machine to come up

	I0417 18:50:41.753177   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.753633   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has current primary IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.753665   96006 main.go:141] libmachine: (ha-467706-m02) Found IP for machine: 192.168.39.236

	I0417 18:50:41.753703   96006 main.go:141] libmachine: (ha-467706-m02) Reserving static IP address...

	I0417 18:50:41.754045   96006 main.go:141] libmachine: (ha-467706-m02) DBG | unable to find host DHCP lease matching {name: "ha-467706-m02", mac: "52:54:00:d8:50:50", ip: "192.168.39.236"} in network mk-ha-467706

	I0417 18:50:41.829586   96006 main.go:141] libmachine: (ha-467706-m02) Reserved static IP address: 192.168.39.236

	I0417 18:50:41.829617   96006 main.go:141] libmachine: (ha-467706-m02) Waiting for SSH to be available...

	I0417 18:50:41.829627   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Getting to WaitForSSH function...

	I0417 18:50:41.832895   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.833340   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:minikube Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:41.833363   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.833541   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Using SSH client type: external

	I0417 18:50:41.833571   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa (-rw-------)

	I0417 18:50:41.833601   96006 main.go:141] libmachine: (ha-467706-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.236 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0417 18:50:41.833614   96006 main.go:141] libmachine: (ha-467706-m02) DBG | About to run SSH command:

	I0417 18:50:41.833630   96006 main.go:141] libmachine: (ha-467706-m02) DBG | exit 0

	I0417 18:50:41.960706   96006 main.go:141] libmachine: (ha-467706-m02) DBG | SSH cmd err, output: <nil>: 

	I0417 18:50:41.960994   96006 main.go:141] libmachine: (ha-467706-m02) KVM machine creation complete!

	I0417 18:50:41.961334   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetConfigRaw

	I0417 18:50:41.961844   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:41.962061   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:41.962225   96006 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0417 18:50:41.962238   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetState

	I0417 18:50:41.963436   96006 main.go:141] libmachine: Detecting operating system of created instance...

	I0417 18:50:41.963451   96006 main.go:141] libmachine: Waiting for SSH to be available...

	I0417 18:50:41.963456   96006 main.go:141] libmachine: Getting to WaitForSSH function...

	I0417 18:50:41.963463   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:41.965691   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.965995   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:41.966028   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:41.966103   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:41.966297   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:41.966455   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:41.966606   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:41.966798   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:41.966995   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:41.967007   96006 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0417 18:50:42.072210   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:50:42.072233   96006 main.go:141] libmachine: Detecting the provisioner...

	I0417 18:50:42.072241   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.075072   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.075435   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.075465   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.075768   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.075992   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.076161   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.076307   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.076475   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.076688   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.076702   96006 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0417 18:50:42.185913   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0417 18:50:42.185995   96006 main.go:141] libmachine: found compatible host: buildroot

	I0417 18:50:42.186002   96006 main.go:141] libmachine: Provisioning with buildroot...

	I0417 18:50:42.186011   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:42.186288   96006 buildroot.go:166] provisioning hostname "ha-467706-m02"

	I0417 18:50:42.186321   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:42.186569   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.189252   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.189677   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.189709   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.189846   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.190047   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.190213   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.190368   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.190523   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.190728   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.190744   96006 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-467706-m02 && echo "ha-467706-m02" | sudo tee /etc/hostname

	I0417 18:50:42.311838   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-467706-m02

	I0417 18:50:42.311871   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.314488   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.314887   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.314914   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.315085   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.315336   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.315547   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.315701   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.315908   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.316085   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.316102   96006 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-467706-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-467706-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-467706-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0417 18:50:42.434077   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:50:42.434113   96006 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18665-75973/.minikube CaCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18665-75973/.minikube}

	I0417 18:50:42.434135   96006 buildroot.go:174] setting up certificates

	I0417 18:50:42.434148   96006 provision.go:84] configureAuth start

	I0417 18:50:42.434166   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetMachineName

	I0417 18:50:42.434487   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:42.437258   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.437702   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.437734   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.437882   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.440159   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.440448   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.440490   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.440578   96006 provision.go:143] copyHostCerts

	I0417 18:50:42.440617   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:50:42.440657   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem, removing ...

	I0417 18:50:42.440669   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:50:42.440748   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem (1078 bytes)

	I0417 18:50:42.440873   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:50:42.440901   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem, removing ...

	I0417 18:50:42.440909   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:50:42.440952   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem (1123 bytes)

	I0417 18:50:42.441025   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:50:42.441048   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem, removing ...

	I0417 18:50:42.441054   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:50:42.441088   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem (1679 bytes)

	I0417 18:50:42.441162   96006 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem org=jenkins.ha-467706-m02 san=[127.0.0.1 192.168.39.236 ha-467706-m02 localhost minikube]

	I0417 18:50:42.760848   96006 provision.go:177] copyRemoteCerts

	I0417 18:50:42.760909   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0417 18:50:42.760938   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.763523   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.763809   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.763835   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.763992   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.764230   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.764378   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.764519   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:42.847766   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0417 18:50:42.847833   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0417 18:50:42.873757   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0417 18:50:42.873849   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0417 18:50:42.899584   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0417 18:50:42.899649   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0417 18:50:42.925517   96006 provision.go:87] duration metric: took 491.346719ms to configureAuth

	I0417 18:50:42.925550   96006 buildroot.go:189] setting minikube options for container-runtime

	I0417 18:50:42.925744   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:42.925844   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:42.928428   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.928795   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:42.928848   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:42.929039   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:42.929254   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.929439   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:42.929593   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:42.929783   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:42.929940   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:42.929955   96006 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0417 18:50:43.215765   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0417 18:50:43.215798   96006 main.go:141] libmachine: Checking connection to Docker...

	I0417 18:50:43.215807   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetURL

	I0417 18:50:43.217123   96006 main.go:141] libmachine: (ha-467706-m02) DBG | Using libvirt version 6000000

	I0417 18:50:43.219595   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.220034   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.220066   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.220248   96006 main.go:141] libmachine: Docker is up and running!

	I0417 18:50:43.220262   96006 main.go:141] libmachine: Reticulating splines...

	I0417 18:50:43.220270   96006 client.go:171] duration metric: took 25.096172136s to LocalClient.Create

	I0417 18:50:43.220292   96006 start.go:167] duration metric: took 25.096248433s to libmachine.API.Create "ha-467706"

	I0417 18:50:43.220302   96006 start.go:293] postStartSetup for "ha-467706-m02" (driver="kvm2")

	I0417 18:50:43.220314   96006 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0417 18:50:43.220347   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.220618   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0417 18:50:43.220650   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:43.222911   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.223248   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.223279   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.223454   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.223636   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.223808   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.223996   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:43.309604   96006 ssh_runner.go:195] Run: cat /etc/os-release

	I0417 18:50:43.314300   96006 info.go:137] Remote host: Buildroot 2023.02.9

	I0417 18:50:43.314329   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/addons for local assets ...

	I0417 18:50:43.314402   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/files for local assets ...

	I0417 18:50:43.314489   96006 filesync.go:149] local asset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> 832072.pem in /etc/ssl/certs

	I0417 18:50:43.314503   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /etc/ssl/certs/832072.pem

	I0417 18:50:43.314613   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0417 18:50:43.324876   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:50:43.352537   96006 start.go:296] duration metric: took 132.222885ms for postStartSetup

	I0417 18:50:43.352594   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetConfigRaw

	I0417 18:50:43.353271   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:43.355939   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.356297   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.356327   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.356586   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:50:43.356837   96006 start.go:128] duration metric: took 25.251245741s to createHost

	I0417 18:50:43.356869   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:43.358910   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.359264   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.359292   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.359361   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.359556   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.359731   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.359873   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.360045   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:50:43.360216   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.236 22 <nil> <nil>}

	I0417 18:50:43.360227   96006 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0417 18:50:43.469667   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713379843.419472324

	I0417 18:50:43.469695   96006 fix.go:216] guest clock: 1713379843.419472324

	I0417 18:50:43.469704   96006 fix.go:229] Guest: 2024-04-17 18:50:43.419472324 +0000 UTC Remote: 2024-04-17 18:50:43.356854721 +0000 UTC m=+80.784201764 (delta=62.617603ms)

	I0417 18:50:43.469725   96006 fix.go:200] guest clock delta is within tolerance: 62.617603ms

	I0417 18:50:43.469732   96006 start.go:83] releasing machines lock for "ha-467706-m02", held for 25.364268885s

	I0417 18:50:43.469750   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.470040   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:43.472586   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.473021   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.473047   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.475263   96006 out.go:177] * Found network options:

	I0417 18:50:43.476714   96006 out.go:177]   - NO_PROXY=192.168.39.159

	W0417 18:50:43.477965   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:50:43.478009   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.478640   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.478829   96006 main.go:141] libmachine: (ha-467706-m02) Calling .DriverName

	I0417 18:50:43.478917   96006 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0417 18:50:43.478957   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	W0417 18:50:43.479048   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:50:43.479126   96006 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0417 18:50:43.479148   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHHostname

	I0417 18:50:43.481734   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.481965   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.482051   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.482106   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.482197   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.482332   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:43.482357   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:43.482366   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.482509   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHPort

	I0417 18:50:43.482559   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.482676   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHKeyPath

	I0417 18:50:43.482729   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:43.482839   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetSSHUsername

	I0417 18:50:43.482978   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.236 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m02/id_rsa Username:docker}

	I0417 18:50:43.723186   96006 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0417 18:50:43.729400   96006 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0417 18:50:43.729487   96006 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0417 18:50:43.747191   96006 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0417 18:50:43.747222   96006 start.go:494] detecting cgroup driver to use...

	I0417 18:50:43.747298   96006 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0417 18:50:43.766134   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0417 18:50:43.782049   96006 docker.go:217] disabling cri-docker service (if available) ...

	I0417 18:50:43.782103   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0417 18:50:43.796842   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0417 18:50:43.811837   96006 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0417 18:50:43.955183   96006 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0417 18:50:44.119405   96006 docker.go:233] disabling docker service ...

	I0417 18:50:44.119488   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0417 18:50:44.135751   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0417 18:50:44.150314   96006 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0417 18:50:44.289369   96006 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0417 18:50:44.419335   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0417 18:50:44.434448   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0417 18:50:44.454265   96006 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0417 18:50:44.454341   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.465548   96006 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0417 18:50:44.465626   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.477204   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.488510   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.500218   96006 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0417 18:50:44.511859   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.523479   96006 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.544983   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:50:44.556679   96006 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0417 18:50:44.567217   96006 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0417 18:50:44.567280   96006 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0417 18:50:44.581851   96006 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0417 18:50:44.592445   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:50:44.730545   96006 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0417 18:50:44.871219   96006 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0417 18:50:44.871302   96006 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0417 18:50:44.876072   96006 start.go:562] Will wait 60s for crictl version

	I0417 18:50:44.876152   96006 ssh_runner.go:195] Run: which crictl

	I0417 18:50:44.880114   96006 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0417 18:50:44.920173   96006 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0417 18:50:44.920278   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:50:44.949069   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:50:44.987468   96006 out.go:177] * Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	I0417 18:50:44.988990   96006 out.go:177]   - env NO_PROXY=192.168.39.159

	I0417 18:50:44.990345   96006 main.go:141] libmachine: (ha-467706-m02) Calling .GetIP

	I0417 18:50:44.992870   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:44.993230   96006 main.go:141] libmachine: (ha-467706-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:d8:50:50", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:50:33 +0000 UTC Type:0 Mac:52:54:00:d8:50:50 Iaid: IPaddr:192.168.39.236 Prefix:24 Hostname:ha-467706-m02 Clientid:01:52:54:00:d8:50:50}

	I0417 18:50:44.993253   96006 main.go:141] libmachine: (ha-467706-m02) DBG | domain ha-467706-m02 has defined IP address 192.168.39.236 and MAC address 52:54:00:d8:50:50 in network mk-ha-467706

	I0417 18:50:44.993438   96006 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0417 18:50:44.998037   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:50:45.011925   96006 mustload.go:65] Loading cluster: ha-467706

	I0417 18:50:45.012122   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:50:45.012364   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:45.012402   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:45.027180   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:40427

	I0417 18:50:45.027710   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:45.028266   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:45.028293   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:45.028637   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:45.029263   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:50:45.031035   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:45.031317   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:45.031355   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:45.046157   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35907

	I0417 18:50:45.046558   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:45.047075   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:45.047105   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:45.047444   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:45.047639   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:45.047800   96006 certs.go:68] Setting up /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706 for IP: 192.168.39.236

	I0417 18:50:45.047815   96006 certs.go:194] generating shared ca certs ...

	I0417 18:50:45.047834   96006 certs.go:226] acquiring lock for ca certs: {Name:mk03352eb76143f462405cfdf4da402444190b34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:45.047966   96006 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key

	I0417 18:50:45.048005   96006 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key

	I0417 18:50:45.048014   96006 certs.go:256] generating profile certs ...

	I0417 18:50:45.048106   96006 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key

	I0417 18:50:45.048131   96006 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3

	I0417 18:50:45.048146   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.159 192.168.39.236 192.168.39.254]

	I0417 18:50:45.216050   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3 ...

	I0417 18:50:45.216082   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3: {Name:mke40eb0bbfa4a257d69dee7c0db8615a28a2c02 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:45.216247   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3 ...

	I0417 18:50:45.216267   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3: {Name:mk744f487b85aae0492308fe90f1def1e1057446 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:50:45.216334   96006 certs.go:381] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.4be75ba3 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt

	I0417 18:50:45.216463   96006 certs.go:385] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.4be75ba3 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key

	I0417 18:50:45.216592   96006 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key

	I0417 18:50:45.216609   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0417 18:50:45.216622   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0417 18:50:45.216636   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0417 18:50:45.216647   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0417 18:50:45.216658   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0417 18:50:45.216668   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0417 18:50:45.216682   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0417 18:50:45.216694   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0417 18:50:45.216742   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem (1338 bytes)

	W0417 18:50:45.216789   96006 certs.go:480] ignoring /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207_empty.pem, impossibly tiny 0 bytes

	I0417 18:50:45.216800   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem (1679 bytes)

	I0417 18:50:45.216830   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem (1078 bytes)

	I0417 18:50:45.216853   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem (1123 bytes)

	I0417 18:50:45.216875   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem (1679 bytes)

	I0417 18:50:45.216912   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:50:45.216937   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem -> /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.216951   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.216966   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.217028   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:45.220190   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:45.220566   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:45.220597   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:45.220791   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:45.221049   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:45.221236   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:45.221414   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:45.293203   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0417 18:50:45.298477   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0417 18:50:45.313225   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0417 18:50:45.318150   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0417 18:50:45.332489   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0417 18:50:45.340783   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0417 18:50:45.351476   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0417 18:50:45.355935   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0417 18:50:45.368043   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0417 18:50:45.372901   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0417 18:50:45.385103   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0417 18:50:45.390349   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0417 18:50:45.403053   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0417 18:50:45.428841   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0417 18:50:45.453137   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0417 18:50:45.478112   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0417 18:50:45.503276   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1436 bytes)

	I0417 18:50:45.528841   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1675 bytes)

	I0417 18:50:45.554403   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0417 18:50:45.581253   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0417 18:50:45.609231   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem --> /usr/share/ca-certificates/83207.pem (1338 bytes)

	I0417 18:50:45.635402   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /usr/share/ca-certificates/832072.pem (1708 bytes)

	I0417 18:50:45.661160   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0417 18:50:45.687529   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0417 18:50:45.704763   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0417 18:50:45.721300   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0417 18:50:45.738377   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0417 18:50:45.755487   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0417 18:50:45.772301   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0417 18:50:45.789375   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (758 bytes)

	I0417 18:50:45.807294   96006 ssh_runner.go:195] Run: openssl version

	I0417 18:50:45.813499   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/83207.pem && ln -fs /usr/share/ca-certificates/83207.pem /etc/ssl/certs/83207.pem"

	I0417 18:50:45.825040   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.830049   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 17 18:40 /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.830110   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/83207.pem

	I0417 18:50:45.836295   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/83207.pem /etc/ssl/certs/51391683.0"

	I0417 18:50:45.848368   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/832072.pem && ln -fs /usr/share/ca-certificates/832072.pem /etc/ssl/certs/832072.pem"

	I0417 18:50:45.859950   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.865632   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 17 18:40 /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.865700   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/832072.pem

	I0417 18:50:45.871771   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/832072.pem /etc/ssl/certs/3ec20f2e.0"

	I0417 18:50:45.883399   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0417 18:50:45.894718   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.900008   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 17 17:59 /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.900078   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:50:45.906155   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0417 18:50:45.917743   96006 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0417 18:50:45.922549   96006 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0417 18:50:45.922604   96006 kubeadm.go:928] updating node {m02 192.168.39.236 8443 v1.30.0-rc.2 crio true true} ...

	I0417 18:50:45.922716   96006 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-467706-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.236

	[Install]

	 config:

	{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0417 18:50:45.922752   96006 kube-vip.go:111] generating kube-vip config ...

	I0417 18:50:45.922800   96006 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0417 18:50:45.943173   96006 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0417 18:50:45.943265   96006 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0417 18:50:45.943322   96006 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:50:45.956026   96006 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0-rc.2': No such file or directory

	Initiating transfer...

	I0417 18:50:45.956087   96006 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:50:45.967843   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl.sha256

	I0417 18:50:45.967881   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:50:45.967960   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:50:45.967964   96006 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet.sha256 -> /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet

	I0417 18:50:45.967984   96006 download.go:107] Downloading: https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm.sha256 -> /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm

	I0417 18:50:45.972622   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubectl': No such file or directory

	I0417 18:50:45.972648   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl (51454104 bytes)

	I0417 18:50:48.202574   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:50:48.202664   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:50:48.208132   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm': No such file or directory

	I0417 18:50:48.208171   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm (50249880 bytes)

	I0417 18:50:50.185607   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:50:50.201809   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:50:50.201893   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:50:50.207126   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet': No such file or directory

	I0417 18:50:50.207170   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet (100100024 bytes)

	I0417 18:50:50.649074   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0417 18:50:50.659340   96006 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)

	I0417 18:50:50.678040   96006 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0417 18:50:50.697112   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0417 18:50:50.715650   96006 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0417 18:50:50.720043   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:50:50.733632   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:50:50.869987   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:50:50.888165   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:50:50.888697   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:50:50.888785   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:50:50.904309   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:44235

	I0417 18:50:50.904752   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:50:50.905310   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:50:50.905332   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:50:50.905622   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:50:50.905847   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:50:50.906027   96006 start.go:316] joinCluster: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2 Cl

usterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[default-storageclass:true storage-provisioner:true] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:

0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:50:50.906152   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0417 18:50:50.906180   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:50:50.909437   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:50.909900   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:50:50.909928   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:50:50.910110   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:50:50.910342   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:50:50.910526   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:50:50.910722   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:50:51.055851   96006 start.go:342] trying to join control-plane node "m02" to cluster: &{Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:50:51.055919   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zt3ppm.k6jpgcx1jeyj2jt1 --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m02 --control-plane --apiserver-advertise-address=192.168.39.236 --apiserver-bind-port=8443"

	I0417 18:51:13.972353   96006 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token zt3ppm.k6jpgcx1jeyj2jt1 --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m02 --control-plane --apiserver-advertise-address=192.168.39.236 --apiserver-bind-port=8443": (22.916397784s)

	I0417 18:51:13.972395   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0417 18:51:14.574803   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-467706-m02 minikube.k8s.io/updated_at=2024_04_17T18_51_14_0700 minikube.k8s.io/version=v1.33.0-beta.0 minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3 minikube.k8s.io/name=ha-467706 minikube.k8s.io/primary=false

	I0417 18:51:14.717411   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-467706-m02 node-role.kubernetes.io/control-plane:NoSchedule-

	I0417 18:51:14.893231   96006 start.go:318] duration metric: took 23.987209952s to joinCluster

	I0417 18:51:14.893330   96006 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:51:14.895174   96006 out.go:177] * Verifying Kubernetes components...

	I0417 18:51:14.893626   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:51:14.896844   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:51:15.183083   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:51:15.224796   96006 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:51:15.225073   96006 kapi.go:59] client config for ha-467706: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt", KeyFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key", CAFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5e2a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0417 18:51:15.225173   96006 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.159:8443

	I0417 18:51:15.225692   96006 node_ready.go:35] waiting up to 6m0s for node "ha-467706-m02" to be "Ready" ...

	I0417 18:51:15.225869   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:15.225880   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:15.225892   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:15.225896   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:15.236705   96006 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0417 18:51:15.726883   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:15.726910   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:15.726922   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:15.726928   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:15.735017   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:16.226972   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:16.227006   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:16.227019   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:16.227024   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:16.231152   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:16.726335   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:16.726359   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:16.726368   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:16.726371   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:16.730277   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:17.226638   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:17.226669   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:17.226678   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:17.226681   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:17.230662   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:17.231373   96006 node_ready.go:53] node "ha-467706-m02" has status "Ready":"False"

	I0417 18:51:17.726905   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:17.726929   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:17.726938   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:17.726941   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:17.731821   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:18.226785   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:18.226823   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:18.226835   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:18.226841   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:18.231456   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:18.726414   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:18.726439   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:18.726448   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:18.726451   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:18.742533   96006 round_trippers.go:574] Response Status: 200 OK in 16 milliseconds

	I0417 18:51:19.225974   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:19.225999   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:19.226009   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:19.226014   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:19.231635   96006 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0417 18:51:19.233042   96006 node_ready.go:53] node "ha-467706-m02" has status "Ready":"False"

	I0417 18:51:19.726389   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:19.726411   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:19.726420   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:19.726425   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:19.729897   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:20.225875   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:20.225899   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:20.225907   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:20.225911   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:20.229100   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:20.726901   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:20.726924   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:20.726932   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:20.726936   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:20.730417   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:21.226005   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:21.226091   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:21.226109   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:21.226117   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:21.230666   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:21.726785   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:21.726806   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:21.726813   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:21.726818   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:21.731509   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:21.732328   96006 node_ready.go:53] node "ha-467706-m02" has status "Ready":"False"

	I0417 18:51:22.226721   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:22.226745   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:22.226756   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:22.226761   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:22.231754   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:22.726964   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:22.726997   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:22.727010   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:22.727018   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:22.735454   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:23.226383   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:23.226413   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.226428   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.226437   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.229878   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:23.230663   96006 node_ready.go:49] node "ha-467706-m02" has status "Ready":"True"

	I0417 18:51:23.230683   96006 node_ready.go:38] duration metric: took 8.0049708s for node "ha-467706-m02" to be "Ready" ...

	I0417 18:51:23.230694   96006 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:51:23.230814   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:23.230827   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.230835   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.230838   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.239654   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:23.246313   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.246432   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-56dz8

	I0417 18:51:23.246443   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.246451   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.246454   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.249987   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:23.251471   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:23.251491   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.251498   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.251503   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.254142   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.254681   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:23.254699   96006 pod_ready.go:81] duration metric: took 8.360266ms for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.254707   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.254764   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-kcdqn

	I0417 18:51:23.254773   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.254780   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.254784   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.257241   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.257923   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:23.257937   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.257944   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.257947   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.260197   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.260616   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:23.260631   96006 pod_ready.go:81] duration metric: took 5.918629ms for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.260640   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.260696   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706

	I0417 18:51:23.260705   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.260712   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.260723   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.263098   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.263593   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:23.263606   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.263612   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.263616   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.266189   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.267242   96006 pod_ready.go:92] pod "etcd-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:23.267256   96006 pod_ready.go:81] duration metric: took 6.610637ms for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.267265   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:23.267312   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:23.267322   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.267328   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.267331   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.269674   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.270282   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:23.270294   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.270301   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.270304   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.272657   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:23.767707   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:23.767738   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.767746   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.767751   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.770927   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:23.771848   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:23.771867   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:23.771877   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:23.771882   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:23.774590   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:24.267451   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:24.267480   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.267493   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.267498   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.271213   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:24.272086   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:24.272102   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.272109   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.272114   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.275365   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:24.768469   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:24.768502   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.768514   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.768519   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.772128   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:24.773012   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:24.773028   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:24.773037   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:24.773041   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:24.776084   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:25.268038   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:25.268060   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.268068   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.268073   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.271535   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:25.272213   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:25.272231   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.272239   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.272244   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.275254   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:25.275716   96006 pod_ready.go:102] pod "etcd-ha-467706-m02" in "kube-system" namespace has status "Ready":"False"

	I0417 18:51:25.768203   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:25.768229   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.768239   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.768245   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.771806   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:25.772566   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:25.772611   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:25.772619   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:25.772625   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:25.775636   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:26.268063   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:26.268099   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.268124   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.268129   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.272010   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:26.272908   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:26.272926   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.272937   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.272942   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.275754   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:26.767796   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:26.767819   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.767827   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.767831   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.771440   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:26.772137   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:26.772157   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:26.772168   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:26.772174   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:26.775107   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.267560   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:51:27.267584   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.267592   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.267597   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.271553   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:27.272200   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:27.272217   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.272226   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.272229   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.274967   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.275841   96006 pod_ready.go:92] pod "etcd-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:27.275858   96006 pod_ready.go:81] duration metric: took 4.008587704s for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.275872   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.275926   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706

	I0417 18:51:27.275934   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.275941   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.275945   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.278731   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.279548   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:27.279562   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.279569   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.279572   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.282012   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.282523   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:27.282541   96006 pod_ready.go:81] duration metric: took 6.66288ms for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.282549   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:27.282597   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:27.282605   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.282612   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.282616   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.285219   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.285913   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:27.285925   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.285932   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.285936   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.288353   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:27.782927   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:27.782951   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.782962   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.782966   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.787431   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:27.788870   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:27.788887   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:27.788895   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:27.788900   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:27.792215   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:28.283697   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:28.283728   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.283737   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.283741   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.287291   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:28.288522   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:28.288535   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.288545   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.288548   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.291872   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:28.782825   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:28.782848   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.782857   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.782862   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.787118   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:28.787874   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:28.787889   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:28.787897   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:28.787902   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:28.791077   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:29.283249   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:29.283280   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.283292   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.283297   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.288519   96006 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0417 18:51:29.289409   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:29.289428   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.289440   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.289446   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.292965   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:29.293591   96006 pod_ready.go:102] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"False"

	I0417 18:51:29.782904   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:29.782929   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.782940   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.782944   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.787500   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:29.789301   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:29.789322   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:29.789333   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:29.789339   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:29.793831   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:30.283438   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:30.283462   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.283470   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.283474   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.286931   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:30.287797   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:30.287812   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.287820   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.287825   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.290475   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:30.783555   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:30.783578   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.783586   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.783591   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.787803   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:30.788747   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:30.788767   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:30.788804   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:30.788811   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:30.792158   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:31.283747   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:31.283777   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.283790   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.283795   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.288177   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:31.289081   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:31.289095   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.289103   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.289107   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.292276   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:31.783370   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:31.783402   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.783414   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.783420   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.786680   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:31.787486   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:31.787503   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:31.787510   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:31.787514   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:31.790453   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:31.790996   96006 pod_ready.go:102] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"False"

	I0417 18:51:32.283343   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:51:32.283366   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.283375   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.283380   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.287390   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.289101   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.289117   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.289129   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.289137   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.297645   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:51:32.298808   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.298825   96006 pod_ready.go:81] duration metric: took 5.016269549s for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.298836   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.298896   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706

	I0417 18:51:32.298903   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.298911   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.298918   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.303341   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:32.304646   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:32.304662   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.304670   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.304675   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.307481   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:32.307982   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.308001   96006 pod_ready.go:81] duration metric: took 9.157988ms for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.308011   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.308072   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m02

	I0417 18:51:32.308080   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.308087   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.308090   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.310622   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:32.311286   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.311300   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.311306   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.311309   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.314424   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.315460   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.315477   96006 pod_ready.go:81] duration metric: took 7.460114ms for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.315486   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.315539   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-hd469

	I0417 18:51:32.315547   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.315554   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.315562   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.318568   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:51:32.426747   96006 request.go:629] Waited for 107.278257ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:32.426836   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:32.426844   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.426855   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.426865   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.430214   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.430962   96006 pod_ready.go:92] pod "kube-proxy-hd469" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.430982   96006 pod_ready.go:81] duration metric: took 115.490294ms for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.430993   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.626388   96006 request.go:629] Waited for 195.326382ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:51:32.626452   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:51:32.626458   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.626466   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.626478   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.630307   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:32.827284   96006 request.go:629] Waited for 196.366908ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.827344   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:32.827349   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:32.827357   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:32.827364   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:32.831913   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:32.832435   96006 pod_ready.go:92] pod "kube-proxy-qxtf4" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:32.832455   96006 pod_ready.go:81] duration metric: took 401.454584ms for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:32.832469   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.026738   96006 request.go:629] Waited for 194.18784ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:51:33.026803   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:51:33.026810   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.026821   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.026837   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.030357   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:33.226664   96006 request.go:629] Waited for 195.467878ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:33.226745   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:51:33.226754   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.226763   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.226766   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.230848   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:51:33.231696   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:33.231721   96006 pod_ready.go:81] duration metric: took 399.24464ms for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.231736   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.426832   96006 request.go:629] Waited for 194.99926ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:51:33.426911   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:51:33.426918   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.426927   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.426938   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.430894   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:33.626958   96006 request.go:629] Waited for 195.422824ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:33.627025   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:51:33.627030   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.627038   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.627041   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.631026   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:33.631774   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:51:33.631795   96006 pod_ready.go:81] duration metric: took 400.050921ms for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:51:33.631806   96006 pod_ready.go:38] duration metric: took 10.401080338s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:51:33.631822   96006 api_server.go:52] waiting for apiserver process to appear ...

	I0417 18:51:33.631879   96006 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:51:33.648554   96006 api_server.go:72] duration metric: took 18.75517691s to wait for apiserver process to appear ...

	I0417 18:51:33.648600   96006 api_server.go:88] waiting for apiserver healthz status ...

	I0417 18:51:33.648626   96006 api_server.go:253] Checking apiserver healthz at https://192.168.39.159:8443/healthz ...

	I0417 18:51:33.653277   96006 api_server.go:279] https://192.168.39.159:8443/healthz returned 200:

	ok

	I0417 18:51:33.653354   96006 round_trippers.go:463] GET https://192.168.39.159:8443/version

	I0417 18:51:33.653362   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.653370   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.653374   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.654340   96006 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0417 18:51:33.654453   96006 api_server.go:141] control plane version: v1.30.0-rc.2

	I0417 18:51:33.654471   96006 api_server.go:131] duration metric: took 5.864211ms to wait for apiserver health ...

	I0417 18:51:33.654480   96006 system_pods.go:43] waiting for kube-system pods to appear ...

	I0417 18:51:33.826909   96006 request.go:629] Waited for 172.335088ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:33.826975   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:33.826981   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:33.826989   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:33.826993   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:33.832448   96006 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0417 18:51:33.837613   96006 system_pods.go:59] 17 kube-system pods found

	I0417 18:51:33.837640   96006 system_pods.go:61] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:51:33.837646   96006 system_pods.go:61] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:51:33.837650   96006 system_pods.go:61] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:51:33.837654   96006 system_pods.go:61] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:51:33.837659   96006 system_pods.go:61] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:51:33.837663   96006 system_pods.go:61] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:51:33.837668   96006 system_pods.go:61] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:51:33.837675   96006 system_pods.go:61] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:51:33.837681   96006 system_pods.go:61] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:51:33.837690   96006 system_pods.go:61] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:51:33.837698   96006 system_pods.go:61] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:51:33.837703   96006 system_pods.go:61] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:51:33.837709   96006 system_pods.go:61] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:51:33.837713   96006 system_pods.go:61] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:51:33.837718   96006 system_pods.go:61] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:51:33.837721   96006 system_pods.go:61] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:51:33.837726   96006 system_pods.go:61] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:51:33.837732   96006 system_pods.go:74] duration metric: took 183.242044ms to wait for pod list to return data ...

	I0417 18:51:33.837743   96006 default_sa.go:34] waiting for default service account to be created ...

	I0417 18:51:34.027238   96006 request.go:629] Waited for 189.408907ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:51:34.027344   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:51:34.027356   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:34.027369   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:34.027387   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:34.031074   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:34.031378   96006 default_sa.go:45] found service account: "default"

	I0417 18:51:34.031406   96006 default_sa.go:55] duration metric: took 193.654279ms for default service account to be created ...

	I0417 18:51:34.031422   96006 system_pods.go:116] waiting for k8s-apps to be running ...

	I0417 18:51:34.226919   96006 request.go:629] Waited for 195.41558ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:34.227010   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:51:34.227019   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:34.227035   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:34.227045   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:34.233257   96006 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0417 18:51:34.238042   96006 system_pods.go:86] 17 kube-system pods found

	I0417 18:51:34.238071   96006 system_pods.go:89] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:51:34.238076   96006 system_pods.go:89] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:51:34.238081   96006 system_pods.go:89] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:51:34.238087   96006 system_pods.go:89] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:51:34.238093   96006 system_pods.go:89] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:51:34.238099   96006 system_pods.go:89] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:51:34.238104   96006 system_pods.go:89] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:51:34.238111   96006 system_pods.go:89] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:51:34.238121   96006 system_pods.go:89] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:51:34.238129   96006 system_pods.go:89] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:51:34.238135   96006 system_pods.go:89] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:51:34.238144   96006 system_pods.go:89] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:51:34.238152   96006 system_pods.go:89] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:51:34.238162   96006 system_pods.go:89] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:51:34.238171   96006 system_pods.go:89] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:51:34.238180   96006 system_pods.go:89] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:51:34.238189   96006 system_pods.go:89] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:51:34.238202   96006 system_pods.go:126] duration metric: took 206.768944ms to wait for k8s-apps to be running ...

	I0417 18:51:34.238215   96006 system_svc.go:44] waiting for kubelet service to be running ....

	I0417 18:51:34.238275   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:51:34.255222   96006 system_svc.go:56] duration metric: took 16.993241ms WaitForService to wait for kubelet

	I0417 18:51:34.255257   96006 kubeadm.go:576] duration metric: took 19.361885993s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0417 18:51:34.255285   96006 node_conditions.go:102] verifying NodePressure condition ...

	I0417 18:51:34.426766   96006 request.go:629] Waited for 171.388544ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes

	I0417 18:51:34.426844   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes

	I0417 18:51:34.426849   96006 round_trippers.go:469] Request Headers:

	I0417 18:51:34.426857   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:51:34.426862   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:51:34.430450   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:51:34.431543   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:51:34.431577   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:51:34.431593   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:51:34.431598   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:51:34.431605   96006 node_conditions.go:105] duration metric: took 176.314123ms to run NodePressure ...

	I0417 18:51:34.431620   96006 start.go:240] waiting for startup goroutines ...

	I0417 18:51:34.431657   96006 start.go:254] writing updated cluster config ...

	I0417 18:51:34.433887   96006 out.go:177] 

	I0417 18:51:34.435625   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:51:34.435731   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:51:34.437530   96006 out.go:177] * Starting "ha-467706-m03" control-plane node in "ha-467706" cluster

	I0417 18:51:34.438965   96006 preload.go:132] Checking if preload exists for k8s version v1.30.0-rc.2 and runtime crio

	I0417 18:51:34.438995   96006 cache.go:56] Caching tarball of preloaded images

	I0417 18:51:34.439105   96006 preload.go:173] Found /home/jenkins/minikube-integration/18665-75973/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.0-rc.2-cri-o-overlay-amd64.tar.lz4 in cache, skipping download

	I0417 18:51:34.439117   96006 cache.go:59] Finished verifying existence of preloaded tar for v1.30.0-rc.2 on crio

	I0417 18:51:34.439238   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:51:34.439424   96006 start.go:360] acquireMachinesLock for ha-467706-m03: {Name:mk477aec4c276e4d91f705836ed4842912dfe2c1 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0417 18:51:34.439471   96006 start.go:364] duration metric: took 26.368µs to acquireMachinesLock for "ha-467706-m03"

	I0417 18:51:34.439490   96006 start.go:93] Provisioning new machine with config: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kubernete

sVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false in

gress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker Binary

Mirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name:m03 IP: Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:51:34.439582   96006 start.go:125] createHost starting for "m03" (driver="kvm2")

	I0417 18:51:34.441053   96006 out.go:204] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...

	I0417 18:51:34.441163   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:51:34.441212   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:51:34.456551   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37695

	I0417 18:51:34.457105   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:51:34.457624   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:51:34.457646   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:51:34.457978   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:51:34.458265   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:34.458431   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:34.458625   96006 start.go:159] libmachine.API.Create for "ha-467706" (driver="kvm2")

	I0417 18:51:34.458663   96006 client.go:168] LocalClient.Create starting

	I0417 18:51:34.458711   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem

	I0417 18:51:34.458750   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:51:34.458773   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:51:34.458838   96006 main.go:141] libmachine: Reading certificate data from /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem

	I0417 18:51:34.458866   96006 main.go:141] libmachine: Decoding PEM data...

	I0417 18:51:34.458883   96006 main.go:141] libmachine: Parsing certificate...

	I0417 18:51:34.458907   96006 main.go:141] libmachine: Running pre-create checks...

	I0417 18:51:34.458920   96006 main.go:141] libmachine: (ha-467706-m03) Calling .PreCreateCheck

	I0417 18:51:34.459099   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetConfigRaw

	I0417 18:51:34.459607   96006 main.go:141] libmachine: Creating machine...

	I0417 18:51:34.459627   96006 main.go:141] libmachine: (ha-467706-m03) Calling .Create

	I0417 18:51:34.459808   96006 main.go:141] libmachine: (ha-467706-m03) Creating KVM machine...

	I0417 18:51:34.461114   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found existing default KVM network

	I0417 18:51:34.461289   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found existing private KVM network mk-ha-467706

	I0417 18:51:34.461430   96006 main.go:141] libmachine: (ha-467706-m03) Setting up store path in /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03 ...

	I0417 18:51:34.461457   96006 main.go:141] libmachine: (ha-467706-m03) Building disk image from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso

	I0417 18:51:34.461539   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.461418   96690 common.go:145] Making disk image using store path: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:51:34.461604   96006 main.go:141] libmachine: (ha-467706-m03) Downloading /home/jenkins/minikube-integration/18665-75973/.minikube/cache/boot2docker.iso from file:///home/jenkins/minikube-integration/18665-75973/.minikube/cache/iso/amd64/minikube-v1.33.0-1713236417-18649-amd64.iso...

	I0417 18:51:34.702350   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.702215   96690 common.go:152] Creating ssh key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa...

	I0417 18:51:34.869742   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.869577   96690 common.go:158] Creating raw disk image: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/ha-467706-m03.rawdisk...

	I0417 18:51:34.869789   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Writing magic tar header

	I0417 18:51:34.869844   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Writing SSH key tar header

	I0417 18:51:34.869872   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03 (perms=drwx------)

	I0417 18:51:34.869891   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:34.869703   96690 common.go:172] Fixing permissions on /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03 ...

	I0417 18:51:34.869911   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03

	I0417 18:51:34.869926   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube/machines

	I0417 18:51:34.869933   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube/machines (perms=drwxr-xr-x)

	I0417 18:51:34.869949   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973/.minikube (perms=drwxr-xr-x)

	I0417 18:51:34.869960   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration/18665-75973 (perms=drwxrwxr-x)

	I0417 18:51:34.869974   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973/.minikube

	I0417 18:51:34.869987   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration/18665-75973

	I0417 18:51:34.869996   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins/minikube-integration

	I0417 18:51:34.870021   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home/jenkins

	I0417 18:51:34.870047   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Checking permissions on dir: /home

	I0417 18:51:34.870063   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins/minikube-integration (perms=drwxrwxr-x)

	I0417 18:51:34.870079   96006 main.go:141] libmachine: (ha-467706-m03) Setting executable bit set on /home/jenkins (perms=drwxr-xr-x)

	I0417 18:51:34.870089   96006 main.go:141] libmachine: (ha-467706-m03) Creating domain...

	I0417 18:51:34.870104   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Skipping /home - not owner

	I0417 18:51:34.871109   96006 main.go:141] libmachine: (ha-467706-m03) define libvirt domain using xml: 

	I0417 18:51:34.871128   96006 main.go:141] libmachine: (ha-467706-m03) <domain type='kvm'>

	I0417 18:51:34.871138   96006 main.go:141] libmachine: (ha-467706-m03)   <name>ha-467706-m03</name>

	I0417 18:51:34.871151   96006 main.go:141] libmachine: (ha-467706-m03)   <memory unit='MiB'>2200</memory>

	I0417 18:51:34.871163   96006 main.go:141] libmachine: (ha-467706-m03)   <vcpu>2</vcpu>

	I0417 18:51:34.871169   96006 main.go:141] libmachine: (ha-467706-m03)   <features>

	I0417 18:51:34.871176   96006 main.go:141] libmachine: (ha-467706-m03)     <acpi/>

	I0417 18:51:34.871183   96006 main.go:141] libmachine: (ha-467706-m03)     <apic/>

	I0417 18:51:34.871196   96006 main.go:141] libmachine: (ha-467706-m03)     <pae/>

	I0417 18:51:34.871206   96006 main.go:141] libmachine: (ha-467706-m03)     

	I0417 18:51:34.871248   96006 main.go:141] libmachine: (ha-467706-m03)   </features>

	I0417 18:51:34.871271   96006 main.go:141] libmachine: (ha-467706-m03)   <cpu mode='host-passthrough'>

	I0417 18:51:34.871280   96006 main.go:141] libmachine: (ha-467706-m03)   

	I0417 18:51:34.871291   96006 main.go:141] libmachine: (ha-467706-m03)   </cpu>

	I0417 18:51:34.871315   96006 main.go:141] libmachine: (ha-467706-m03)   <os>

	I0417 18:51:34.871336   96006 main.go:141] libmachine: (ha-467706-m03)     <type>hvm</type>

	I0417 18:51:34.871348   96006 main.go:141] libmachine: (ha-467706-m03)     <boot dev='cdrom'/>

	I0417 18:51:34.871358   96006 main.go:141] libmachine: (ha-467706-m03)     <boot dev='hd'/>

	I0417 18:51:34.871366   96006 main.go:141] libmachine: (ha-467706-m03)     <bootmenu enable='no'/>

	I0417 18:51:34.871375   96006 main.go:141] libmachine: (ha-467706-m03)   </os>

	I0417 18:51:34.871383   96006 main.go:141] libmachine: (ha-467706-m03)   <devices>

	I0417 18:51:34.871395   96006 main.go:141] libmachine: (ha-467706-m03)     <disk type='file' device='cdrom'>

	I0417 18:51:34.871411   96006 main.go:141] libmachine: (ha-467706-m03)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/boot2docker.iso'/>

	I0417 18:51:34.871424   96006 main.go:141] libmachine: (ha-467706-m03)       <target dev='hdc' bus='scsi'/>

	I0417 18:51:34.871435   96006 main.go:141] libmachine: (ha-467706-m03)       <readonly/>

	I0417 18:51:34.871442   96006 main.go:141] libmachine: (ha-467706-m03)     </disk>

	I0417 18:51:34.871452   96006 main.go:141] libmachine: (ha-467706-m03)     <disk type='file' device='disk'>

	I0417 18:51:34.871465   96006 main.go:141] libmachine: (ha-467706-m03)       <driver name='qemu' type='raw' cache='default' io='threads' />

	I0417 18:51:34.871480   96006 main.go:141] libmachine: (ha-467706-m03)       <source file='/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/ha-467706-m03.rawdisk'/>

	I0417 18:51:34.871492   96006 main.go:141] libmachine: (ha-467706-m03)       <target dev='hda' bus='virtio'/>

	I0417 18:51:34.871500   96006 main.go:141] libmachine: (ha-467706-m03)     </disk>

	I0417 18:51:34.871509   96006 main.go:141] libmachine: (ha-467706-m03)     <interface type='network'>

	I0417 18:51:34.871517   96006 main.go:141] libmachine: (ha-467706-m03)       <source network='mk-ha-467706'/>

	I0417 18:51:34.871525   96006 main.go:141] libmachine: (ha-467706-m03)       <model type='virtio'/>

	I0417 18:51:34.871535   96006 main.go:141] libmachine: (ha-467706-m03)     </interface>

	I0417 18:51:34.871545   96006 main.go:141] libmachine: (ha-467706-m03)     <interface type='network'>

	I0417 18:51:34.871555   96006 main.go:141] libmachine: (ha-467706-m03)       <source network='default'/>

	I0417 18:51:34.871563   96006 main.go:141] libmachine: (ha-467706-m03)       <model type='virtio'/>

	I0417 18:51:34.871572   96006 main.go:141] libmachine: (ha-467706-m03)     </interface>

	I0417 18:51:34.871579   96006 main.go:141] libmachine: (ha-467706-m03)     <serial type='pty'>

	I0417 18:51:34.871585   96006 main.go:141] libmachine: (ha-467706-m03)       <target port='0'/>

	I0417 18:51:34.871615   96006 main.go:141] libmachine: (ha-467706-m03)     </serial>

	I0417 18:51:34.871633   96006 main.go:141] libmachine: (ha-467706-m03)     <console type='pty'>

	I0417 18:51:34.871648   96006 main.go:141] libmachine: (ha-467706-m03)       <target type='serial' port='0'/>

	I0417 18:51:34.871656   96006 main.go:141] libmachine: (ha-467706-m03)     </console>

	I0417 18:51:34.871666   96006 main.go:141] libmachine: (ha-467706-m03)     <rng model='virtio'>

	I0417 18:51:34.871693   96006 main.go:141] libmachine: (ha-467706-m03)       <backend model='random'>/dev/random</backend>

	I0417 18:51:34.871705   96006 main.go:141] libmachine: (ha-467706-m03)     </rng>

	I0417 18:51:34.871715   96006 main.go:141] libmachine: (ha-467706-m03)     

	I0417 18:51:34.871723   96006 main.go:141] libmachine: (ha-467706-m03)     

	I0417 18:51:34.871733   96006 main.go:141] libmachine: (ha-467706-m03)   </devices>

	I0417 18:51:34.871745   96006 main.go:141] libmachine: (ha-467706-m03) </domain>

	I0417 18:51:34.871751   96006 main.go:141] libmachine: (ha-467706-m03) 

	I0417 18:51:34.878872   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:20:46:22 in network default

	I0417 18:51:34.879554   96006 main.go:141] libmachine: (ha-467706-m03) Ensuring networks are active...

	I0417 18:51:34.879573   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:34.880392   96006 main.go:141] libmachine: (ha-467706-m03) Ensuring network default is active

	I0417 18:51:34.880661   96006 main.go:141] libmachine: (ha-467706-m03) Ensuring network mk-ha-467706 is active

	I0417 18:51:34.881007   96006 main.go:141] libmachine: (ha-467706-m03) Getting domain xml...

	I0417 18:51:34.881716   96006 main.go:141] libmachine: (ha-467706-m03) Creating domain...

	I0417 18:51:36.106921   96006 main.go:141] libmachine: (ha-467706-m03) Waiting to get IP...

	I0417 18:51:36.107774   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:36.108244   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:36.108290   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:36.108235   96690 retry.go:31] will retry after 259.688955ms: waiting for machine to come up

	I0417 18:51:36.369919   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:36.370449   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:36.370484   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:36.370393   96690 retry.go:31] will retry after 263.833952ms: waiting for machine to come up

	I0417 18:51:36.636049   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:36.636520   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:36.636546   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:36.636478   96690 retry.go:31] will retry after 477.100713ms: waiting for machine to come up

	I0417 18:51:37.115192   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:37.115714   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:37.115748   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:37.115659   96690 retry.go:31] will retry after 585.751769ms: waiting for machine to come up

	I0417 18:51:37.703494   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:37.704022   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:37.704046   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:37.703971   96690 retry.go:31] will retry after 480.911798ms: waiting for machine to come up

	I0417 18:51:38.186810   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:38.187304   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:38.187336   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:38.187235   96690 retry.go:31] will retry after 741.971724ms: waiting for machine to come up

	I0417 18:51:38.931059   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:38.931460   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:38.931485   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:38.931420   96690 retry.go:31] will retry after 818.006613ms: waiting for machine to come up

	I0417 18:51:39.751433   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:39.751984   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:39.752015   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:39.751936   96690 retry.go:31] will retry after 1.076985012s: waiting for machine to come up

	I0417 18:51:40.830953   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:40.831445   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:40.831485   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:40.831385   96690 retry.go:31] will retry after 1.317961563s: waiting for machine to come up

	I0417 18:51:42.150497   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:42.150927   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:42.150950   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:42.150902   96690 retry.go:31] will retry after 1.665893506s: waiting for machine to come up

	I0417 18:51:43.818870   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:43.819324   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:43.819354   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:43.819268   96690 retry.go:31] will retry after 2.909952059s: waiting for machine to come up

	I0417 18:51:46.730539   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:46.731025   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:46.731049   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:46.730987   96690 retry.go:31] will retry after 3.59067388s: waiting for machine to come up

	I0417 18:51:50.322830   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:50.323323   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:50.323355   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:50.323263   96690 retry.go:31] will retry after 3.540199243s: waiting for machine to come up

	I0417 18:51:53.866714   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:53.867100   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find current IP address of domain ha-467706-m03 in network mk-ha-467706

	I0417 18:51:53.867130   96006 main.go:141] libmachine: (ha-467706-m03) DBG | I0417 18:51:53.867046   96690 retry.go:31] will retry after 3.58223567s: waiting for machine to come up

	I0417 18:51:57.450494   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.450992   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has current primary IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.451015   96006 main.go:141] libmachine: (ha-467706-m03) Found IP for machine: 192.168.39.250

	I0417 18:51:57.451069   96006 main.go:141] libmachine: (ha-467706-m03) Reserving static IP address...

	I0417 18:51:57.451464   96006 main.go:141] libmachine: (ha-467706-m03) DBG | unable to find host DHCP lease matching {name: "ha-467706-m03", mac: "52:54:00:93:9e:a9", ip: "192.168.39.250"} in network mk-ha-467706

	I0417 18:51:57.528115   96006 main.go:141] libmachine: (ha-467706-m03) Reserved static IP address: 192.168.39.250

	I0417 18:51:57.528155   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Getting to WaitForSSH function...

	I0417 18:51:57.528164   96006 main.go:141] libmachine: (ha-467706-m03) Waiting for SSH to be available...

	I0417 18:51:57.531251   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.531739   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:minikube Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.531764   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.531909   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Using SSH client type: external

	I0417 18:51:57.531940   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa (-rw-------)

	I0417 18:51:57.531977   96006 main.go:141] libmachine: (ha-467706-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.250 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0417 18:51:57.531996   96006 main.go:141] libmachine: (ha-467706-m03) DBG | About to run SSH command:

	I0417 18:51:57.532010   96006 main.go:141] libmachine: (ha-467706-m03) DBG | exit 0

	I0417 18:51:57.660953   96006 main.go:141] libmachine: (ha-467706-m03) DBG | SSH cmd err, output: <nil>: 

	I0417 18:51:57.661254   96006 main.go:141] libmachine: (ha-467706-m03) KVM machine creation complete!

	I0417 18:51:57.661574   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetConfigRaw

	I0417 18:51:57.662186   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:57.662357   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:57.662518   96006 main.go:141] libmachine: Waiting for machine to be running, this may take a few minutes...

	I0417 18:51:57.662533   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetState

	I0417 18:51:57.663657   96006 main.go:141] libmachine: Detecting operating system of created instance...

	I0417 18:51:57.663671   96006 main.go:141] libmachine: Waiting for SSH to be available...

	I0417 18:51:57.663677   96006 main.go:141] libmachine: Getting to WaitForSSH function...

	I0417 18:51:57.663683   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:57.665980   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.666354   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.666381   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.666482   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:57.666701   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.666883   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.667009   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:57.667140   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:57.667390   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:57.667406   96006 main.go:141] libmachine: About to run SSH command:

	exit 0

	I0417 18:51:57.776433   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:51:57.776460   96006 main.go:141] libmachine: Detecting the provisioner...

	I0417 18:51:57.776470   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:57.779557   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.780066   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.780108   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.780214   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:57.780447   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.780635   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.780844   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:57.781095   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:57.781318   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:57.781334   96006 main.go:141] libmachine: About to run SSH command:

	cat /etc/os-release

	I0417 18:51:57.890734   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: NAME=Buildroot

	VERSION=2023.02.9-dirty

	ID=buildroot

	VERSION_ID=2023.02.9

	PRETTY_NAME="Buildroot 2023.02.9"

	I0417 18:51:57.890841   96006 main.go:141] libmachine: found compatible host: buildroot

	I0417 18:51:57.890855   96006 main.go:141] libmachine: Provisioning with buildroot...

	I0417 18:51:57.890869   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:57.891166   96006 buildroot.go:166] provisioning hostname "ha-467706-m03"

	I0417 18:51:57.891206   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:57.891442   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:57.894112   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.894576   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:57.894606   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:57.894749   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:57.894916   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.895074   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:57.895260   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:57.895416   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:57.895592   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:57.895604   96006 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-467706-m03 && echo "ha-467706-m03" | sudo tee /etc/hostname

	I0417 18:51:58.022957   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-467706-m03

	I0417 18:51:58.022997   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.026141   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.026552   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.026585   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.026799   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.027009   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.027194   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.027452   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.027784   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:58.028015   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:58.028040   96006 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-467706-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-467706-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-467706-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0417 18:51:58.147117   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0417 18:51:58.147158   96006 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/18665-75973/.minikube CaCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/18665-75973/.minikube}

	I0417 18:51:58.147176   96006 buildroot.go:174] setting up certificates

	I0417 18:51:58.147187   96006 provision.go:84] configureAuth start

	I0417 18:51:58.147197   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetMachineName

	I0417 18:51:58.147514   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:51:58.150495   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.150863   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.150904   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.151108   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.153368   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.153737   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.153757   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.153954   96006 provision.go:143] copyHostCerts

	I0417 18:51:58.153999   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:51:58.154045   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem, removing ...

	I0417 18:51:58.154059   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem

	I0417 18:51:58.154141   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/ca.pem (1078 bytes)

	I0417 18:51:58.154273   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:51:58.154307   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem, removing ...

	I0417 18:51:58.154318   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem

	I0417 18:51:58.154358   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/cert.pem (1123 bytes)

	I0417 18:51:58.154424   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:51:58.154448   96006 exec_runner.go:144] found /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem, removing ...

	I0417 18:51:58.154457   96006 exec_runner.go:203] rm: /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem

	I0417 18:51:58.154489   96006 exec_runner.go:151] cp: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/18665-75973/.minikube/key.pem (1679 bytes)

	I0417 18:51:58.154574   96006 provision.go:117] generating server cert: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem org=jenkins.ha-467706-m03 san=[127.0.0.1 192.168.39.250 ha-467706-m03 localhost minikube]

	I0417 18:51:58.356725   96006 provision.go:177] copyRemoteCerts

	I0417 18:51:58.356820   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0417 18:51:58.356856   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.359545   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.359943   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.359981   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.360159   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.360359   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.360546   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.360688   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:58.443213   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0417 18:51:58.443311   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0417 18:51:58.471921   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0417 18:51:58.472006   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0417 18:51:58.498008   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0417 18:51:58.498081   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0417 18:51:58.524744   96006 provision.go:87] duration metric: took 377.543951ms to configureAuth

	I0417 18:51:58.524790   96006 buildroot.go:189] setting minikube options for container-runtime

	I0417 18:51:58.525095   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:51:58.525185   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.527959   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.528315   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.528338   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.528543   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.528758   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.528953   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.529129   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.529297   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:58.529463   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:58.529477   96006 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /etc/sysconfig && printf %!s(MISSING) "

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	" | sudo tee /etc/sysconfig/crio.minikube && sudo systemctl restart crio

	I0417 18:51:58.811996   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	CRIO_MINIKUBE_OPTIONS='--insecure-registry 10.96.0.0/12 '

	I0417 18:51:58.812039   96006 main.go:141] libmachine: Checking connection to Docker...

	I0417 18:51:58.812051   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetURL

	I0417 18:51:58.813614   96006 main.go:141] libmachine: (ha-467706-m03) DBG | Using libvirt version 6000000

	I0417 18:51:58.815988   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.816312   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.816337   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.816495   96006 main.go:141] libmachine: Docker is up and running!

	I0417 18:51:58.816517   96006 main.go:141] libmachine: Reticulating splines...

	I0417 18:51:58.816526   96006 client.go:171] duration metric: took 24.357851209s to LocalClient.Create

	I0417 18:51:58.816556   96006 start.go:167] duration metric: took 24.357933069s to libmachine.API.Create "ha-467706"

	I0417 18:51:58.816567   96006 start.go:293] postStartSetup for "ha-467706-m03" (driver="kvm2")

	I0417 18:51:58.816579   96006 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0417 18:51:58.816597   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:58.816866   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0417 18:51:58.816890   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.819416   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.819788   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.819817   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.819908   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.820089   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.820264   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.820455   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:58.903423   96006 ssh_runner.go:195] Run: cat /etc/os-release

	I0417 18:51:58.907793   96006 info.go:137] Remote host: Buildroot 2023.02.9

	I0417 18:51:58.907829   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/addons for local assets ...

	I0417 18:51:58.907891   96006 filesync.go:126] Scanning /home/jenkins/minikube-integration/18665-75973/.minikube/files for local assets ...

	I0417 18:51:58.907963   96006 filesync.go:149] local asset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> 832072.pem in /etc/ssl/certs

	I0417 18:51:58.907973   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /etc/ssl/certs/832072.pem

	I0417 18:51:58.908078   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0417 18:51:58.917857   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:51:58.944503   96006 start.go:296] duration metric: took 127.921184ms for postStartSetup

	I0417 18:51:58.944571   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetConfigRaw

	I0417 18:51:58.945214   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:51:58.947772   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.948095   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.948138   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.948469   96006 profile.go:143] Saving config to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/config.json ...

	I0417 18:51:58.948684   96006 start.go:128] duration metric: took 24.509091391s to createHost

	I0417 18:51:58.948711   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:58.951031   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.951386   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:58.951416   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:58.951598   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:58.951807   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.951995   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:58.952112   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:58.952234   96006 main.go:141] libmachine: Using SSH client type: native

	I0417 18:51:58.952417   96006 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d4e0] 0x830240 <nil>  [] 0s} 192.168.39.250 22 <nil> <nil>}

	I0417 18:51:58.952429   96006 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0417 18:51:59.061669   96006 main.go:141] libmachine: SSH cmd err, output: <nil>: 1713379919.025305300

	I0417 18:51:59.061695   96006 fix.go:216] guest clock: 1713379919.025305300

	I0417 18:51:59.061704   96006 fix.go:229] Guest: 2024-04-17 18:51:59.0253053 +0000 UTC Remote: 2024-04-17 18:51:58.948697509 +0000 UTC m=+156.376044537 (delta=76.607791ms)

	I0417 18:51:59.061723   96006 fix.go:200] guest clock delta is within tolerance: 76.607791ms

	I0417 18:51:59.061730   96006 start.go:83] releasing machines lock for "ha-467706-m03", held for 24.622249744s

	I0417 18:51:59.061754   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.062041   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:51:59.064824   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.065192   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:59.065231   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.067675   96006 out.go:177] * Found network options:

	I0417 18:51:59.069081   96006 out.go:177]   - NO_PROXY=192.168.39.159,192.168.39.236

	W0417 18:51:59.070321   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	W0417 18:51:59.070343   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:51:59.070360   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.071000   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.071241   96006 main.go:141] libmachine: (ha-467706-m03) Calling .DriverName

	I0417 18:51:59.071364   96006 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0417 18:51:59.071410   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	W0417 18:51:59.071447   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	W0417 18:51:59.071470   96006 proxy.go:119] fail to check proxy env: Error ip not in block

	I0417 18:51:59.071539   96006 ssh_runner.go:195] Run: sudo sh -c "podman version >/dev/null"

	I0417 18:51:59.071564   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHHostname

	I0417 18:51:59.075438   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.075906   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.076399   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:59.076426   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.076632   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:51:59.076660   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:59.076671   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:51:59.076837   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHPort

	I0417 18:51:59.076882   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:59.076982   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHKeyPath

	I0417 18:51:59.077030   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:59.077184   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetSSHUsername

	I0417 18:51:59.077180   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:59.077333   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.250 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706-m03/id_rsa Username:docker}

	I0417 18:51:59.312868   96006 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0417 18:51:59.319779   96006 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0417 18:51:59.319848   96006 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0417 18:51:59.337213   96006 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0417 18:51:59.337240   96006 start.go:494] detecting cgroup driver to use...

	I0417 18:51:59.337303   96006 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0417 18:51:59.356790   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0417 18:51:59.371164   96006 docker.go:217] disabling cri-docker service (if available) ...

	I0417 18:51:59.371221   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.socket

	I0417 18:51:59.385299   96006 ssh_runner.go:195] Run: sudo systemctl stop -f cri-docker.service

	I0417 18:51:59.399551   96006 ssh_runner.go:195] Run: sudo systemctl disable cri-docker.socket

	I0417 18:51:59.511492   96006 ssh_runner.go:195] Run: sudo systemctl mask cri-docker.service

	I0417 18:51:59.680128   96006 docker.go:233] disabling docker service ...

	I0417 18:51:59.680200   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.socket

	I0417 18:51:59.695980   96006 ssh_runner.go:195] Run: sudo systemctl stop -f docker.service

	I0417 18:51:59.709911   96006 ssh_runner.go:195] Run: sudo systemctl disable docker.socket

	I0417 18:51:59.853481   96006 ssh_runner.go:195] Run: sudo systemctl mask docker.service

	I0417 18:51:59.975362   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service docker

	I0417 18:51:59.990715   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/crio/crio.sock

	" | sudo tee /etc/crictl.yaml"

	I0417 18:52:00.014556   96006 crio.go:59] configure cri-o to use "registry.k8s.io/pause:3.9" pause image...

	I0417 18:52:00.014646   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*pause_image = .*$|pause_image = "registry.k8s.io/pause:3.9"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.026160   96006 crio.go:70] configuring cri-o to use "cgroupfs" as cgroup driver...

	I0417 18:52:00.026224   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|^.*cgroup_manager = .*$|cgroup_manager = "cgroupfs"|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.037683   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/conmon_cgroup = .*/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.049269   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/cgroup_manager = .*/a conmon_cgroup = "pod"' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.060422   96006 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0417 18:52:00.072142   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *"net.ipv4.ip_unprivileged_port_start=.*"/d' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.083153   96006 ssh_runner.go:195] Run: sh -c "sudo grep -q "^ *default_sysctls" /etc/crio/crio.conf.d/02-crio.conf || sudo sed -i '/conmon_cgroup = .*/a default_sysctls = \[\n\]' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.103537   96006 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^default_sysctls *= *\[|&\n  "net.ipv4.ip_unprivileged_port_start=0",|' /etc/crio/crio.conf.d/02-crio.conf"

	I0417 18:52:00.115363   96006 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0417 18:52:00.125483   96006 crio.go:166] couldn't verify netfilter by "sudo sysctl net.bridge.bridge-nf-call-iptables" which might be okay. error: sudo sysctl net.bridge.bridge-nf-call-iptables: Process exited with status 255

	stdout:

	stderr:

	sysctl: cannot stat /proc/sys/net/bridge/bridge-nf-call-iptables: No such file or directory

	I0417 18:52:00.125543   96006 ssh_runner.go:195] Run: sudo modprobe br_netfilter

	I0417 18:52:00.140258   96006 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0417 18:52:00.151232   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:52:00.284671   96006 ssh_runner.go:195] Run: sudo systemctl restart crio

	I0417 18:52:00.434033   96006 start.go:541] Will wait 60s for socket path /var/run/crio/crio.sock

	I0417 18:52:00.434122   96006 ssh_runner.go:195] Run: stat /var/run/crio/crio.sock

	I0417 18:52:00.439963   96006 start.go:562] Will wait 60s for crictl version

	I0417 18:52:00.440079   96006 ssh_runner.go:195] Run: which crictl

	I0417 18:52:00.444073   96006 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0417 18:52:00.487475   96006 start.go:578] Version:  0.1.0

	RuntimeName:  cri-o

	RuntimeVersion:  1.29.1

	RuntimeApiVersion:  v1

	I0417 18:52:00.487559   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:52:00.516105   96006 ssh_runner.go:195] Run: crio --version

	I0417 18:52:00.546634   96006 out.go:177] * Preparing Kubernetes v1.30.0-rc.2 on CRI-O 1.29.1 ...

	I0417 18:52:00.548096   96006 out.go:177]   - env NO_PROXY=192.168.39.159

	I0417 18:52:00.549484   96006 out.go:177]   - env NO_PROXY=192.168.39.159,192.168.39.236

	I0417 18:52:00.550999   96006 main.go:141] libmachine: (ha-467706-m03) Calling .GetIP

	I0417 18:52:00.553930   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:52:00.554200   96006 main.go:141] libmachine: (ha-467706-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:9e:a9", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:51:49 +0000 UTC Type:0 Mac:52:54:00:93:9e:a9 Iaid: IPaddr:192.168.39.250 Prefix:24 Hostname:ha-467706-m03 Clientid:01:52:54:00:93:9e:a9}

	I0417 18:52:00.554219   96006 main.go:141] libmachine: (ha-467706-m03) DBG | domain ha-467706-m03 has defined IP address 192.168.39.250 and MAC address 52:54:00:93:9e:a9 in network mk-ha-467706

	I0417 18:52:00.554407   96006 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0417 18:52:00.559384   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:52:00.573146   96006 mustload.go:65] Loading cluster: ha-467706

	I0417 18:52:00.573371   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:52:00.573651   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:52:00.573700   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:52:00.588993   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43305

	I0417 18:52:00.589529   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:52:00.590035   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:52:00.590058   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:52:00.590436   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:52:00.590616   96006 main.go:141] libmachine: (ha-467706) Calling .GetState

	I0417 18:52:00.592317   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:52:00.592729   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:52:00.592804   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:52:00.607728   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:32889

	I0417 18:52:00.608165   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:52:00.608719   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:52:00.608750   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:52:00.609117   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:52:00.609294   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:52:00.609463   96006 certs.go:68] Setting up /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706 for IP: 192.168.39.250

	I0417 18:52:00.609482   96006 certs.go:194] generating shared ca certs ...

	I0417 18:52:00.609497   96006 certs.go:226] acquiring lock for ca certs: {Name:mk03352eb76143f462405cfdf4da402444190b34 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:52:00.609655   96006 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key

	I0417 18:52:00.609709   96006 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key

	I0417 18:52:00.609724   96006 certs.go:256] generating profile certs ...

	I0417 18:52:00.609820   96006 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key

	I0417 18:52:00.609850   96006 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9

	I0417 18:52:00.609869   96006 crypto.go:68] Generating cert /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9 with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.159 192.168.39.236 192.168.39.250 192.168.39.254]

	I0417 18:52:00.749277   96006 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9 ...

	I0417 18:52:00.749320   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9: {Name:mk6143d78cf42a990aa606d474f97e8b4fd0619a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:52:00.749616   96006 crypto.go:164] Writing key to /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9 ...

	I0417 18:52:00.749648   96006 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9: {Name:mk3bb67b98f87c1d920beec47452d123a46411b4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0417 18:52:00.749762   96006 certs.go:381] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt.75a453e9 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt

	I0417 18:52:00.749897   96006 certs.go:385] copying /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key.75a453e9 -> /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key

	I0417 18:52:00.750025   96006 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key

	I0417 18:52:00.750042   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0417 18:52:00.750054   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0417 18:52:00.750068   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0417 18:52:00.750081   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0417 18:52:00.750098   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0417 18:52:00.750110   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0417 18:52:00.750122   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0417 18:52:00.750134   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0417 18:52:00.750185   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem (1338 bytes)

	W0417 18:52:00.750214   96006 certs.go:480] ignoring /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207_empty.pem, impossibly tiny 0 bytes

	I0417 18:52:00.750223   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca-key.pem (1679 bytes)

	I0417 18:52:00.750245   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/ca.pem (1078 bytes)

	I0417 18:52:00.750267   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/cert.pem (1123 bytes)

	I0417 18:52:00.750290   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/key.pem (1679 bytes)

	I0417 18:52:00.750324   96006 certs.go:484] found cert: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem (1708 bytes)

	I0417 18:52:00.750348   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:00.750362   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem -> /usr/share/ca-certificates/83207.pem

	I0417 18:52:00.750374   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem -> /usr/share/ca-certificates/832072.pem

	I0417 18:52:00.750409   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:52:00.753425   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:00.753882   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:52:00.753914   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:00.754091   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:52:00.754308   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:52:00.754433   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:52:00.754565   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:52:00.825222   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0417 18:52:00.830594   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0417 18:52:00.843572   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0417 18:52:00.848432   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1679 bytes)

	I0417 18:52:00.860990   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0417 18:52:00.868349   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0417 18:52:00.881489   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0417 18:52:00.886462   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0417 18:52:00.902096   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0417 18:52:00.907262   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0417 18:52:00.920906   96006 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0417 18:52:00.926468   96006 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1675 bytes)

	I0417 18:52:00.941097   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0417 18:52:00.969343   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0417 18:52:00.997366   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0417 18:52:01.024743   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1675 bytes)

	I0417 18:52:01.054703   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1444 bytes)

	I0417 18:52:01.082003   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0417 18:52:01.109194   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0417 18:52:01.136303   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0417 18:52:01.162022   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0417 18:52:01.187722   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/certs/83207.pem --> /usr/share/ca-certificates/83207.pem (1338 bytes)

	I0417 18:52:01.214107   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/files/etc/ssl/certs/832072.pem --> /usr/share/ca-certificates/832072.pem (1708 bytes)

	I0417 18:52:01.241348   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0417 18:52:01.261810   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1679 bytes)

	I0417 18:52:01.282278   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0417 18:52:01.301494   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0417 18:52:01.320460   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0417 18:52:01.339415   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1675 bytes)

	I0417 18:52:01.357976   96006 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (758 bytes)

	I0417 18:52:01.375690   96006 ssh_runner.go:195] Run: openssl version

	I0417 18:52:01.381609   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0417 18:52:01.392798   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:01.397733   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Apr 17 17:59 /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:01.397804   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0417 18:52:01.403864   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0417 18:52:01.415745   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/83207.pem && ln -fs /usr/share/ca-certificates/83207.pem /etc/ssl/certs/83207.pem"

	I0417 18:52:01.428109   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/83207.pem

	I0417 18:52:01.432877   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Apr 17 18:40 /usr/share/ca-certificates/83207.pem

	I0417 18:52:01.432941   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/83207.pem

	I0417 18:52:01.439267   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/83207.pem /etc/ssl/certs/51391683.0"

	I0417 18:52:01.450923   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/832072.pem && ln -fs /usr/share/ca-certificates/832072.pem /etc/ssl/certs/832072.pem"

	I0417 18:52:01.462324   96006 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/832072.pem

	I0417 18:52:01.467307   96006 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Apr 17 18:40 /usr/share/ca-certificates/832072.pem

	I0417 18:52:01.467382   96006 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/832072.pem

	I0417 18:52:01.473331   96006 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/832072.pem /etc/ssl/certs/3ec20f2e.0"

	I0417 18:52:01.484248   96006 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0417 18:52:01.488720   96006 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0417 18:52:01.488810   96006 kubeadm.go:928] updating node {m03 192.168.39.250 8443 v1.30.0-rc.2 crio true true} ...

	I0417 18:52:01.488925   96006 kubeadm.go:940] kubelet [Unit]

	Wants=crio.service

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-467706-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.250

	[Install]

	 config:

	{KubernetesVersion:v1.30.0-rc.2 ClusterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0417 18:52:01.488961   96006 kube-vip.go:111] generating kube-vip config ...

	I0417 18:52:01.489005   96006 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0417 18:52:01.505434   96006 kube-vip.go:163] auto-enabling control-plane load-balancing in kube-vip

	I0417 18:52:01.505511   96006 kube-vip.go:133] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.7.1

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0417 18:52:01.505571   96006 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:52:01.517039   96006 binaries.go:47] Didn't find k8s binaries: sudo ls /var/lib/minikube/binaries/v1.30.0-rc.2: Process exited with status 2

	stdout:

	stderr:

	ls: cannot access '/var/lib/minikube/binaries/v1.30.0-rc.2': No such file or directory

	Initiating transfer...

	I0417 18:52:01.517114   96006 ssh_runner.go:195] Run: sudo mkdir -p /var/lib/minikube/binaries/v1.30.0-rc.2

	I0417 18:52:01.528436   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubeadm.sha256

	I0417 18:52:01.528460   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubelet.sha256

	I0417 18:52:01.528473   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:52:01.528483   96006 binary.go:76] Not caching binary, using https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.30.0-rc.2/bin/linux/amd64/kubectl.sha256

	I0417 18:52:01.528495   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:52:01.528516   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:52:01.528548   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm

	I0417 18:52:01.528549   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl

	I0417 18:52:01.533531   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubectl': No such file or directory

	I0417 18:52:01.533565   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubectl --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl (51454104 bytes)

	I0417 18:52:01.556412   96006 vm_assets.go:163] NewFileAsset: /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet -> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:52:01.556557   96006 ssh_runner.go:195] Run: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet

	I0417 18:52:01.569927   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm': No such file or directory

	I0417 18:52:01.569973   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubeadm --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubeadm (50249880 bytes)

	I0417 18:52:01.615729   96006 ssh_runner.go:352] existence check for /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: stat -c "%!s(MISSING) %!y(MISSING)" /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/binaries/v1.30.0-rc.2/kubelet': No such file or directory

	I0417 18:52:01.615777   96006 ssh_runner.go:362] scp /home/jenkins/minikube-integration/18665-75973/.minikube/cache/linux/amd64/v1.30.0-rc.2/kubelet --> /var/lib/minikube/binaries/v1.30.0-rc.2/kubelet (100100024 bytes)

	I0417 18:52:02.505814   96006 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0417 18:52:02.516731   96006 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (318 bytes)

	I0417 18:52:02.537107   96006 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (357 bytes)

	I0417 18:52:02.555786   96006 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1346 bytes)

	I0417 18:52:02.574491   96006 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0417 18:52:02.580118   96006 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0417 18:52:02.594496   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:52:02.741413   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:52:02.761049   96006 host.go:66] Checking if "ha-467706" exists ...

	I0417 18:52:02.761373   96006 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_crio_integration/out/docker-machine-driver-kvm2

	I0417 18:52:02.761425   96006 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0417 18:52:02.776757   96006 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38773

	I0417 18:52:02.777305   96006 main.go:141] libmachine: () Calling .GetVersion

	I0417 18:52:02.777802   96006 main.go:141] libmachine: Using API Version  1

	I0417 18:52:02.777823   96006 main.go:141] libmachine: () Calling .SetConfigRaw

	I0417 18:52:02.778163   96006 main.go:141] libmachine: () Calling .GetMachineName

	I0417 18:52:02.778370   96006 main.go:141] libmachine: (ha-467706) Calling .DriverName

	I0417 18:52:02.778550   96006 start.go:316] joinCluster: &{Name:ha-467706 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18649/minikube-v1.33.0-1713236417-18649-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.43-1713236840-18649@sha256:c67dbc47b437ffe7d18f65acebd2213336466a75b1de10cec62939ffc450543e Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.0-rc.2 Cl

usterName:ha-467706 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.159 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.236 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:fals

e ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Di

sableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0417 18:52:02.778748   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm token create --print-join-command --ttl=0"

	I0417 18:52:02.778783   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHHostname

	I0417 18:52:02.781899   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:02.782379   96006 main.go:141] libmachine: (ha-467706) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:3b:c1:55", ip: ""} in network mk-ha-467706: {Iface:virbr1 ExpiryTime:2024-04-17 19:49:38 +0000 UTC Type:0 Mac:52:54:00:3b:c1:55 Iaid: IPaddr:192.168.39.159 Prefix:24 Hostname:ha-467706 Clientid:01:52:54:00:3b:c1:55}

	I0417 18:52:02.782406   96006 main.go:141] libmachine: (ha-467706) DBG | domain ha-467706 has defined IP address 192.168.39.159 and MAC address 52:54:00:3b:c1:55 in network mk-ha-467706

	I0417 18:52:02.782580   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHPort

	I0417 18:52:02.782768   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHKeyPath

	I0417 18:52:02.782986   96006 main.go:141] libmachine: (ha-467706) Calling .GetSSHUsername

	I0417 18:52:02.783174   96006 sshutil.go:53] new ssh client: &{IP:192.168.39.159 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/18665-75973/.minikube/machines/ha-467706/id_rsa Username:docker}

	I0417 18:52:02.957773   96006 start.go:342] trying to join control-plane node "m03" to cluster: &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:52:02.957846   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 1y032b.zfoaqppbodvod22o --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443"

	I0417 18:52:27.749596   96006 ssh_runner.go:235] Completed: /bin/bash -c "sudo env PATH="/var/lib/minikube/binaries/v1.30.0-rc.2:$PATH" kubeadm join control-plane.minikube.internal:8443 --token 1y032b.zfoaqppbodvod22o --discovery-token-ca-cert-hash sha256:48f645e13fdefadc8e826582d6403b190039751bc152ed40dae3f9a02a350767 --ignore-preflight-errors=all --cri-socket unix:///var/run/crio/crio.sock --node-name=ha-467706-m03 --control-plane --apiserver-advertise-address=192.168.39.250 --apiserver-bind-port=8443": (24.791722831s)

	I0417 18:52:27.749646   96006 ssh_runner.go:195] Run: /bin/bash -c "sudo systemctl daemon-reload && sudo systemctl enable kubelet && sudo systemctl start kubelet"

	I0417 18:52:28.385191   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig label --overwrite nodes ha-467706-m03 minikube.k8s.io/updated_at=2024_04_17T18_52_28_0700 minikube.k8s.io/version=v1.33.0-beta.0 minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3 minikube.k8s.io/name=ha-467706 minikube.k8s.io/primary=false

	I0417 18:52:28.504077   96006 ssh_runner.go:195] Run: sudo /var/lib/minikube/binaries/v1.30.0-rc.2/kubectl --kubeconfig=/var/lib/minikube/kubeconfig taint nodes ha-467706-m03 node-role.kubernetes.io/control-plane:NoSchedule-

	I0417 18:52:28.621348   96006 start.go:318] duration metric: took 25.842793494s to joinCluster

	I0417 18:52:28.621444   96006 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.250 Port:8443 KubernetesVersion:v1.30.0-rc.2 ContainerRuntime:crio ControlPlane:true Worker:true}

	I0417 18:52:28.623236   96006 out.go:177] * Verifying Kubernetes components...

	I0417 18:52:28.621761   96006 config.go:182] Loaded profile config "ha-467706": Driver=kvm2, ContainerRuntime=crio, KubernetesVersion=v1.30.0-rc.2

	I0417 18:52:28.624642   96006 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0417 18:52:28.898574   96006 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0417 18:52:28.923168   96006 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/18665-75973/kubeconfig

	I0417 18:52:28.923555   96006 kapi.go:59] client config for ha-467706: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.crt", KeyFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/profiles/ha-467706/client.key", CAFile:"/home/jenkins/minikube-integration/18665-75973/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(nil)

}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1c5e2a0), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0417 18:52:28.923651   96006 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.159:8443

	I0417 18:52:28.923966   96006 node_ready.go:35] waiting up to 6m0s for node "ha-467706-m03" to be "Ready" ...

	I0417 18:52:28.924090   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:28.924104   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:28.924115   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:28.924120   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:28.927651   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:29.424873   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:29.424902   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:29.424914   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:29.424921   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:29.428630   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:29.924950   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:29.924978   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:29.924989   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:29.924995   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:29.929352   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:30.424980   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:30.425005   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:30.425016   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:30.425021   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:30.433101   96006 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0417 18:52:30.924634   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:30.924655   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:30.924663   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:30.924666   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:30.929216   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:30.930081   96006 node_ready.go:53] node "ha-467706-m03" has status "Ready":"False"

	I0417 18:52:31.424251   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:31.424276   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:31.424287   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:31.424294   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:31.427884   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:31.925119   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:31.925141   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:31.925150   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:31.925153   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:31.929439   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:32.425059   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:32.425082   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:32.425090   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:32.425095   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:32.428735   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:32.925083   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:32.925105   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:32.925113   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:32.925117   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:32.928326   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:33.424762   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:33.424797   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:33.424806   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:33.424810   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:33.428416   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:33.429153   96006 node_ready.go:53] node "ha-467706-m03" has status "Ready":"False"

	I0417 18:52:33.924533   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:33.924556   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:33.924565   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:33.924569   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:33.928140   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:34.424439   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:34.424464   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:34.424472   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:34.424476   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:34.428193   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:34.925087   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:34.925111   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:34.925120   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:34.925125   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:34.928677   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:35.425172   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:35.425200   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:35.425210   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:35.425218   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:35.429160   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:35.429880   96006 node_ready.go:53] node "ha-467706-m03" has status "Ready":"False"

	I0417 18:52:35.925045   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:35.925069   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:35.925081   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:35.925086   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:35.929103   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.424535   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:36.424572   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.424584   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.424592   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.428304   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.925072   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:36.925098   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.925107   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.925112   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.929080   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.929865   96006 node_ready.go:49] node "ha-467706-m03" has status "Ready":"True"

	I0417 18:52:36.929899   96006 node_ready.go:38] duration metric: took 8.005907796s for node "ha-467706-m03" to be "Ready" ...

	I0417 18:52:36.929921   96006 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:52:36.930010   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:36.930023   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.930035   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.930040   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.936875   96006 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0417 18:52:36.943562   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.943658   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-56dz8

	I0417 18:52:36.943671   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.943682   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.943691   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.946981   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.947848   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:36.947865   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.947874   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.947877   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.951124   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.951882   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.951909   96006 pod_ready.go:81] duration metric: took 8.318595ms for pod "coredns-7db6d8ff4d-56dz8" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.951922   96006 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.952004   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-kcdqn

	I0417 18:52:36.952016   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.952025   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.952030   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.954946   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:36.956375   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:36.956391   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.956398   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.956402   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.960496   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:36.961176   96006 pod_ready.go:92] pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.961195   96006 pod_ready.go:81] duration metric: took 9.26631ms for pod "coredns-7db6d8ff4d-kcdqn" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.961204   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.961424   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706

	I0417 18:52:36.961444   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.961453   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.961460   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.964198   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:36.964962   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:36.964980   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.964990   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.964996   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.968568   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.969736   96006 pod_ready.go:92] pod "etcd-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.969755   96006 pod_ready.go:81] duration metric: took 8.543441ms for pod "etcd-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.969767   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.969836   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m02

	I0417 18:52:36.969846   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.969856   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.969864   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.973322   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:36.974022   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:36.974039   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:36.974049   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:36.974056   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:36.977049   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:36.977876   96006 pod_ready.go:92] pod "etcd-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:36.977893   96006 pod_ready.go:81] duration metric: took 8.118952ms for pod "etcd-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:36.977902   96006 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:37.125207   96006 request.go:629] Waited for 147.237578ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.125304   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.125317   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.125327   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.125335   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.129265   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:37.325969   96006 request.go:629] Waited for 195.91734ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.326062   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.326069   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.326081   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.326087   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.329735   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:37.525979   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.526008   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.526024   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.526030   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.530532   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:37.725519   96006 request.go:629] Waited for 194.121985ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.725593   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:37.725601   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.725612   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.725631   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.728991   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:37.978697   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:37.978723   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:37.978732   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:37.978736   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:37.982744   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.125959   96006 request.go:629] Waited for 142.267335ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.126016   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.126020   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.126028   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.126033   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.129065   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.478351   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:38.478382   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.478393   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.478400   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.482019   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.526015   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.526040   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.526053   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.526057   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.530125   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:38.979130   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:38.979167   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.979181   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.979191   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.983274   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:38.984058   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:38.984074   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:38.984082   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:38.984087   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:38.987121   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:38.987824   96006 pod_ready.go:102] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"False"

	I0417 18:52:39.478744   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:39.478767   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.478776   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.478780   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.482249   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:39.482930   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:39.482947   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.482955   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.482958   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.485711   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:39.978405   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:39.978428   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.978437   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.978441   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.983307   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:39.984232   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:39.984251   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:39.984260   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:39.984265   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:39.987576   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:40.478611   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:40.478635   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.478649   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.478654   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.482185   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:40.482957   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:40.482974   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.482982   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.482990   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.485806   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:40.978434   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:40.978458   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.978466   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.978470   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.982366   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:40.983312   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:40.983326   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:40.983334   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:40.983337   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:40.986184   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:41.478160   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:41.478186   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.478195   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.478205   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.482826   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:41.483571   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:41.483587   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.483597   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.483606   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.486864   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:41.487510   96006 pod_ready.go:102] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"False"

	I0417 18:52:41.978993   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:41.979015   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.979031   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.979035   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.982762   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:41.983777   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:41.983799   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:41.983811   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:41.983817   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:41.987561   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:42.478573   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:42.478599   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.478609   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.478623   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.482464   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:42.483352   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:42.483371   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.483379   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.483384   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.486473   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:42.978778   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:42.978800   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.978808   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.978812   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.982956   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:42.984208   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:42.984229   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:42.984240   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:42.984245   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:42.987545   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:43.479123   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:43.479160   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.479173   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.479178   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.482599   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:43.483500   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:43.483519   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.483529   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.483538   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.488219   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:43.488884   96006 pod_ready.go:102] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"False"

	I0417 18:52:43.978220   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:43.978245   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.978254   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.978258   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.982430   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:43.983082   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:43.983101   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:43.983111   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:43.983117   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:43.986478   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.478768   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/etcd-ha-467706-m03

	I0417 18:52:44.478792   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.478800   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.478805   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.482390   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.482993   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:44.483009   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.483017   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.483022   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.486288   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.486885   96006 pod_ready.go:92] pod "etcd-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.486907   96006 pod_ready.go:81] duration metric: took 7.508997494s for pod "etcd-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.486931   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.487003   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706

	I0417 18:52:44.487014   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.487024   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.487033   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.489839   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.490630   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:44.490648   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.490659   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.490666   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.493317   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.493787   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.493806   96006 pod_ready.go:81] duration metric: took 6.868213ms for pod "kube-apiserver-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.493815   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.493866   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m02

	I0417 18:52:44.493875   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.493881   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.493885   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.496618   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.497206   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:44.497221   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.497228   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.497232   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.499850   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.500328   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.500346   96006 pod_ready.go:81] duration metric: took 6.524042ms for pod "kube-apiserver-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.500354   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.500398   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-467706-m03

	I0417 18:52:44.500406   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.500413   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.500416   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.502820   96006 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0417 18:52:44.525635   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:44.525658   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.525668   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.525674   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.529459   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.529911   96006 pod_ready.go:92] pod "kube-apiserver-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.529931   96006 pod_ready.go:81] duration metric: took 29.571504ms for pod "kube-apiserver-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.529941   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.725298   96006 request.go:629] Waited for 195.288314ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706

	I0417 18:52:44.725379   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706

	I0417 18:52:44.725389   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.725400   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.725411   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.729804   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:44.925812   96006 request.go:629] Waited for 195.39534ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:44.925880   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:44.925888   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:44.925896   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:44.925913   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:44.929676   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:44.930553   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:44.930576   96006 pod_ready.go:81] duration metric: took 400.628962ms for pod "kube-controller-manager-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:44.930586   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.125857   96006 request.go:629] Waited for 195.191389ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m02

	I0417 18:52:45.125925   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m02

	I0417 18:52:45.125932   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.125942   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.125948   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.129306   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.325424   96006 request.go:629] Waited for 195.384898ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:45.325501   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:45.325507   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.325517   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.325525   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.329384   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.329913   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:45.329940   96006 pod_ready.go:81] duration metric: took 399.345281ms for pod "kube-controller-manager-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.329956   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.526037   96006 request.go:629] Waited for 195.983642ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m03

	I0417 18:52:45.526113   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-467706-m03

	I0417 18:52:45.526118   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.526125   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.526129   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.529953   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.725683   96006 request.go:629] Waited for 195.070685ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:45.725758   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:45.725766   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.725782   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.725790   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.729681   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:45.730371   96006 pod_ready.go:92] pod "kube-controller-manager-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:45.730395   96006 pod_ready.go:81] duration metric: took 400.429466ms for pod "kube-controller-manager-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.730409   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:45.925377   96006 request.go:629] Waited for 194.888012ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-hd469

	I0417 18:52:45.925484   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-hd469

	I0417 18:52:45.925490   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:45.925498   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:45.925505   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:45.929973   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:46.125654   96006 request.go:629] Waited for 194.431513ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:46.125734   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:46.125743   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.125755   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.125762   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.129903   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:46.130743   96006 pod_ready.go:92] pod "kube-proxy-hd469" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:46.130767   96006 pod_ready.go:81] duration metric: took 400.350111ms for pod "kube-proxy-hd469" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.130779   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-jlcq7" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.325821   96006 request.go:629] Waited for 194.963898ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-jlcq7

	I0417 18:52:46.325910   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-jlcq7

	I0417 18:52:46.325921   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.325931   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.325940   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.329752   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.526022   96006 request.go:629] Waited for 195.476053ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:46.526102   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:46.526108   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.526116   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.526121   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.529860   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.530884   96006 pod_ready.go:92] pod "kube-proxy-jlcq7" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:46.530902   96006 pod_ready.go:81] duration metric: took 400.117162ms for pod "kube-proxy-jlcq7" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.530913   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.726192   96006 request.go:629] Waited for 195.191733ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:52:46.726277   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-proxy-qxtf4

	I0417 18:52:46.726285   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.726295   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.726299   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.729763   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.925722   96006 request.go:629] Waited for 195.405879ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:46.925783   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:46.925788   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:46.925795   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:46.925803   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:46.929239   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:46.930056   96006 pod_ready.go:92] pod "kube-proxy-qxtf4" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:46.930085   96006 pod_ready.go:81] duration metric: took 399.165332ms for pod "kube-proxy-qxtf4" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:46.930101   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.126140   96006 request.go:629] Waited for 195.938622ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:52:47.126218   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706

	I0417 18:52:47.126224   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.126232   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.126237   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.129831   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:47.325630   96006 request.go:629] Waited for 195.196456ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:47.325703   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706

	I0417 18:52:47.325716   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.325735   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.325746   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.329278   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:47.330132   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:47.330153   96006 pod_ready.go:81] duration metric: took 400.03338ms for pod "kube-scheduler-ha-467706" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.330165   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.525201   96006 request.go:629] Waited for 194.96066ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:52:47.525294   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m02

	I0417 18:52:47.525304   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.525312   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.525316   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.528656   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:47.725569   96006 request.go:629] Waited for 196.155088ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:47.725626   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m02

	I0417 18:52:47.725631   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.725639   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.725643   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.730074   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:47.730804   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:47.730829   96006 pod_ready.go:81] duration metric: took 400.655349ms for pod "kube-scheduler-ha-467706-m02" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.730843   96006 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:47.925724   96006 request.go:629] Waited for 194.787766ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m03

	I0417 18:52:47.925810   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-467706-m03

	I0417 18:52:47.925822   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:47.925829   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:47.925834   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:47.929948   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:48.125180   96006 request.go:629] Waited for 194.303544ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:48.125265   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes/ha-467706-m03

	I0417 18:52:48.125271   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.125280   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.125285   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.128743   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:48.129451   96006 pod_ready.go:92] pod "kube-scheduler-ha-467706-m03" in "kube-system" namespace has status "Ready":"True"

	I0417 18:52:48.129480   96006 pod_ready.go:81] duration metric: took 398.623814ms for pod "kube-scheduler-ha-467706-m03" in "kube-system" namespace to be "Ready" ...

	I0417 18:52:48.129495   96006 pod_ready.go:38] duration metric: took 11.199554563s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0417 18:52:48.129516   96006 api_server.go:52] waiting for apiserver process to appear ...

	I0417 18:52:48.129583   96006 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0417 18:52:48.146310   96006 api_server.go:72] duration metric: took 19.524820593s to wait for apiserver process to appear ...

	I0417 18:52:48.146344   96006 api_server.go:88] waiting for apiserver healthz status ...

	I0417 18:52:48.146377   96006 api_server.go:253] Checking apiserver healthz at https://192.168.39.159:8443/healthz ...

	I0417 18:52:48.153650   96006 api_server.go:279] https://192.168.39.159:8443/healthz returned 200:

	ok

	I0417 18:52:48.153862   96006 round_trippers.go:463] GET https://192.168.39.159:8443/version

	I0417 18:52:48.153876   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.153888   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.153894   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.154829   96006 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0417 18:52:48.154892   96006 api_server.go:141] control plane version: v1.30.0-rc.2

	I0417 18:52:48.154905   96006 api_server.go:131] duration metric: took 8.55388ms to wait for apiserver health ...

	I0417 18:52:48.154914   96006 system_pods.go:43] waiting for kube-system pods to appear ...

	I0417 18:52:48.325249   96006 request.go:629] Waited for 170.263186ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.325330   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.325336   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.325353   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.325361   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.332685   96006 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0417 18:52:48.339789   96006 system_pods.go:59] 24 kube-system pods found

	I0417 18:52:48.339819   96006 system_pods.go:61] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:52:48.339823   96006 system_pods.go:61] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:52:48.339827   96006 system_pods.go:61] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:52:48.339830   96006 system_pods.go:61] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:52:48.339833   96006 system_pods.go:61] "etcd-ha-467706-m03" [a79f9120-9c62-465e-8e06-97337c1eecd9] Running

	I0417 18:52:48.339836   96006 system_pods.go:61] "kindnet-5mvhn" [1d1c6ddb-22cf-489e-8958-41434cbf8b0c] Running

	I0417 18:52:48.339839   96006 system_pods.go:61] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:52:48.339842   96006 system_pods.go:61] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:52:48.339844   96006 system_pods.go:61] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:52:48.339848   96006 system_pods.go:61] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:52:48.339850   96006 system_pods.go:61] "kube-apiserver-ha-467706-m03" [69a7a929-d717-4c2f-9cca-c067dcc7610d] Running

	I0417 18:52:48.339853   96006 system_pods.go:61] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:52:48.339856   96006 system_pods.go:61] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:52:48.339860   96006 system_pods.go:61] "kube-controller-manager-ha-467706-m03" [ae6eeeac-1ab7-4b22-8691-69d534d6d73e] Running

	I0417 18:52:48.339862   96006 system_pods.go:61] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:52:48.339865   96006 system_pods.go:61] "kube-proxy-jlcq7" [05590f74-8ea6-42ef-9d72-33e15cfd3a32] Running

	I0417 18:52:48.339868   96006 system_pods.go:61] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:52:48.339870   96006 system_pods.go:61] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:52:48.339873   96006 system_pods.go:61] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:52:48.339876   96006 system_pods.go:61] "kube-scheduler-ha-467706-m03" [94c0d749-a1da-468b-baee-25f5177376e5] Running

	I0417 18:52:48.339878   96006 system_pods.go:61] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:52:48.339881   96006 system_pods.go:61] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:52:48.339884   96006 system_pods.go:61] "kube-vip-ha-467706-m03" [75d15d4b-ed49-4d98-aecd-713bead1e281] Running

	I0417 18:52:48.339887   96006 system_pods.go:61] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:52:48.339894   96006 system_pods.go:74] duration metric: took 184.973208ms to wait for pod list to return data ...

	I0417 18:52:48.339904   96006 default_sa.go:34] waiting for default service account to be created ...

	I0417 18:52:48.525253   96006 request.go:629] Waited for 185.260041ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:52:48.525328   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/default/serviceaccounts

	I0417 18:52:48.525334   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.525343   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.525347   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.529005   96006 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0417 18:52:48.529165   96006 default_sa.go:45] found service account: "default"

	I0417 18:52:48.529185   96006 default_sa.go:55] duration metric: took 189.273406ms for default service account to be created ...

	I0417 18:52:48.529198   96006 system_pods.go:116] waiting for k8s-apps to be running ...

	I0417 18:52:48.725658   96006 request.go:629] Waited for 196.383891ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.725738   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/namespaces/kube-system/pods

	I0417 18:52:48.725744   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.725752   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.725757   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.732978   96006 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0417 18:52:48.738859   96006 system_pods.go:86] 24 kube-system pods found

	I0417 18:52:48.738891   96006 system_pods.go:89] "coredns-7db6d8ff4d-56dz8" [242dc56e-69d4-4742-8c4a-26b465f94153] Running

	I0417 18:52:48.738897   96006 system_pods.go:89] "coredns-7db6d8ff4d-kcdqn" [5353b60b-c7db-4eac-b0e9-915a8df02ae6] Running

	I0417 18:52:48.738902   96006 system_pods.go:89] "etcd-ha-467706" [500bd5cb-de50-4277-8098-f412bc51408d] Running

	I0417 18:52:48.738906   96006 system_pods.go:89] "etcd-ha-467706-m02" [e5e98e5e-1530-406c-96cc-7f2c8a7fabba] Running

	I0417 18:52:48.738910   96006 system_pods.go:89] "etcd-ha-467706-m03" [a79f9120-9c62-465e-8e06-97337c1eecd9] Running

	I0417 18:52:48.738914   96006 system_pods.go:89] "kindnet-5mvhn" [1d1c6ddb-22cf-489e-8958-41434cbf8b0c] Running

	I0417 18:52:48.738918   96006 system_pods.go:89] "kindnet-hspjv" [5ccc61fa-7766-431c-9f06-4fdfe455f551] Running

	I0417 18:52:48.738922   96006 system_pods.go:89] "kindnet-k6b9s" [a5bb2604-19fa-40f0-aaad-43ebf30e0cbb] Running

	I0417 18:52:48.738927   96006 system_pods.go:89] "kube-apiserver-ha-467706" [abcc8e4d-65cb-4284-a5c3-959035327f06] Running

	I0417 18:52:48.738931   96006 system_pods.go:89] "kube-apiserver-ha-467706-m02" [a011e338-074d-4af2-81b2-c3075782bc95] Running

	I0417 18:52:48.738935   96006 system_pods.go:89] "kube-apiserver-ha-467706-m03" [69a7a929-d717-4c2f-9cca-c067dcc7610d] Running

	I0417 18:52:48.738939   96006 system_pods.go:89] "kube-controller-manager-ha-467706" [27890bb6-f74a-4577-8815-deb93497a69c] Running

	I0417 18:52:48.738943   96006 system_pods.go:89] "kube-controller-manager-ha-467706-m02" [abca2329-458d-45ec-b95b-ba181216bc46] Running

	I0417 18:52:48.738948   96006 system_pods.go:89] "kube-controller-manager-ha-467706-m03" [ae6eeeac-1ab7-4b22-8691-69d534d6d73e] Running

	I0417 18:52:48.738954   96006 system_pods.go:89] "kube-proxy-hd469" [ec70213c-82da-44af-a5ef-34157c4edc01] Running

	I0417 18:52:48.738958   96006 system_pods.go:89] "kube-proxy-jlcq7" [05590f74-8ea6-42ef-9d72-33e15cfd3a32] Running

	I0417 18:52:48.738965   96006 system_pods.go:89] "kube-proxy-qxtf4" [a28fd6ef-279c-49be-9282-4a6c7083c601] Running

	I0417 18:52:48.738969   96006 system_pods.go:89] "kube-scheduler-ha-467706" [682de84e-f6f1-4962-98c1-708fc1bcb473] Running

	I0417 18:52:48.738975   96006 system_pods.go:89] "kube-scheduler-ha-467706-m02" [c254711d-76f7-42b5-b8cc-4f31c91d1bae] Running

	I0417 18:52:48.738980   96006 system_pods.go:89] "kube-scheduler-ha-467706-m03" [94c0d749-a1da-468b-baee-25f5177376e5] Running

	I0417 18:52:48.738992   96006 system_pods.go:89] "kube-vip-ha-467706" [b92af6a0-34f7-4bdb-b0c3-e2821f4e693c] Running

	I0417 18:52:48.738995   96006 system_pods.go:89] "kube-vip-ha-467706-m02" [9285fce9-715f-46ab-9171-41ae5065ea13] Running

	I0417 18:52:48.738999   96006 system_pods.go:89] "kube-vip-ha-467706-m03" [75d15d4b-ed49-4d98-aecd-713bead1e281] Running

	I0417 18:52:48.739002   96006 system_pods.go:89] "storage-provisioner" [b5a737ba-33c0-4c0d-ab14-fe98f2c6e903] Running

	I0417 18:52:48.739011   96006 system_pods.go:126] duration metric: took 209.807818ms to wait for k8s-apps to be running ...

	I0417 18:52:48.739021   96006 system_svc.go:44] waiting for kubelet service to be running ....

	I0417 18:52:48.739068   96006 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0417 18:52:48.758130   96006 system_svc.go:56] duration metric: took 19.098207ms WaitForService to wait for kubelet

	I0417 18:52:48.758166   96006 kubeadm.go:576] duration metric: took 20.136683772s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0417 18:52:48.758192   96006 node_conditions.go:102] verifying NodePressure condition ...

	I0417 18:52:48.925633   96006 request.go:629] Waited for 167.350815ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.159:8443/api/v1/nodes

	I0417 18:52:48.925711   96006 round_trippers.go:463] GET https://192.168.39.159:8443/api/v1/nodes

	I0417 18:52:48.925717   96006 round_trippers.go:469] Request Headers:

	I0417 18:52:48.925740   96006 round_trippers.go:473]     Accept: application/json, */*

	I0417 18:52:48.925762   96006 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0417 18:52:48.930050   96006 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0417 18:52:48.931223   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:52:48.931267   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:52:48.931278   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:52:48.931282   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:52:48.931285   96006 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0417 18:52:48.931288   96006 node_conditions.go:123] node cpu capacity is 2

	I0417 18:52:48.931292   96006 node_conditions.go:105] duration metric: took 173.095338ms to run NodePressure ...

	I0417 18:52:48.931304   96006 start.go:240] waiting for startup goroutines ...

	I0417 18:52:48.931341   96006 start.go:254] writing updated cluster config ...

	I0417 18:52:48.931624   96006 ssh_runner.go:195] Run: rm -f paused

	I0417 18:52:48.985138   96006 start.go:600] kubectl: 1.29.4, cluster: 1.30.0-rc.2 (minor skew: 1)

	I0417 18:52:48.987244   96006 out.go:177] * Done! kubectl is now configured to use "ha-467706" cluster and "default" namespace by default

	==> CRI-O <==

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.835474628Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380231835447498,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=0aee9d16-b47a-4156-90bc-d8323303e95d name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.836217191Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=e715a508-9313-4677-8c37-4fe93a229753 name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.836277932Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=e715a508-9313-4677-8c37-4fe93a229753 name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.836612188Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=e715a508-9313-4677-8c37-4fe93a229753 name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.882179328Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=5ebd7ad5-daed-40e9-9ef0-7bbe75339f86 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.882548972Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=5ebd7ad5-daed-40e9-9ef0-7bbe75339f86 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.883904074Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=c55dcb4e-3136-4752-91bb-9234fd7c13b0 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.884414686Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380231884392733,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=c55dcb4e-3136-4752-91bb-9234fd7c13b0 name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.884989814Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=adb6094d-6037-45a8-b11e-b0a88d1c06af name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.885047060Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=adb6094d-6037-45a8-b11e-b0a88d1c06af name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.885500648Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=adb6094d-6037-45a8-b11e-b0a88d1c06af name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.936499040Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=ad92cf9a-2129-4490-a20f-5aebf05b303a name=/runtime.v1.RuntimeService/Version

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.936635845Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=ad92cf9a-2129-4490-a20f-5aebf05b303a name=/runtime.v1.RuntimeService/Version

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.944964709Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=e50aaadd-0775-4da7-a1db-0da141d4255b name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.945882460Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380231945852980,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=e50aaadd-0775-4da7-a1db-0da141d4255b name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.946514023Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=304178ba-5bd7-498c-9869-dc22a4840fad name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.946566095Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=304178ba-5bd7-498c-9869-dc22a4840fad name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.946838076Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=304178ba-5bd7-498c-9869-dc22a4840fad name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.988508451Z" level=debug msg="Request: &VersionRequest{Version:,}" file="otel-collector/interceptors.go:62" id=21cda65a-5ddc-4faf-bd7c-7e3f432bbf26 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.988692693Z" level=debug msg="Response: &VersionResponse{Version:0.1.0,RuntimeName:cri-o,RuntimeVersion:1.29.1,RuntimeApiVersion:v1,}" file="otel-collector/interceptors.go:74" id=21cda65a-5ddc-4faf-bd7c-7e3f432bbf26 name=/runtime.v1.RuntimeService/Version

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.990780182Z" level=debug msg="Request: &ImageFsInfoRequest{}" file="otel-collector/interceptors.go:62" id=bedc3867-5dd2-4ac8-9b65-136ec6c39ccd name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.991699739Z" level=debug msg="Response: &ImageFsInfoResponse{ImageFilesystems:[]*FilesystemUsage{&FilesystemUsage{Timestamp:1713380231991671613,FsId:&FilesystemIdentifier{Mountpoint:/var/lib/containers/storage/overlay-images,},UsedBytes:&UInt64Value{Value:144997,},InodesUsed:&UInt64Value{Value:67,},},},ContainerFilesystems:[]*FilesystemUsage{},}" file="otel-collector/interceptors.go:74" id=bedc3867-5dd2-4ac8-9b65-136ec6c39ccd name=/runtime.v1.ImageService/ImageFsInfo

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.992941532Z" level=debug msg="Request: &ListContainersRequest{Filter:&ContainerFilter{Id:,State:nil,PodSandboxId:,LabelSelector:map[string]string{},},}" file="otel-collector/interceptors.go:62" id=5e8678ae-fec9-4c40-9abb-a06c0e405f8d name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.992994436Z" level=debug msg="No filters were applied, returning full container list" file="server/container_list.go:60" id=5e8678ae-fec9-4c40-9abb-a06c0e405f8d name=/runtime.v1.RuntimeService/ListContainers

	Apr 17 18:57:11 ha-467706 crio[683]: time="2024-04-17 18:57:11.993590096Z" level=debug msg="Response: &ListContainersResponse{Containers:[]*Container{&Container{Id:93e18e5085cb7dd6c95fb8bf1229f0c45008cce304c1ead3cea2d6da36b66d51,PodSandboxId:1b57101a3681c5db6b4f34a77455f6f491097dd29c13b5296d6610accd0b65c9,Metadata:&ContainerMetadata{Name:busybox,Attempt:0,},Image:&ImageSpec{Image:gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:8c811b4aec35f259572d0f79207bc0678df4c736eeec50bc9fec37ed936a472a,State:CONTAINER_RUNNING,CreatedAt:1713379972464206680,Labels:map[string]string{io.kubernetes.container.name: busybox,io.kubernetes.pod.name: busybox-fc5497c4f-r65s7,io.kubernetes.pod.namespace: default,io.kubernetes.pod.uid: a14d0b32-aa41-4396-a2f7-643e8e32d96d,},Annotations:map[string]string{io.kubernetes.container.hash: 8d68b365,io.kubernetes.container.restartCount: 0,io.kubernetes.c

ontainer.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:23e69dba1da3a09443417dec6b066eff9a59f12bf747e8bd9782ec63c0141f6b,PodSandboxId:b3b3a885a73fc4348ee424eaec1dcb1583e0e30d6740438d7a49ba9665fd8bfa,Metadata:&ContainerMetadata{Name:storage-provisioner,Attempt:0,},Image:&ImageSpec{Image:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562,State:CONTAINER_RUNNING,CreatedAt:1713379820308051209,Labels:map[string]string{io.kubernetes.container.name: storage-provisioner,io.kubernetes.pod.name: storage-provisioner,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: b5a737ba-33c0-4c0d-ab14-fe98f2c6e903,},Annotations:map[string]string{io.kubernetes.container.hash: a7546df6,io.kubernetes.container.restartCount: 0,io.kubernetes.container.ter

minationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230,PodSandboxId:2887673f339d8aca82e90272f06ce0c4744ef4ec4b48d38aff27b25d5ec1db35,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820245176087,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-56dz8,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 242dc56e-69d4-4742-8c4a-26b465f94153,},Annotations:map[string]string{io.kubernetes.container.hash: d376a5ac,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"na

me\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0,PodSandboxId:0836a6cd9f827b7b8d4555cf10ba3a53dddaed91a13975d989668b12a77de7b7,Metadata:&ContainerMetadata{Name:coredns,Attempt:0,},Image:&ImageSpec{Image:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4,State:CONTAINER_RUNNING,CreatedAt:1713379820252193082,Labels:map[string]string{io.kubernetes.container.name: coredns,io.kubernetes.pod.name: coredns-7db6d8ff4d-kcdqn,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5353b60b-c7

db-4eac-b0e9-915a8df02ae6,},Annotations:map[string]string{io.kubernetes.container.hash: e7e6a88e,io.kubernetes.container.ports: [{\"name\":\"dns\",\"containerPort\":53,\"protocol\":\"UDP\"},{\"name\":\"dns-tcp\",\"containerPort\":53,\"protocol\":\"TCP\"},{\"name\":\"metrics\",\"containerPort\":9153,\"protocol\":\"TCP\"}],io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d,PodSandboxId:a4a14e5274f052a23b3343825e9cd999cca173c2d5c9157ca3dadbb01c59e890,Metadata:&ContainerMetadata{Name:kindnet-cni,Attempt:0,},Image:&ImageSpec{Image:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5,State:CONTAINER_RUNNING,CreatedAt:17133798

18001748637,Labels:map[string]string{io.kubernetes.container.name: kindnet-cni,io.kubernetes.pod.name: kindnet-hspjv,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5ccc61fa-7766-431c-9f06-4fdfe455f551,},Annotations:map[string]string{io.kubernetes.container.hash: 56bcb65c,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1,PodSandboxId:269ac099b43b4bbb9fbc405722fbbab237ab54aeef7290fe4b9e366401a294a4,Metadata:&ContainerMetadata{Name:kube-proxy,Attempt:0,},Image:&ImageSpec{Image:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e,State:CONTAINER_RUNNING,CreatedAt:1713379817830885641,Labels:map[string]strin

g{io.kubernetes.container.name: kube-proxy,io.kubernetes.pod.name: kube-proxy-hd469,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: ec70213c-82da-44af-a5ef-34157c4edc01,},Annotations:map[string]string{io.kubernetes.container.hash: 936f368f,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:c2e7dc14e0398eb1a0fbe87ca0f8fc81d718a21d9d41e0f03029cf8ce888af8b,PodSandboxId:209f90ed9f3f5331a9d6a950ad6f8fd78700123b0eec63defd46bd082ae3b1da,Metadata:&ContainerMetadata{Name:kube-vip,Attempt:0,},Image:&ImageSpec{Image:ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:22aaebb38f4a9f54562fab7b3a59b206e32f59a368c5749c96d06f5a1c187dba,State:CONTAINER_RUNNING,CreatedAt:1713379801424337361,Labels:map[string]string{

io.kubernetes.container.name: kube-vip,io.kubernetes.pod.name: kube-vip-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 1d73414bb22a378bd54afe8a51fdffd5,},Annotations:map[string]string{io.kubernetes.container.hash: d7e5eb98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04,PodSandboxId:167b41d6ec7a7d2bd6a7a061a387fae932d17ae93a2969023dc60b85a3f84a9e,Metadata:&ContainerMetadata{Name:etcd,Attempt:0,},Image:&ImageSpec{Image:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899,State:CONTAINER_RUNNING,CreatedAt:1713379798099381628,Labels:map[string]string{io.kubernetes.container.name: etcd,io.kuber

netes.pod.name: etcd-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 5533a84d7b0b75b280465dc195066a47,},Annotations:map[string]string{io.kubernetes.container.hash: 6a2bdf98,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f,PodSandboxId:2d8b6f55b0eabcbd40b5315040c12b666ddb8ded0194ab9a6bd643bec96f6430,Metadata:&ContainerMetadata{Name:kube-apiserver,Attempt:0,},Image:&ImageSpec{Image:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1,State:CONTAINER_RUNNING,CreatedAt:1713379798071709810,Labels:map[string]string{io.kubernetes.container.name: kube-apiserver,io.kubernetes.pod.name: kube-apiserver-

ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 45523f78a5229d0b08cb428fcaedfed0,},Annotations:map[string]string{io.kubernetes.container.hash: 91cb0593,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e,PodSandboxId:844fdf54706b9d0da9d8977d1435d0d8891e140577322d205e1b5767397fcf4f,Metadata:&ContainerMetadata{Name:kube-controller-manager,Attempt:0,},Image:&ImageSpec{Image:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b,State:CONTAINER_RUNNING,CreatedAt:1713379798054701454,Labels:map[string]string{io.kubernetes.container.name: kube-controller-manager,io.kubernetes.pod.name: kube-controller-ma

nager-ha-467706,io.kubernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: c507e54022f894ce12e7854719296d07,},Annotations:map[string]string{io.kubernetes.container.hash: c80ec39b,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},&Container{Id:7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c,PodSandboxId:18f84a94ee364210a00aec2b2b51f0bb97230343abc962600ecf0e9b19dc4a08,Metadata:&ContainerMetadata{Name:kube-scheduler,Attempt:0,},Image:&ImageSpec{Image:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,Annotations:map[string]string{},UserSpecifiedImage:,RuntimeHandler:,},ImageRef:461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6,State:CONTAINER_RUNNING,CreatedAt:1713379797955002026,Labels:map[string]string{io.kubernetes.container.name: kube-scheduler,io.kubernetes.pod.name: kube-scheduler-ha-467706,io.ku

bernetes.pod.namespace: kube-system,io.kubernetes.pod.uid: 771847de86593b1b57b1c5e8f0129c24,},Annotations:map[string]string{io.kubernetes.container.hash: 1e34585d,io.kubernetes.container.restartCount: 0,io.kubernetes.container.terminationMessagePath: /dev/termination-log,io.kubernetes.container.terminationMessagePolicy: File,io.kubernetes.pod.terminationGracePeriod: 30,},},},}" file="otel-collector/interceptors.go:74" id=5e8678ae-fec9-4c40-9abb-a06c0e405f8d name=/runtime.v1.RuntimeService/ListContainers

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	93e18e5085cb7       gcr.io/k8s-minikube/busybox@sha256:74f634b1bc1bd74535d5209589734efbd44a25f4e2dc96d78784576a3eb5b335   4 minutes ago       Running             busybox                   0                   1b57101a3681c       busybox-fc5497c4f-r65s7

	23e69dba1da3a       6e38f40d628db3002f5617342c8872c935de530d867d0f709a2fbda1a302a562                                      6 minutes ago       Running             storage-provisioner       0                   b3b3a885a73fc       storage-provisioner

	143bf06c19825       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   0836a6cd9f827       coredns-7db6d8ff4d-kcdqn

	56dd0755cda79       cbb01a7bd410dc08ba382018ab909a674fb0e48687f0c00797ed5bc34fcc6bb4                                      6 minutes ago       Running             coredns                   0                   2887673f339d8       coredns-7db6d8ff4d-56dz8

	2f2ed526ef2f9       4950bb10b3f87e8d4a8f772a0d8934625cac4ccfa3675fea34cad0dab83fd5a5                                      6 minutes ago       Running             kindnet-cni               0                   a4a14e5274f05       kindnet-hspjv

	fe8aab67cc372       35c7fe5cdbee52250b1e2b15640a06c8ebff60dbc795a7701deb6309be51431e                                      6 minutes ago       Running             kube-proxy                0                   269ac099b43b4       kube-proxy-hd469

	c2e7dc14e0398       ghcr.io/kube-vip/kube-vip@sha256:58ce44dc60694b0aa547d87d4a8337133961d3a8538021a672ba9bd33b267c9a     7 minutes ago       Running             kube-vip                  0                   209f90ed9f3f5       kube-vip-ha-467706

	0b4b6b19cdcea       3861cfcd7c04ccac1f062788eca39487248527ef0c0cfd477a83d7691a75a899                                      7 minutes ago       Running             etcd                      0                   167b41d6ec7a7       etcd-ha-467706

	d1e96d91894cf       65a750108e0b64670c3a9f33978b6a33b0d5cdaca85158e0c637c5a4e84539c1                                      7 minutes ago       Running             kube-apiserver            0                   2d8b6f55b0eab       kube-apiserver-ha-467706

	644754e2725b2       ae2ef7918948cfa32fb3b9cba56f6140b9e23022b7ed81960e2e83a14990532b                                      7 minutes ago       Running             kube-controller-manager   0                   844fdf54706b9       kube-controller-manager-ha-467706

	7f539c70ed4df       461015b94df4b9e0beae6963e44faa05142f2bddf16b1956a2c09ccefe0416a6                                      7 minutes ago       Running             kube-scheduler            0                   18f84a94ee364       kube-scheduler-ha-467706

	==> coredns [143bf06c19825476d6acaa493d723f11171a9d80e30f41df764ec674a91fa2e0] <==

	[INFO] 10.244.2.2:44486 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000369814s

	[INFO] 10.244.2.2:33799 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000190447s

	[INFO] 10.244.0.4:52709 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000115254s

	[INFO] 10.244.0.4:45280 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00018129s

	[INFO] 10.244.0.4:55894 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001481686s

	[INFO] 10.244.0.4:41971 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000086394s

	[INFO] 10.244.1.2:45052 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000204533s

	[INFO] 10.244.1.2:56976 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00191173s

	[INFO] 10.244.1.2:48269 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000205618s

	[INFO] 10.244.1.2:41050 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000145556s

	[INFO] 10.244.1.2:40399 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001367129s

	[INFO] 10.244.1.2:34908 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.00024876s

	[INFO] 10.244.1.2:33490 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000115098s

	[INFO] 10.244.1.2:43721 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000162828s

	[INFO] 10.244.2.2:52076 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000338786s

	[INFO] 10.244.0.4:58146 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000084273s

	[INFO] 10.244.0.4:46620 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00011163s

	[INFO] 10.244.1.2:55749 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000161622s

	[INFO] 10.244.1.2:50475 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000112723s

	[INFO] 10.244.2.2:58296 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000123831s

	[INFO] 10.244.2.2:42756 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000149112s

	[INFO] 10.244.2.2:44779 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000135979s

	[INFO] 10.244.0.4:32859 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000254227s

	[INFO] 10.244.0.4:39694 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000091483s

	[INFO] 10.244.1.2:48582 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000162571s

	==> coredns [56dd0755cda797074d46524da56506fc00c27c0d63758fdaf9a1ad7c92eff230] <==

	[INFO] 10.244.1.2:40690 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000216989s

	[INFO] 10.244.1.2:51761 - 5 "PTR IN 148.40.75.147.in-addr.arpa. udp 44 false 512" NXDOMAIN qr,rd,ra 44 0.001998901s

	[INFO] 10.244.2.2:55936 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000277709s

	[INFO] 10.244.2.2:59321 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.021403442s

	[INFO] 10.244.2.2:33112 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000361777s

	[INFO] 10.244.2.2:44063 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.012356307s

	[INFO] 10.244.2.2:52058 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000226126s

	[INFO] 10.244.2.2:45346 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000192986s

	[INFO] 10.244.0.4:42980 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001884522s

	[INFO] 10.244.0.4:33643 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000177169s

	[INFO] 10.244.0.4:55640 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000105826s

	[INFO] 10.244.0.4:54019 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000112453s

	[INFO] 10.244.2.2:41133 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000144651s

	[INFO] 10.244.2.2:59362 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000099749s

	[INFO] 10.244.2.2:32859 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000102166s

	[INFO] 10.244.0.4:33356 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000105006s

	[INFO] 10.244.0.4:56803 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000133644s

	[INFO] 10.244.1.2:34244 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000104241s

	[INFO] 10.244.1.2:43628 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000148576s

	[INFO] 10.244.2.2:50718 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000190649s

	[INFO] 10.244.0.4:44677 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.00013354s

	[INFO] 10.244.0.4:45227 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000159231s

	[INFO] 10.244.1.2:46121 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135561s

	[INFO] 10.244.1.2:43459 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000116038s

	[INFO] 10.244.1.2:34953 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000088316s

	==> describe nodes <==

	Name:               ha-467706

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_04_17T18_50_05_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:50:01 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:57:02 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:00 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:00 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:00 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 17 Apr 2024 18:53:08 +0000   Wed, 17 Apr 2024 18:50:19 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.159

	  Hostname:    ha-467706

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 3208cc9eadd3453fab86398575c87f4f

	  System UUID:                3208cc9e-add3-453f-ab86-398575c87f4f

	  Boot ID:                    142d9103-8e77-48a0-a260-5d3c6e2e5842

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-r65s7              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m23s

	  kube-system                 coredns-7db6d8ff4d-56dz8             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m55s

	  kube-system                 coredns-7db6d8ff4d-kcdqn             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     6m55s

	  kube-system                 etcd-ha-467706                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         7m8s

	  kube-system                 kindnet-hspjv                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m56s

	  kube-system                 kube-apiserver-ha-467706             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m8s

	  kube-system                 kube-controller-manager-ha-467706    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m8s

	  kube-system                 kube-proxy-hd469                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m56s

	  kube-system                 kube-scheduler-ha-467706             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m9s

	  kube-system                 kube-vip-ha-467706                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         7m10s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m54s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age    From             Message

	  ----    ------                   ----   ----             -------

	  Normal  Starting                 6m54s  kube-proxy       

	  Normal  Starting                 7m8s   kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  7m8s   kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  7m8s   kubelet          Node ha-467706 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    7m8s   kubelet          Node ha-467706 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     7m8s   kubelet          Node ha-467706 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           6m56s  node-controller  Node ha-467706 event: Registered Node ha-467706 in Controller

	  Normal  NodeReady                6m53s  kubelet          Node ha-467706 status is now: NodeReady

	  Normal  RegisteredNode           5m43s  node-controller  Node ha-467706 event: Registered Node ha-467706 in Controller

	  Normal  RegisteredNode           4m29s  node-controller  Node ha-467706 event: Registered Node ha-467706 in Controller

	Name:               ha-467706-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_17T18_51_14_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:51:11 +0000

	Taints:             node.kubernetes.io/unreachable:NoExecute

	                    node.kubernetes.io/unreachable:NoSchedule

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706-m02

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:53:56 +0000

	Conditions:

	  Type             Status    LastHeartbeatTime                 LastTransitionTime                Reason              Message

	  ----             ------    -----------------                 ------------------                ------              -------

	  MemoryPressure   Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  DiskPressure     Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  PIDPressure      Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	  Ready            Unknown   Wed, 17 Apr 2024 18:53:14 +0000   Wed, 17 Apr 2024 18:54:38 +0000   NodeStatusUnknown   Kubelet stopped posting node status.

	Addresses:

	  InternalIP:  192.168.39.236

	  Hostname:    ha-467706-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 f49a89e0b0d7432fa507fd1ad108778d

	  System UUID:                f49a89e0-b0d7-432f-a507-fd1ad108778d

	  Boot ID:                    a312ddbf-6416-4cd3-b83f-4a865cbb9daf

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-xg855                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m23s

	  kube-system                 etcd-ha-467706-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         5m59s

	  kube-system                 kindnet-k6b9s                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      6m1s

	  kube-system                 kube-apiserver-ha-467706-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m59s

	  kube-system                 kube-controller-manager-ha-467706-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m55s

	  kube-system                 kube-proxy-qxtf4                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         6m1s

	  kube-system                 kube-scheduler-ha-467706-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m59s

	  kube-system                 kube-vip-ha-467706-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         5m56s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                  From             Message

	  ----    ------                   ----                 ----             -------

	  Normal  Starting                 5m56s                kube-proxy       

	  Normal  NodeHasSufficientMemory  6m1s (x8 over 6m1s)  kubelet          Node ha-467706-m02 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    6m1s (x8 over 6m1s)  kubelet          Node ha-467706-m02 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     6m1s (x7 over 6m1s)  kubelet          Node ha-467706-m02 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  6m1s                 kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           5m56s                node-controller  Node ha-467706-m02 event: Registered Node ha-467706-m02 in Controller

	  Normal  RegisteredNode           5m43s                node-controller  Node ha-467706-m02 event: Registered Node ha-467706-m02 in Controller

	  Normal  RegisteredNode           4m29s                node-controller  Node ha-467706-m02 event: Registered Node ha-467706-m02 in Controller

	  Normal  NodeNotReady             2m33s                node-controller  Node ha-467706-m02 status is now: NodeNotReady

	Name:               ha-467706-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_17T18_52_28_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:52:25 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706-m03

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:57:12 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:25 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:25 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:25 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 17 Apr 2024 18:52:55 +0000   Wed, 17 Apr 2024 18:52:36 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.250

	  Hostname:    ha-467706-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 6f9c357ef5b24ca6b2e9c8c989ff32f8

	  System UUID:                6f9c357e-f5b2-4ca6-b2e9-c8c989ff32f8

	  Boot ID:                    920b7140-01bb-49d7-ab98-44319db0cc1f

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-gzsn2                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m23s

	  kube-system                 etcd-ha-467706-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         4m45s

	  kube-system                 kindnet-5mvhn                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      4m47s

	  kube-system                 kube-apiserver-ha-467706-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m45s

	  kube-system                 kube-controller-manager-ha-467706-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m39s

	  kube-system                 kube-proxy-jlcq7                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m47s

	  kube-system                 kube-scheduler-ha-467706-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m45s

	  kube-system                 kube-vip-ha-467706-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         4m42s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 4m42s                  kube-proxy       

	  Normal  NodeHasSufficientMemory  4m47s (x8 over 4m47s)  kubelet          Node ha-467706-m03 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    4m47s (x8 over 4m47s)  kubelet          Node ha-467706-m03 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     4m47s (x7 over 4m47s)  kubelet          Node ha-467706-m03 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  4m47s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           4m46s                  node-controller  Node ha-467706-m03 event: Registered Node ha-467706-m03 in Controller

	  Normal  RegisteredNode           4m43s                  node-controller  Node ha-467706-m03 event: Registered Node ha-467706-m03 in Controller

	  Normal  RegisteredNode           4m29s                  node-controller  Node ha-467706-m03 event: Registered Node ha-467706-m03 in Controller

	Name:               ha-467706-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-467706-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=6017d247dc519df02225d261a1d9173619e922e3

	                    minikube.k8s.io/name=ha-467706

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_04_17T18_53_25_0700

	                    minikube.k8s.io/version=v1.33.0-beta.0

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/crio/crio.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Wed, 17 Apr 2024 18:53:24 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-467706-m04

	  AcquireTime:     <unset>

	  RenewTime:       Wed, 17 Apr 2024 18:57:09 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:24 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:24 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:24 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Wed, 17 Apr 2024 18:53:55 +0000   Wed, 17 Apr 2024 18:53:34 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.203

	  Hostname:    ha-467706-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 dd00fe12f3b54ed0af7c6ee4cc75cc20

	  System UUID:                dd00fe12-f3b5-4ed0-af7c-6ee4cc75cc20

	  Boot ID:                    af4f4186-bd72-4c86-9e7c-b804dc030414

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  cri-o://1.29.1

	  Kubelet Version:            v1.30.0-rc.2

	  Kube-Proxy Version:         v1.30.0-rc.2

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-v8r5k       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      3m48s

	  kube-system                 kube-proxy-c7znr    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         3m48s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 3m42s                  kube-proxy       

	  Normal  RegisteredNode           3m48s                  node-controller  Node ha-467706-m04 event: Registered Node ha-467706-m04 in Controller

	  Normal  NodeHasSufficientMemory  3m48s (x2 over 3m48s)  kubelet          Node ha-467706-m04 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    3m48s (x2 over 3m48s)  kubelet          Node ha-467706-m04 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m48s (x2 over 3m48s)  kubelet          Node ha-467706-m04 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m48s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           3m46s                  node-controller  Node ha-467706-m04 event: Registered Node ha-467706-m04 in Controller

	  Normal  RegisteredNode           3m44s                  node-controller  Node ha-467706-m04 event: Registered Node ha-467706-m04 in Controller

	  Normal  NodeReady                3m38s                  kubelet          Node ha-467706-m04 status is now: NodeReady

	==> dmesg <==

	[Apr17 18:49] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.053092] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.041003] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.561690] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +2.796176] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +4.989146] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000001] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +8.404684] systemd-fstab-generator[599]: Ignoring "noauto" option for root device

	[  +0.063801] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.068254] systemd-fstab-generator[612]: Ignoring "noauto" option for root device

	[  +0.163928] systemd-fstab-generator[626]: Ignoring "noauto" option for root device

	[  +0.151596] systemd-fstab-generator[638]: Ignoring "noauto" option for root device

	[  +0.299739] systemd-fstab-generator[668]: Ignoring "noauto" option for root device

	[  +4.466528] systemd-fstab-generator[768]: Ignoring "noauto" option for root device

	[  +0.062588] kauditd_printk_skb: 130 callbacks suppressed

	[  +4.060993] systemd-fstab-generator[950]: Ignoring "noauto" option for root device

	[  +0.990848] kauditd_printk_skb: 62 callbacks suppressed

	[Apr17 18:50] systemd-fstab-generator[1370]: Ignoring "noauto" option for root device

	[  +0.084981] kauditd_printk_skb: 35 callbacks suppressed

	[ +13.627165] kauditd_printk_skb: 21 callbacks suppressed

	[Apr17 18:51] kauditd_printk_skb: 72 callbacks suppressed

	==> etcd [0b4b6b19cdceaaa9c5e07ca749ed05ad4ef54e42a70f972986b9bac17eee3a04] <==

	{"level":"warn","ts":"2024-04-17T18:57:12.284358Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.293965Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.298675Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.328861Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.329871Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.330776Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.341777Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.349561Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.353612Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.357404Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.366205Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.373735Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.381081Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.381308Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.38681Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.390786Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.398898Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.407264Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.416065Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.420784Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.425816Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.438449Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.446842Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.456307Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	{"level":"warn","ts":"2024-04-17T18:57:12.481377Z","caller":"rafthttp/peer.go:267","msg":"dropped internal Raft message since sending buffer is full (overloaded network)","message-type":"MsgHeartbeat","local-member-id":"f0ef8018a32f46af","from":"f0ef8018a32f46af","remote-peer-id":"9a927b09686f3923","remote-peer-name":"pipeline","remote-peer-active":false}

	==> kernel <==

	 18:57:12 up 7 min,  0 users,  load average: 0.42, 0.18, 0.08

	Linux ha-467706 5.10.207 #1 SMP Tue Apr 16 07:56:03 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [2f2ed526ef2f9ac7bfc7074a0949f7d97e5ea5227e7baf3882d897da4753705d] <==

	I0417 18:56:39.624634       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	I0417 18:56:49.640707       1 main.go:223] Handling node with IPs: map[192.168.39.159:{}]

	I0417 18:56:49.640754       1 main.go:227] handling current node

	I0417 18:56:49.640766       1 main.go:223] Handling node with IPs: map[192.168.39.236:{}]

	I0417 18:56:49.640772       1 main.go:250] Node ha-467706-m02 has CIDR [10.244.1.0/24] 

	I0417 18:56:49.640873       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0417 18:56:49.640904       1 main.go:250] Node ha-467706-m03 has CIDR [10.244.2.0/24] 

	I0417 18:56:49.640954       1 main.go:223] Handling node with IPs: map[192.168.39.203:{}]

	I0417 18:56:49.640983       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	I0417 18:56:59.654432       1 main.go:223] Handling node with IPs: map[192.168.39.159:{}]

	I0417 18:56:59.654596       1 main.go:227] handling current node

	I0417 18:56:59.654630       1 main.go:223] Handling node with IPs: map[192.168.39.236:{}]

	I0417 18:56:59.654717       1 main.go:250] Node ha-467706-m02 has CIDR [10.244.1.0/24] 

	I0417 18:56:59.654884       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0417 18:56:59.654937       1 main.go:250] Node ha-467706-m03 has CIDR [10.244.2.0/24] 

	I0417 18:56:59.655053       1 main.go:223] Handling node with IPs: map[192.168.39.203:{}]

	I0417 18:56:59.655159       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	I0417 18:57:09.670962       1 main.go:223] Handling node with IPs: map[192.168.39.159:{}]

	I0417 18:57:09.671055       1 main.go:227] handling current node

	I0417 18:57:09.671263       1 main.go:223] Handling node with IPs: map[192.168.39.236:{}]

	I0417 18:57:09.671300       1 main.go:250] Node ha-467706-m02 has CIDR [10.244.1.0/24] 

	I0417 18:57:09.671515       1 main.go:223] Handling node with IPs: map[192.168.39.250:{}]

	I0417 18:57:09.671547       1 main.go:250] Node ha-467706-m03 has CIDR [10.244.2.0/24] 

	I0417 18:57:09.671611       1 main.go:223] Handling node with IPs: map[192.168.39.203:{}]

	I0417 18:57:09.671616       1 main.go:250] Node ha-467706-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [d1e96d91894cf944f472f9327a83705e9c8e8e4edd31fdb0a902e1b7d3b2d14f] <==

	I0417 18:50:04.318202       1 controller.go:615] quota admission added evaluator for: deployments.apps

	I0417 18:50:04.355194       1 alloc.go:330] "allocated clusterIPs" service="kube-system/kube-dns" clusterIPs={"IPv4":"10.96.0.10"}

	I0417 18:50:04.378610       1 controller.go:615] quota admission added evaluator for: daemonsets.apps

	I0417 18:50:16.846627       1 controller.go:615] quota admission added evaluator for: replicasets.apps

	I0417 18:50:16.894909       1 controller.go:615] quota admission added evaluator for: controllerrevisions.apps

	E0417 18:52:26.096584       1 writers.go:122] apiserver was unable to write a JSON response: http: Handler timeout

	E0417 18:52:26.096677       1 status.go:71] apiserver received an error that is not an metav1.Status: &errors.errorString{s:"http: Handler timeout"}: http: Handler timeout

	E0417 18:52:26.096707       1 finisher.go:175] FinishRequest: post-timeout activity - time-elapsed: 9.196µs, panicked: false, err: context canceled, panic-reason: <nil>

	E0417 18:52:26.098071       1 writers.go:135] apiserver was unable to write a fallback JSON response: http: Handler timeout

	E0417 18:52:26.098305       1 timeout.go:142] post-timeout activity - time-elapsed: 1.438942ms, POST "/api/v1/namespaces/kube-system/events" result: <nil>

	E0417 18:52:53.633381       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:32846: use of closed network connection

	E0417 18:52:53.851620       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55360: use of closed network connection

	E0417 18:52:54.066049       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55380: use of closed network connection

	E0417 18:52:54.312073       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55394: use of closed network connection

	E0417 18:52:54.530310       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55398: use of closed network connection

	E0417 18:52:54.749321       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55418: use of closed network connection

	E0417 18:52:54.970072       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55426: use of closed network connection

	E0417 18:52:55.170376       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55456: use of closed network connection

	E0417 18:52:55.363232       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55474: use of closed network connection

	E0417 18:52:55.704964       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55496: use of closed network connection

	E0417 18:52:55.917674       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55522: use of closed network connection

	E0417 18:52:56.149324       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55548: use of closed network connection

	E0417 18:52:56.358780       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55554: use of closed network connection

	E0417 18:52:56.573732       1 conn.go:339] Error on socket receive: read tcp 192.168.39.254:8443->192.168.39.1:55562: use of closed network connection

	W0417 18:54:12.608672       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.159 192.168.39.250]

	==> kube-controller-manager [644754e2725b2c54326d7424afa917ad298b867b229958f776f120be3114457e] <==

	I0417 18:51:16.104067       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-467706-m02"

	I0417 18:52:25.246945       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-467706-m03\" does not exist"

	I0417 18:52:25.263499       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-467706-m03" podCIDRs=["10.244.2.0/24"]

	I0417 18:52:26.133648       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-467706-m03"

	I0417 18:52:49.983995       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="111.444635ms"

	I0417 18:52:50.033279       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="49.02233ms"

	I0417 18:52:50.161420       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="128.074688ms"

	I0417 18:52:50.383994       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="222.50029ms"

	I0417 18:52:50.433875       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="49.821909ms"

	I0417 18:52:50.434037       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="104.115µs"

	I0417 18:52:51.508597       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="65.721µs"

	I0417 18:52:52.536956       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="17.409602ms"

	I0417 18:52:52.537269       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="205.901µs"

	I0417 18:52:53.029529       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="45.842838ms"

	I0417 18:52:53.029630       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="64.918µs"

	I0417 18:52:53.104812       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="14.029182ms"

	I0417 18:52:53.105468       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="56.414µs"

	E0417 18:53:24.007584       1 certificate_controller.go:146] Sync csr-gt8sv failed with : error updating signature for csr: Operation cannot be fulfilled on certificatesigningrequests.certificates.k8s.io "csr-gt8sv": the object has been modified; please apply your changes to the latest version and try again

	I0417 18:53:24.279715       1 actual_state_of_world.go:543] "Failed to update statusUpdateNeeded field in actual state of world" logger="persistentvolume-attach-detach-controller" err="Failed to set statusUpdateNeeded to needed true, because nodeName=\"ha-467706-m04\" does not exist"

	I0417 18:53:24.315391       1 range_allocator.go:381] "Set node PodCIDR" logger="node-ipam-controller" node="ha-467706-m04" podCIDRs=["10.244.3.0/24"]

	I0417 18:53:26.172529       1 node_lifecycle_controller.go:879] "Missing timestamp for Node. Assuming now as a timestamp" logger="node-lifecycle-controller" node="ha-467706-m04"

	I0417 18:53:34.662934       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-467706-m04"

	I0417 18:54:39.012020       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-467706-m04"

	I0417 18:54:39.148264       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="46.816388ms"

	I0417 18:54:39.148404       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="57.341µs"

	==> kube-proxy [fe8aab67cc3728c03cc31fe03f8dcc41eea7026f159c3e2994435fdcef199ae1] <==

	I0417 18:50:18.091985       1 server_linux.go:69] "Using iptables proxy"

	I0417 18:50:18.123753       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.159"]

	I0417 18:50:18.174594       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0417 18:50:18.174693       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0417 18:50:18.174745       1 server_linux.go:165] "Using iptables Proxier"

	I0417 18:50:18.177785       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0417 18:50:18.178232       1 server.go:872] "Version info" version="v1.30.0-rc.2"

	I0417 18:50:18.178431       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0417 18:50:18.179602       1 config.go:192] "Starting service config controller"

	I0417 18:50:18.179652       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0417 18:50:18.179690       1 config.go:101] "Starting endpoint slice config controller"

	I0417 18:50:18.179706       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0417 18:50:18.180692       1 config.go:319] "Starting node config controller"

	I0417 18:50:18.180731       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0417 18:50:18.279797       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0417 18:50:18.279873       1 shared_informer.go:320] Caches are synced for service config

	I0417 18:50:18.281317       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [7f539c70ed4df5c369ed8cb3c4de4844ed7e03feafa36a10437c0946f4ca3d9c] <==

	W0417 18:50:01.055262       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	E0417 18:50:01.058446       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope

	W0417 18:50:01.902822       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0417 18:50:01.902927       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0417 18:50:01.966916       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0417 18:50:01.967036       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0417 18:50:01.967229       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0417 18:50:01.967646       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0417 18:50:02.044397       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0417 18:50:02.045012       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0417 18:50:02.094905       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0417 18:50:02.096485       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0417 18:50:02.376262       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0417 18:50:02.376346       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	I0417 18:50:04.574514       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0417 18:52:25.323167       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-5mvhn\": pod kindnet-5mvhn is already assigned to node \"ha-467706-m03\"" plugin="DefaultBinder" pod="kube-system/kindnet-5mvhn" node="ha-467706-m03"

	E0417 18:52:25.323308       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 1d1c6ddb-22cf-489e-8958-41434cbf8b0c(kube-system/kindnet-5mvhn) wasn't assumed so cannot be forgotten" pod="kube-system/kindnet-5mvhn"

	E0417 18:52:25.323334       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-5mvhn\": pod kindnet-5mvhn is already assigned to node \"ha-467706-m03\"" pod="kube-system/kindnet-5mvhn"

	I0417 18:52:25.323383       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kindnet-5mvhn" node="ha-467706-m03"

	E0417 18:52:25.324325       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-jlcq7\": pod kube-proxy-jlcq7 is already assigned to node \"ha-467706-m03\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-jlcq7" node="ha-467706-m03"

	E0417 18:52:25.324409       1 schedule_one.go:338] "scheduler cache ForgetPod failed" err="pod 05590f74-8ea6-42ef-9d72-33e15cfd3a32(kube-system/kube-proxy-jlcq7) wasn't assumed so cannot be forgotten" pod="kube-system/kube-proxy-jlcq7"

	E0417 18:52:25.324432       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-jlcq7\": pod kube-proxy-jlcq7 is already assigned to node \"ha-467706-m03\"" pod="kube-system/kube-proxy-jlcq7"

	I0417 18:52:25.324451       1 schedule_one.go:1061] "Pod has been assigned to node. Abort adding it back to queue." pod="kube-system/kube-proxy-jlcq7" node="ha-467706-m03"

	E0417 18:53:24.402687       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kindnet-wth9x\": pod kindnet-wth9x is already assigned to node \"ha-467706-m04\"" plugin="DefaultBinder" pod="kube-system/kindnet-wth9x" node="ha-467706-m04"

	E0417 18:53:24.402914       1 schedule_one.go:1048] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kindnet-wth9x\": pod kindnet-wth9x is already assigned to node \"ha-467706-m04\"" pod="kube-system/kindnet-wth9x"

	==> kubelet <==

	Apr 17 18:53:04 ha-467706 kubelet[1377]: E0417 18:53:04.307805    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:53:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:53:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:53:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:53:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:54:04 ha-467706 kubelet[1377]: E0417 18:54:04.306427    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:54:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:54:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:54:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:54:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:55:04 ha-467706 kubelet[1377]: E0417 18:55:04.305151    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:55:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:55:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:55:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:55:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:56:04 ha-467706 kubelet[1377]: E0417 18:56:04.307844    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:56:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:56:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:56:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:56:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Apr 17 18:57:04 ha-467706 kubelet[1377]: E0417 18:57:04.304401    1377 iptables.go:577] "Could not set up iptables canary" err=<

	Apr 17 18:57:04 ha-467706 kubelet[1377]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Apr 17 18:57:04 ha-467706 kubelet[1377]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Apr 17 18:57:04 ha-467706 kubelet[1377]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Apr 17 18:57:04 ha-467706 kubelet[1377]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-467706 -n ha-467706

helpers_test.go:261: (dbg) Run:  kubectl --context ha-467706 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/RestartSecondaryNode FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/RestartSecondaryNode (51.64s)